############################### # # sample robots.txt file for this website # # addresses all robots by using wild card * # User-agent: * # list folders robots are not allowed to index Disallow: /cgi-bin/ Disallow: /images/ Disallow: /scripts/ Disallow: /rejoice/ Disallow: /outsourced/ Disallow: /Tutorials/ Disallow: /training/ Disallow: /login/ Disallow: /images/ Disallow: /ccc/ Disallow: /wedding-pastor/ Disallow: /entropybanner/ Disallow: /BT/ Disallow: /temp/ Disallow: /lotm/ Disallow: /newsletter/ Disallow: /joomla153/ Disallow: /jjr/ Disallow: /ds/ Disallow: /dt-w/ Disallow: /sr/ Disallow: /rejoice/ Disallow: /test_blog/ Disallow: /drupal/ Disallow: /CRM/ Disallow: /Tutorials/ Disallow: /Connection/ Disallow: /Buttons/ Disallow: /surfboaredrecords/ Disallow: /drupal/ Disallow: /Connection/ Disallow: /bt-assoc/ Disallow: /btassoc/ Disallow: /_private/ # # list specific files robots are not allowed to index #Disallow: /meta_tags.html # # End of robots.txt file # ###############################