# robots.txt for site http://www.cyberauto.com/ User-agent: * Disallow: /cgi-bin/ Disallow: /analog/ Disallow: /error/ # Added 25Oct06, CPM # Prevents spidering of useless phpBB files User-agent: * #Disallow: /forums/viewtopic.php #Disallow: /forums/viewforum.php #Disallow: /forums/index.php? #Took these out because I wasn't sure if they might be blocking the indexing #of the forums. This may have been suggested as part of the SID-removal mod #that I never got to work properly... Disallow: /forums/posting.php Disallow: /forums/groupcp.php Disallow: /forums/search.php Disallow: /forums/login.php Disallow: /forums/post Disallow: /forums/member Disallow: /forums/profile.php Disallow: /forums/memberlist.php Disallow: /forums/faq.php