# This file is read and obeyed by polite search engines # Please refer to the W3C notes: # http://www.w3.org/TR/html4/appendix/notes.html#h-B.4.1.1 # or http://info.webcrawler.com/mak/projects/robots/exclusion.html User-agent: * # add directories to keep out of search engines Disallow: /dealers/policy/ Disallow: /jsp/review/ Disallow: /bb/ Disallow: /newsletter/ # Turn away unwanted search engines # Rover is a bad dog User-agent: Roverbot Disallow: /