# See http://www.robotstxt.org/wc/norobots.html for documentation on # how to use the robots.txt file # Ban a number of utility methods and pages. User-Agent: * Disallow: /users/login # Login method, POST only Disallow: /users/validate_attribute # Needs a parameter and only makes sense when used interactively Disallow: /welcome/send_mail # Used to provide feedback, POST only Sitemap: /sitemap.xml