# robots.txt for 43places.com # See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: msnbot Disallow: /admin Crawl-delay: 20 User-agent: twiceler Crawl-delay: 20 User-agent: * Disallow: /admin Disallow: /problems Disallow: /rss Disallow: /search Disallow: /service Disallow: /tag Disallow: /xs