User-agent: * Disallow: /actions/ # These robots are banned for accessing invalid URLs. This could be because: # Their parser is broken # They try to follow javascript: urls # They are trying to access parent directories User-agent: Sphere Scout&v4.0 (beta) - scout at sphere dot com Disallow: / User-agent: ShopWiki Disallow: / User-agent: TMCrawler Disallow: /