User-agent: * Disallow: /thankyou.htm Disallow: /subscribed.htm Disallow: /unsubscribed.htm Disallow: /cgi-bin/ Disallow: /xim12/ Disallow: /foxes.book.of.martyrs/foxes.introduction.htm Disallow: /foxes.book.of.martyrs/f1jxz/ Disallow: /f/christian.zip Disallow: /404.html User-agent: FDSE Disallow: /store/ Disallow: /wigglesworth/ User-agent: * Disallow: / User-agent: Googlebot Allow: / User-agent: Googlebot-Mobile Allow: / User-agent: FDSE Allow: / User-agent: slurp Allow: / User-agent: msnbot Allow: / User-agent: Teoma Allow: / User-agent: Gigabot Allow: / User-agent: YahooFeedSeeker Allow: / User-agent: YahooFeedSeeker Testing Allow: / User-agent: YahooMobile Allow: / User-agent: msnbot-NewsBlogs Allow: / User-agent: Yahoo-Test/ Allow: / User-agent: NewsGatorOnline Allow: / User-agent: NewsGator Allow: / User-agent: DoCoMo Allow: / User-agent: MSR-ISRCCrawler Allow: / User-agent: Googlebot-Image Disallow: / User-agent: Teoma #Ask's new image bot ignores exclusion, see if it obeys this Disallow: /xim12/ Disallow: /foxes.book.of.martyrs/f1jxz/ User-agent: Yahoo-MMCrawler #Yahoo's image bot Disallow: / User-agent: Yahoo-MMCrawler/3.x Disallow: /