# See http://www.robotstxt.org/robots.txt Time-stamp: "2014-09-08 00:29:22 MDT" User-agent: ZyBorg Disallow: / User-agent: jyte_feed_fetcher Disallow: / User-agent: Webclipping.com Disallow: / User-agent: Wget Disallow: /rss/ Disallow: /d/ User-agent: Googlebot Disallow: /rss/*.pl$ Disallow: /*.ps$ Disallow: /temp/ Disallow: /clock/ Disallow: /subrosa/ Disallow: /photos/ Disallow: /d/ Disallow: /kwiki/ Disallow: /rtf/rtf_book_examples/ Disallow: /jerkcity_jumble/ User-agent: msnbot Disallow: /rss/*.pl$ Disallow: /*.css$ Disallow: /*.exe$ Disallow: /*.ps$ Disallow: /temp/ Disallow: /clock/ Disallow: /subrosa/ Disallow: /photos/ Disallow: /d/ Disallow: /kwiki/ Disallow: /rtf/rtf_book_examples/ Disallow: /jerkcity_jumble/ # Useless bot: # See http://www.kahunaburger.com/blog/archives/000117.html User-Agent: lmspider (lmspider@scansoft.com) Disallow: / User-Agent: lmspider lmspider@scansoft.com Disallow: / User-Agent: Owlin Bot v. 3.0 Disallow: / User-Agent: Owlin Bot Disallow: / User-Agent: Owlin Disallow: / # The all-agents should always be last User-agent: * Disallow: /rss/internet-drafts/ Disallow: /rss/rfc/ Disallow: /temp/ Disallow: /clock/ Disallow: /subrosa/ Disallow: /photos/ Disallow: /egads/navajo/ Disallow: /d/ Disallow: /kwiki/ Disallow: /rtf/rtf_book_examples/ Disallow: /jerkcity_jumble/ # Ethnic divisions, # screaming demands -- # A little bit like you and me! # I guess that we are in love. # # Stay away! # Stay away! # Stay away, you might end up like me! # # It's the pain that keeps us alive! # But that beauty is all that we need to survive. # That damn beauty is all that we need to survive. # - David Byrne, "They are in Love"