# robots.txt file for MichaelMcElhiney.com User-agent: ia_archiver Disallow: / User-agent: Googlebot Disallow: /*.gif$ Disallow: /*.jpg$ User-agent: * Disallow: /default.html # September 16, 2009 # # Similar to concept mentioned at The Google Cache # http://www.thegooglecache.com/uncategorized/exclude-by-keyword-thoughts-on-spam-and-robotstxt/ # # This concept would also include the option of multiple words in the specified string with the use of # quotations. This concept would not disallow the search engine to crawl pages with the specified string. # This concept would disallow any pages on the entire site from being listed in results that are returned # from the search engine when a user searches for the specified string, while the pages would not be # excluded from results that are returned from the search engine when a user searches for strings such as # "michael mcelhiney" Disallow-by-key: "michael patrick mcelhiney" # For more information about this development, contact: # # Patrick R. McElhiney # patrick@mce123.com