# robots.txt file # www.mosescone.com # Updated 11/24/2009 # Version 4.0 - 11/24/09 # BASIC robots.txt file for sitemaker websites. # Must be named "robots.txt" and be in the root folder. # Certain files excluded. # Exclude some User-agent: * Disallow: /blank Disallow: /BLANK Disallow: /print Disallow: /PRINT User-agent: Googlebot Disallow: /blank Disallow: /BLANK Disallow: /print Disallow: /PRINT Disallow: /?src= Disallow: /body.cfm/ Disallow: /body.cfm.cfm Disallow: /Basi Disallow: /Body Disallow: /Care Disallow: /Clin Disallow: /Defa Disallow: /Home Disallow: /Land Disallow: /Smt_ User-agent: gsa-crawler Disallow: /blank Disallow: /BLANK Disallow: /print Disallow: /PRINT Disallow: /1