# robots.txt,v 1.0 2001/10/11 # # This is a file retrieved by webwalkers a.k.a. spiders that # conform to a defacto standard. # See # # For updates to this file please contact aheswat@us.ibm.com # # Format is: # User-agent: # Disallow: | # # PLEASE NOTE: Specific crawlers should be added BELOW User-agent: * # ----------------------------------------------------------------------------- User-agent: * Disallow: /lenovo/shop/ Disallow: /CommunityCBR/ Disallow: /solutions/sap/doc/content/bin #Disallow: /support/ User-agent: Googlebot Disallow: /lenovo/shop/ Disallow: /CommunityCBR/ Disallow: /solutions/sap/doc/content/bin #Allow Corporate Fast Crawler User-agent: Fast Corporate Crawler Disallow: /support/ #Allow-agent BTAccessibility for CIO web standards reporting (WSR) project User-agent: BTAccessibility