# Disallow all crawlers access to certain pages. User-agent: * Disallow: /cgi-bin/ Disallow: /cad/ Disallow: /auditoria/ Disallow: /sgp/ Disallow: /users/ Disallow: /_notes/ Disallow: /banners/ Disallow: /cgi-local/ Disallow: /newsletter/ User-agent: webreaper Disallow: /