# Disallow all crawlers access to certain pages. User-agent: * Disallow: /etc Disallow: /logs Disallow: /cgi-bin Disallow: /tmp Disallow: /tmp_cap