User-agent: * Disallow: /_private/ Disallow: *.asp Disallow: /HTTPERRORS/ User-agent: Wget Disallow: / Disallow: /images/ Disallow: /pdf/