User-agent: * Disallow: *.aspx Disallow: *.asp Disallow: *?* Allow: .htm$ Allow: .html$