Determine if User Agent is a crawler?

[Bill]

Is there a fast way, with Classic ASP, to determine if a user agent is a search engine
spider?

I know that ASP.NET has Request.Browser.Crawler, I'm looking to see if classic ASP has
something built in, or do I have to look for strings in the user agent.

Thanks!

 

[David Morgan]

Check Request.ServerVariables("HTTP_USER_AGENT") for crawler, spider and
bot. Most search crawlers have something like that in their user agent
string.