Problems with crawlers

T

TomislaW

I try to trace users on my web page

In global.asax.cs on Application_BeginRequest I check if user has my cookie,
if not I give him new cookie (integer identity number from database). When
session ends I save in database some information (names of pages he
visited). I don't want to save what crawlers (Google, yahoo.) do on my page,
but don't know how to do that.

I have one more problem with crawlers; some of them come to my site with
wrong query string. My web site is multilingual and typically my pages looks
like this page1.aspx?id=123&lang=en, page2.aspx?id=4&lang=fr etc., but some
crawlers come to my site with page.aspx?id =1&lang=en?lang=de or
page2? Id=3&lang=en?lang=en?lang=hr and I don't know how to
avoid this.
 

Ask a Question

Want to reply to this thread or ask your own question?

You'll need to choose a username for the site, which only take a couple of moments. After that, you can post your question and our members will help you out.

Ask a Question

Members online

Forum statistics

Threads
473,968
Messages
2,570,149
Members
46,695
Latest member
StanleyDri

Latest Threads

Top