Search code examples
asp.netsessiongooglebotgoogle-crawlers

Does googlebot keep sessions when crawling?


When googlebot crawls pages does it have session? For example I am storing some variables on the session and using them in my site's pages. When googlebot crawls these pages will I still have the session-variables? In my global.asax I am storing some variables on the session at session start. Will I have any problem with Google bot?


Solution

  • The answer to one of your question is: yes, you will have problems with Google bot.

    Generally we've encountered two types of issues with google bot:

    1. it sometimes does not retain HTTP cookies between requests. Our application relies on custom cookies and the there were plenty of google bot requests caught to carry no cookies at all.

    2. it makes long breaks between consecutive requests. For example, it retrieves your page and asks for it's scripts later on.

    Both will cause troubles with your session. First - you need a precise ASPNETSessionID cookie to be passed between requests. Googlebot will probably sometimes fail to do that. Second - if there's a long timespan between requests, your session is going to terminate even if the cookie is there.