does the googlebot have cookies enabled?

Discussion in 'Google' started by monosodium, Jul 6, 2007.

  1. #1
    anyone know whether the google crawler eats cookies?
     
    monosodium, Jul 6, 2007 IP
  2. MatthewN

    MatthewN Well-Known Member

    Messages:
    859
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    195
    #2
    I am not sure on this. I thought not, but have seen some weird things happen on a few sites when a googlebot crawled and seemed to access areas it shouldnt have.
     
    MatthewN, Jul 6, 2007 IP
  3. monosodium

    monosodium Well-Known Member

    Messages:
    1,028
    Likes Received:
    50
    Best Answers:
    0
    Trophy Points:
    100
    #3
    monosodium, Jul 6, 2007 IP
  4. mvandemar

    mvandemar Notable Member

    Messages:
    2,409
    Likes Received:
    307
    Best Answers:
    0
    Trophy Points:
    230
    #4
    No, bro, that page does not indicate that Gbot has either cookies or Javascript enabled. You have them enabled, so you see what you need to when viewing the cache.

    Gbot does not have them enabled, although there is functionality to allow Google's AdSense bot to access login only areas. You have to set that up in your AdSense account though.

    -Michael
     
    mvandemar, Jul 6, 2007 IP
  5. oseymour

    oseymour Well-Known Member

    Messages:
    3,960
    Likes Received:
    92
    Best Answers:
    0
    Trophy Points:
    135
    #5
    I have never seen evidence that Googlebot uses cookies
     
    oseymour, Jul 6, 2007 IP
  6. hamidof

    hamidof Peon

    Messages:
    619
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Google bot has cookies enabled, because on my forums, there is always one Google Bot, but there are sometimes 20 Yahoo or MSN bots.

    That is because Yahoo just opens a page and then opens another page and VB counts each one as a separate visitor, BUT, Google Bot recieves and sends back the cookies from my forums and that's why only it's position on the forum changes!
     
    hamidof, Jul 6, 2007 IP
  7. mvandemar

    mvandemar Notable Member

    Messages:
    2,409
    Likes Received:
    307
    Best Answers:
    0
    Trophy Points:
    230
    #7
    No, that's not why, you just made that up.

    Gbot wil spider thousands of pages using the same IP address, so is seen as 1 visitor... Yahoo will use tons of diff ones for each spidering session.

    -Michael
     
    mvandemar, Jul 6, 2007 IP
  8. hamidof

    hamidof Peon

    Messages:
    619
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Haha... Even if it changes it's IP addresses and sends back the same cookies, then it will count as the same visitor!

    That's the best I can explain this.
     
    hamidof, Jul 6, 2007 IP
  9. mvandemar

    mvandemar Notable Member

    Messages:
    2,409
    Likes Received:
    307
    Best Answers:
    0
    Trophy Points:
    230
    #9
    No. The point is that it doesn't change IP addresses, so doesn't need to send a cookie to be seen as the same visitor.

    -Michael
     
    mvandemar, Jul 6, 2007 IP
  10. Chessclan

    Chessclan Member

    Messages:
    57
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #10
    I would suggest you to use linx browser (Linux based text browser) to test your site. Google says their crawlers are based on linx browser functionality.
    As for myself I doubt they have cookies support.
     
    Chessclan, Jul 6, 2007 IP
  11. hamidof

    hamidof Peon

    Messages:
    619
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    0
    #11
    That is because it sends VB's session cookie back, so VB only makes one session for it, and Yahoo doesn't, that's why it makes 20 sessions for Yahoo at once:)
     
    hamidof, Jul 6, 2007 IP
  12. mvandemar

    mvandemar Notable Member

    Messages:
    2,409
    Likes Received:
    307
    Best Answers:
    0
    Trophy Points:
    230
    #12
    No, it doesn't! Why on earth do you keep saying it does? It's just not true!

    -Michael
     
    mvandemar, Jul 6, 2007 IP
  13. hamidof

    hamidof Peon

    Messages:
    619
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Michael, I have technical evidence that is does, I don't say "It's just true":)
     
    hamidof, Jul 6, 2007 IP
  14. mvandemar

    mvandemar Notable Member

    Messages:
    2,409
    Likes Received:
    307
    Best Answers:
    0
    Trophy Points:
    230
    #14
    What evidence?

    -Michael
     
    mvandemar, Jul 6, 2007 IP
  15. hamidof

    hamidof Peon

    Messages:
    619
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Read my previous posts, a web developer would understand this very easy.

    BTW, why are you saying that it doesn't understand cookies?
     
    hamidof, Jul 6, 2007 IP
  16. mvandemar

    mvandemar Notable Member

    Messages:
    2,409
    Likes Received:
    307
    Best Answers:
    0
    Trophy Points:
    230
    #16
    Your precious posts state that the reason you believe it is because it only shows on Gbot on your vb site at a time, whereas it shows multiple Yahoo bots. Correct? That's your evidence?

    Because I am a programmer and know how these things work. I can actually prove it, but I'm not sure you would be able to even understand the proof. Even your phrasing about whether or not it "understands" cookies leads me to believe you don't know what it is.

    -Michael
     
    mvandemar, Jul 6, 2007 IP
  17. hamidof

    hamidof Peon

    Messages:
    619
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    0
    #17
    What is your proof?
     
    hamidof, Jul 6, 2007 IP
  18. hamidof

    hamidof Peon

    Messages:
    619
    Likes Received:
    44
    Best Answers:
    0
    Trophy Points:
    0
    #18
    I honestly doubt both of these:)
     
    hamidof, Jul 6, 2007 IP
  19. mvandemar

    mvandemar Notable Member

    Messages:
    2,409
    Likes Received:
    307
    Best Answers:
    0
    Trophy Points:
    230
    #19
    Before I spend an hour setting it up, wth is yours? Are you only talking what you already posted?

    -Michael
     
    mvandemar, Jul 6, 2007 IP
  20. Sleepy_Sentry

    Sleepy_Sentry Well-Known Member

    Messages:
    869
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    110
    #20
    Yes, the googlebot does eat cookies. It requires an hourly supply of cookies, otherwise it refuses to continue crawling. Usually Sergey feeds it a few Oreos, but sometimes it gets Chips Ahoy as a special treat.
     
    Sleepy_Sentry, Jul 6, 2007 IP