Google Crawling Process

Discussion in 'Guidelines / Compliance' started by harihan, Aug 16, 2010.

  1. #1
    Google's spider follow html link for crawling website but what is the process like how they crawl all the pages from one page. Crawling is start from left upper side and ends at right bottom side. if they found any link for other page in between then they will move on another page then what about remaining page and remaining links from the same page?
     
    harihan, Aug 16, 2010 IP
  2. JamesColin

    JamesColin Prominent Member

    Messages:
    7,874
    Likes Received:
    164
    Best Answers:
    1
    Trophy Points:
    395
    Digital Goods:
    1
    #2
    I guess they first take all the links from the page and then have a method to crawl them, I don't believe they need to do it in order. But I don't know.
     
    JamesColin, Aug 23, 2010 IP
  3. harihan

    harihan Peon

    Messages:
    29
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I think there must be some process for crawling. I am still search answer for the same. Anyways, thanks for sharing your ideas.
     
    harihan, Aug 25, 2010 IP
  4. James K

    James K Peon

    Messages:
    1
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I guess nobody really knows about the Google crawling process - it is a closely guarded and constantly changing secret!
     
    James K, Aug 25, 2010 IP
  5. billyw

    billyw Well-Known Member

    Messages:
    119
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    133
    #5
    Is Google Crawling the same as Yahoo's Slurp?
    I have seen both on my site, right after new content is added.
     
    billyw, Aug 26, 2010 IP
  6. jas1414

    jas1414 Peon

    Messages:
    162
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    crawling start from left upper side of page and go to right side bottom it true.... once you create site map and submitted then it stored in data base and when ever you update and content or meta information for website then it come again and visit in same way with fresh content and information what so ever you update...

    if any body know more then please let us know about it
     
    jas1414, Aug 26, 2010 IP
  7. Ekonson

    Ekonson Guest

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    I think is it some thing secret that how google crawl. I thing googlebot is one of the best process to crawl that may google follow.
     
    Ekonson, Aug 27, 2010 IP
  8. الريم

    الريم Peon

    Messages:
    1
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    شكرا واعتذر انا لا اتحدث الانجليزيه ولكن الزحف ياتي دائما عندما يكون الموقع ذو محتوى جيد وغير مكرر لان قوقل يهتم بالاشياء الجديده والمفيده على حد ما سمعت وقرائت بوركتم
     
    الريم, Aug 29, 2010 IP
  9. Aquarezz

    Aquarezz Notable Member

    Messages:
    3,009
    Likes Received:
    69
    Best Answers:
    0
    Trophy Points:
    225
    #9
    They crawl the complete package, so what difference does it make if it's from right-bottom to left-top or opposite? Logically it's probably starting from the upper left corner and than heading downwards though.
     
    Aquarezz, Aug 29, 2010 IP
  10. anubhavnair

    anubhavnair Guest

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    As far as I know, though it starts from upper left corner it never considers logo and the alt text for indexing. So it is advisable to use the primary keyword at the top of the page in H1 header tag. Similarly it is better to end the website using the same keyword.
    This gives an indication to crawler about the main theme of the webpage. This is what i know. If anyone knows anything extra please share!!
     
    anubhavnair, Aug 29, 2010 IP
  11. mich.ewriter

    mich.ewriter Member

    Messages:
    151
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #11
    Wel not too a secret...He has done great for sharing the great idea and will search more
     
    mich.ewriter, Aug 29, 2010 IP
  12. anubhavnair

    anubhavnair Guest

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    I read some where today that Google now crawls wordpress blogs immediately after a post is made. This is awesome as they have really evolved themselves...
     
    anubhavnair, Aug 30, 2010 IP
  13. nicefirework

    nicefirework Peon

    Messages:
    61
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #13
    In my opinion google sent robot to crawl your site called googlebot. this robot will scan your web, extract meta title, description, content and link. I.f the link is dofollow, this robot will open link and scan other page. Its depend on your authority site called pagerank, how importance your page to get indexed and how often this robot should came back to your site.
     
    nicefirework, Aug 30, 2010 IP
  14. jfseostudio.com

    jfseostudio.com Well-Known Member

    Messages:
    142
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    128
    #14
    I'd say from top to bottom but as far as left to right or right to left I'm not sure. However, since Google is so edu studious oriented i'd guess left to right formally like a US college book.
     
    jfseostudio.com, Aug 31, 2010 IP