Why google crawl few sites so frequently ?

Discussion in 'Google' started by jackPeterson, Apr 18, 2012.

0
  1. #1
    Hello Everyone !
    Will any body suggest me why google crawl few sites so frequently, i mean to say 5 times a day ?
     
    jackPeterson, Apr 18, 2012 IP
  2. Chandantiwari

    Chandantiwari Greenhorn

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #2
    These are some factors which must help to increase google crawl rate:


    1) Update website content
    2) Good Web Page Load Time
    4) Good Internal Link Structure
    5) Get backlinks from high pr and regularly crwaled sites
    6) Each pages of websites have unique meta tags
    7) Adjust the crawl speed via webmaster tool
    8) Create Sitemap
     
    Chandantiwari, Apr 18, 2012 IP
  3. alamest

    alamest Well-Known Member

    Messages:
    277
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    133
    #3
    I agree with Chandantiwari, you need to follw all that 8 points and it will start automatically start crawling faster, updating content is important..
     
    alamest, Apr 18, 2012 IP
  4. patco

    patco Well-Known Member

    Messages:
    2,035
    Likes Received:
    47
    Best Answers:
    17
    Trophy Points:
    100
    #4
    Because they update their content VERY frequently and of course because a lot of people ping it ;)
     
    patco, Apr 19, 2012 IP
  5. knysna

    knysna Peon

    Messages:
    81
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Its called popularity
     
    knysna, Apr 20, 2012 IP
  6. kevinanderson1

    kevinanderson1 Peon

    Messages:
    71
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Very rightly said the more you update the content the better the crawl rate, also the no of back links to your website is important. A xml sitemap also helps improve the crawl rate.
     
    kevinanderson1, Apr 20, 2012 IP
  7. ThePassiveIncomeBlog

    ThePassiveIncomeBlog Active Member

    Messages:
    847
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    50
    #7
    Sites are updating frequently and bookmarking with famous social networks will be indexed fast and frequent by Google.
     
    ThePassiveIncomeBlog, Apr 20, 2012 IP
  8. josefaryan

    josefaryan Member

    Messages:
    1,473
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    45
    #8
    New/Fresh/Quality/Relevant content in your website can help in getting crawled by google regularly.
     
    josefaryan, Apr 22, 2012 IP
  9. SoftDev

    SoftDev Well-Known Member

    Messages:
    589
    Likes Received:
    10
    Best Answers:
    1
    Trophy Points:
    130
    #9
    because they are trusted due to the following reasons, high page rank, quality content, no duplicates, no keyword stuffing, no spammy links etc..
     
    SoftDev, Apr 25, 2012 IP
  10. cdesigner

    cdesigner Peon

    Messages:
    318
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #10
    It depends upon the crawl rate.Crawl rate is determined by detecting the change frequency.
    You dont have to worry about the crawl rate if you site is updated frequently you site will be updated frequently in the google's database.
    All this might not work if you site is not listed in Google. you should know that you can invite google's crawler by sending a ping.
    FYI you can also specify frequency in sitemap.
     
    cdesigner, Apr 25, 2012 IP
  11. GMTGuy

    GMTGuy Greenhorn

    Messages:
    37
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #11
    Robot.txt maybe blocking the crawler, your sitemap may be telling Google not to crawl things very frequently(not sure if bot listens to that or not), you may not have much content or very many back links so Google may low prioritize your site.
     
    GMTGuy, Apr 25, 2012 IP
  12. Genesis1

    Genesis1 Peon

    Messages:
    644
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Mostly because of the content and plugins
     
    Genesis1, Apr 25, 2012 IP
  13. jonewatson80

    jonewatson80 Member

    Messages:
    19
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    38
    #13
    Well, maybe it because those sites are updated frequently and it had a quality content. Since, Google also crawl those sites that had a unique content aside from it's backlinks and traffic.
     
    jonewatson80, Jul 8, 2012 IP
  14. igor_k

    igor_k Greenhorn

    Messages:
    409
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    23
    #14
    try to ping your site – Add new content to your site frequently as Google like new contents. Ping your site after adding new content.  A lot of time, Google with Cache your site instantly after the Ping. Pinging your site is the online equivalent of waving a flag and yelling, “Hey! Check this Out! We have new content here.” to search engines.
     
    igor_k, Jul 8, 2012 IP