Webmaster Tools - Crawl Rate

Discussion in 'Google' started by dnoah, Feb 7, 2010.

  1. #1
    What is the purpose of adjusting the crawl rate in google webmaster tools?

    Will setting a higher google crawl rate result in pages being indexed quicker as you add them to your website?
     
    dnoah, Feb 7, 2010 IP
  2. sanjeewamad

    sanjeewamad Peon

    Messages:
    573
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Best option is to let Google determine the crawl rate.
     
    sanjeewamad, Feb 7, 2010 IP
  3. thanapa

    thanapa Well-Known Member

    Messages:
    527
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    125
    #3
    thanapa, Feb 8, 2010 IP
  4. alamest

    alamest Well-Known Member

    Messages:
    277
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    133
    #4
    I think it tells about our domain and how many time it crawls It means how many time people have seen your website but didn't clicked it. I think it works like that..

    I hope this helps.
     
    alamest, Feb 8, 2010 IP
  5. Ascendancy

    Ascendancy Active Member

    Messages:
    1,721
    Likes Received:
    31
    Best Answers:
    0
    Trophy Points:
    90
    #5
    I am wondering this a lot, I have tried pinging different articles and services but it doesn't seem to help much. I find that submitting a Sitemap works, but that's very difficult to keep up with on some websites.
     
    Ascendancy, Feb 8, 2010 IP
  6. peterson82

    peterson82 Peon

    Messages:
    228
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Update your content often and regularlya ,Make sure your server works correctly, Get more back links,Adjust the crawl speed.These are the ways crawling.
     
    peterson82, Feb 8, 2010 IP
  7. FreeCashTube

    FreeCashTube Peon

    Messages:
    378
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #7
    From Google:


    Google Help › Webmaster Tools Help › Using Webmaster Tools › Site configuration › Changing Google's crawl rate
    Changing Google's crawl rate
    Print

    Google has sophisticated algorithms that determine how much to crawl each site. Our goal is to crawl as many pages from your site as we can on each visit without overwhelming your server's bandwidth.

    You can change the crawl rate (the time used by Googlebot to crawl the site) for sites that are at the root level—for example, www.example.com and http://subdomain.example.com. You can't change the crawl rate for sites that are not at the root level—for example, www.example.com/folder.

    Note: Crawl rate refers to the speed of Googlebot's requests during the crawl process. It doesn't have any effect on how often we crawl or how deeply we crawl your URL structure.

    To change the crawl rate:

    1. On the Webmaster Tools Home page, click the site you want.
    2. Under Site configuration, click Settings.
    3. In the Crawl rate section, select the option you want.

    The new crawl rate will be valid for 90 days.
     
    FreeCashTube, Feb 8, 2010 IP
  8. Master Directory

    Master Directory Well-Known Member

    Messages:
    3,351
    Likes Received:
    82
    Best Answers:
    0
    Trophy Points:
    135
    Digital Goods:
    1
    #8
    let google determine crawl rate is the best option
     
    Master Directory, Feb 8, 2010 IP
  9. artboy

    artboy Peon

    Messages:
    149
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #9
    if your site is tens/hundreds of thousands of pages big or bigger, it might give you some benefit, but a small site wouldn't.
     
    artboy, Feb 8, 2010 IP
  10. faboccasion

    faboccasion Peon

    Messages:
    74
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    yes determine crawl rate is best
     
    faboccasion, Feb 9, 2010 IP
  11. Pristuno

    Pristuno Peon

    Messages:
    241
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    You cannot control crawl rate .You can just limit the site's section from crawling.The crawl rate depends upon the dynamism of you website.That is why forums are crawled more.
     
    Pristuno, Feb 9, 2010 IP
  12. jcalberto

    jcalberto Peon

    Messages:
    73
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #12
    jcalberto, Feb 9, 2010 IP