did you know that you can change the crawl rate for your site in google?

Discussion in 'Google' started by spyrit, Nov 27, 2007.

  1. #1
    I just found out myself, and i think it's cool, so i thought i should share this for the ones that don't know.

    How it works, you need a google webmaster account, after that you need to verify that you own the site you submitted there.
    After that go to Tools-> set crawl rate.

    This is usefull if you have many pages and the BandWidth is not a problem for you. I just set mine to Faster.


    What they say about this:

    Faster A faster crawl will enable us to crawl your site quickly, but may put more load on your server.
    Normal Recommended crawl rate.
    Slower A slower crawl will reduce Googlebot's traffic on your server, but we may not be able to crawl your site as often.


    You can do the opposite too, if you don't have BW to spare, just set it to slow and maybe it helps you a little.

    Ok, this is it, enjoy :)
     
    spyrit, Nov 27, 2007 IP
  2. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #2
    Yes, I noticed this many moons ago :D Isn't it great when you discover something new! Even if it isn't new ;)
     
    astup1didiot, Nov 27, 2007 IP
  3. spyrit

    spyrit Well-Known Member

    Messages:
    1,788
    Likes Received:
    94
    Best Answers:
    0
    Trophy Points:
    150
    #3
    haha...well it really is when i found it i said wow...and i was asking myself for so long how to make google crawl faster my site :D
     
    spyrit, Nov 27, 2007 IP
  4. slasher20

    slasher20 Member

    Messages:
    67
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #4
    yes - i did know that!
     
    slasher20, Nov 27, 2007 IP
  5. Philopoemen

    Philopoemen Peon

    Messages:
    704
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Actually this option is available only for those websites that are updated often.
    For example I have a website where are about 15 new pages are created daily (there are about 3300 indexed pages). The "faster" option got available a couple of months ago.
    While my smaller websites that are updated like once a month, they don't have this option "faster", it is disabled.
     
    Philopoemen, Nov 27, 2007 IP
  6. godmode

    godmode Well-Known Member

    Messages:
    4,453
    Likes Received:
    156
    Best Answers:
    0
    Trophy Points:
    190
    #6
    Darn pretty old. Good that u finally discovered it. now googlebot will have breakfast, lunch and dinner on your site :D
     
    godmode, Nov 27, 2007 IP
  7. ZakYoung

    ZakYoung Guest

    Messages:
    43
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    It's a great trick, very necessary imho.
     
    ZakYoung, Nov 27, 2007 IP
  8. darkmessiah

    darkmessiah Peon

    Messages:
    500
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #8
    This is what I dont understand. Googlebot visits my site every day, I take it it's just doing a routine check. But I noticed on the main overview that googlebot last visited several days ago. What exactly is getting done "faster".
     
    darkmessiah, Nov 28, 2007 IP
  9. abraxas

    abraxas Well-Known Member

    Messages:
    1,422
    Likes Received:
    44
    Best Answers:
    1
    Trophy Points:
    125
    #9
    I have had this option available since I created my first site/registered for webamster tools and keep it to fast crawl. I also have one site, which i have not enough time to update the real content, only this on home page/it is even incomplete/, but the crawl rate option is still available.
     
    abraxas, Nov 28, 2007 IP
  10. spyrit

    spyrit Well-Known Member

    Messages:
    1,788
    Likes Received:
    94
    Best Answers:
    0
    Trophy Points:
    150
    #10
    lol....i see everybody knew, so am i the last one that found out about this :D ...
     
    spyrit, Nov 28, 2007 IP
  11. Win Z

    Win Z Active Member

    Messages:
    331
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    60
    #11
    ohh i dint know that...:D

    Thnx for the tip :)
     
    Win Z, Nov 28, 2007 IP
  12. Philopoemen

    Philopoemen Peon

    Messages:
    704
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Weird... i have it disabled for a couple of my sites :(
     
    Philopoemen, Nov 28, 2007 IP
  13. portablewebmaster

    portablewebmaster Guest

    Messages:
    77
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #13
    i didn't know it, thank's for the information budy
     
    portablewebmaster, Nov 28, 2007 IP
  14. Bangkok Baby

    Bangkok Baby Peon

    Messages:
    322
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    0
    #14
    IMHO, the fast crawl option is only good for websites that update frequently. For a static content site it won't help you.
    If you set fast crawl for static content sites it will be disabled after some time.
     
    Bangkok Baby, Nov 28, 2007 IP
  15. oseymour

    oseymour Well-Known Member

    Messages:
    3,960
    Likes Received:
    92
    Best Answers:
    0
    Trophy Points:
    135
    #15
    well, the default setting is the best one, so changing it will not necessarily get you crawled faster
     
    oseymour, Nov 28, 2007 IP
  16. t2000q

    t2000q Prominent Member

    Messages:
    4,636
    Likes Received:
    192
    Best Answers:
    0
    Trophy Points:
    300
    Digital Goods:
    1
    #16
    well, i never knew, so thanks
     
    t2000q, Nov 28, 2007 IP
  17. tarponkeith

    tarponkeith Well-Known Member

    Messages:
    4,758
    Likes Received:
    279
    Best Answers:
    0
    Trophy Points:
    180
    #17
    Same here, but I've also set a couple sites to "Faster", and have seen no increase in bot visits...
     
    tarponkeith, Nov 28, 2007 IP
  18. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #18
    yes, i know it . it was mention before but thanks for reminding it again:)
     
    trichnosis, Nov 28, 2007 IP