Webmaster Crawl Rate HELP Please

Discussion in 'Google' started by bubaipal, May 10, 2008.

0
  1. #1
    Hello Dpers:)

    I just saw in Webmaster tools that my site was not crawled for 20 days and the faster crawl option is given. So I activated it and it will expire in 90 days.:D

    So, how is it calculated when to give the option of faster crawl? After 90 days when will I get the option of faster crawl?:confused:

    Waiting for replies:rolleyes:
    Bubai pal
     
    bubaipal, May 10, 2008 IP
  2. tonyinabox

    tonyinabox Peon

    Messages:
    1,988
    Likes Received:
    42
    Best Answers:
    0
    Trophy Points:
    0
    #2
    there are some factors that will give you the option of faster crawl like how fast your server and internet connection to your hosting.
     
    tonyinabox, May 10, 2008 IP
  3. snakeair

    snakeair Notable Member

    Messages:
    1,743
    Likes Received:
    198
    Best Answers:
    4
    Trophy Points:
    280
    #3
    I don't even use the faster crawler rate on my sites. Fresh content daily is a good way to keep search engines crawling your sites.

    Well if your server can handle faster crawl rate, then by all mean's use it. If you are on shared hosting, don't even bother with that option cause you never know how stupid your host can be.
     
    snakeair, May 10, 2008 IP
  4. bubaipal

    bubaipal Peon

    Messages:
    939
    Likes Received:
    17
    Best Answers:
    0
    Trophy Points:
    0
    #4
    I am giving it a try as my site has not be crawled for 20 days. No option for me. But the server is very slow.
     
    bubaipal, May 10, 2008 IP
  5. Lexiseek

    Lexiseek Banned

    Messages:
    2,499
    Likes Received:
    115
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Just add a fresh page of content and a few links.
     
    Lexiseek, May 10, 2008 IP
  6. bloodwrath

    bloodwrath Active Member

    Messages:
    1,364
    Likes Received:
    49
    Best Answers:
    0
    Trophy Points:
    90
    #6
    another way to get google to come back sooner is to add a Word Press blog to the site, so www.yourwebsite.com/blog

    On the blog have a link to the main page and in the blog talk about and post internal links to other pages on your website.

    Using this can help Google come back often.
    As well as adding fresh content to the website, also you can skip the blog if you can add rss to your site.
     
    bloodwrath, May 10, 2008 IP
    bubaipal likes this.
  7. mpcovcd

    mpcovcd Peon

    Messages:
    280
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #7
    No need for faster crawl, just have unique content and the search engine bots will come
     
    mpcovcd, May 10, 2008 IP
  8. angilina

    angilina Notable Member

    Messages:
    7,824
    Likes Received:
    186
    Best Answers:
    0
    Trophy Points:
    260
    #8
    If you add or update your site more often, then you will get this fast crawl option..

    I have 3 sites, all are set to faster crawl.
     
    angilina, May 10, 2008 IP
    bubaipal likes this.
  9. brian65

    brian65 Active Member

    Messages:
    1,172
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    88
    #9
    Update your site, add links. Your site will then be crawled every day.
     
    brian65, May 10, 2008 IP
  10. snakeair

    snakeair Notable Member

    Messages:
    1,743
    Likes Received:
    198
    Best Answers:
    4
    Trophy Points:
    280
    #10
    Do you have a sitemap created for your website? Lot's of useful information posted already.
     
    snakeair, May 10, 2008 IP
  11. The Stealthy One

    The Stealthy One Well-Known Member Affiliate Manager

    Messages:
    3,043
    Likes Received:
    54
    Best Answers:
    0
    Trophy Points:
    105
    #11
    I think an RSS feed of free syndicated content would have the desired effect of creating constantly updated content.
     
    The Stealthy One, May 10, 2008 IP
  12. magda

    magda Notable Member

    Messages:
    5,197
    Likes Received:
    315
    Best Answers:
    0
    Trophy Points:
    280
    #12
    The speed of the crawl is not the same thing as the frequency of the crawl, they're completely different things.
     
    magda, May 10, 2008 IP
  13. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #13
    i think it's related with the dailly downloaded kb from your web site
     
    trichnosis, May 10, 2008 IP
  14. tattoos

    tattoos Prominent Member

    Messages:
    1,903
    Likes Received:
    150
    Best Answers:
    0
    Trophy Points:
    335
    #14
    I am unsure how often that page gets updated.
    My webmaster tools says:
    "Googlebot last successfully accessed your home page on Apr 4, 2008"
    So it has been over a month for me. But, If you have a look on the "set crawl rate" page, it says
    "Googlebot activity in the last 90 days" and
    "Number of pages crawled per day" etc...

    That sounds to me like Googlebot is going to my site every day, but Webmaster tools is not updating the information on the "set crawl rate" page every day.

    I wish it would update more often, but its a free service, so I guess I can't complain :D

    I am not 100% sure if what I just said is right, it's just what I think.
    So if anyone knows if that is wrong, please tell us.

    I have only had the option to increase the Googlebot crawl speed once. That was a month or two after I started my site.. I have not had the option since then. (about a year)

    Cheers
    James
     
    tattoos, May 10, 2008 IP