1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How to increase google crawling rate?

Discussion in 'Search Engine Optimization' started by Sunlust, Aug 1, 2008.

  1. #1
    Hi,
    I think that my websites aren't crawled enough, is there any other way, apart from social bookmarking pages or submitting press releases/articles to increase the crawling rate?
     
    Sunlust, Aug 1, 2008 IP
  2. Christ

    Christ Active Member

    Messages:
    720
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #2
    Try to get backlink from high PR website like netscape and other sites..Google will crawl your site..
     
    Christ, Aug 1, 2008 IP
  3. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #3
    Are you using a crawling monitoring script to actually see how often GoogleBot comes? I see so many people ask this question and don't actually monitor it. They use the information in Google Webmasters Central which is almost always behind in data. But, by having backlinks from "relevant" sites and popular sites that post lots of new content daily (like digg, mixx, etc) you encourage GoogleBot to find your URLs more and in turn visit them more.
     
    astup1didiot, Aug 1, 2008 IP
  4. maclin123

    maclin123 Member

    Messages:
    74
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    48
    #4
    If you want to crawl your website or want to crawl a particular webpage then use Digg. Your page is crawled in same day. Its a nice tip which i get from somewhere & its work for me. So, it be for you. :)
     
    maclin123, Aug 1, 2008 IP
  5. Tripta_Kneoteric

    Tripta_Kneoteric Banned

    Messages:
    220
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #5
    There is an option in Google webmaster tool to set the crawl rate. By default it is set as normal but you can change. Do you add content on a daily basis? if yes then it is advisable to increase the crawl rate or else it should be left as it is.
     
    Tripta_Kneoteric, Aug 1, 2008 IP
  6. crimson_river

    crimson_river Banned

    Messages:
    144
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #6
    try having a footer and site map, having your keywords in it....then submit your site map on google's directory submission listing....:D
     
    crimson_river, Aug 1, 2008 IP
  7. Sunlust

    Sunlust Active Member

    Messages:
    448
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    60
    #7
    I did it mate, I add content once two/three days, but I often do keyword amendments and title tags edits etc

    I'll try the digg solution =o
     
    Sunlust, Aug 1, 2008 IP
  8. mirisaamali

    mirisaamali Well-Known Member

    Messages:
    812
    Likes Received:
    31
    Best Answers:
    0
    Trophy Points:
    118
    #8
    well there is one trick if you follow, it should make SE crawl all over you regularly. Follow this:

    You need to type on the address line:
    www.aboutus.org/www.domain.com

    Don't forget, www.domain.com should be your domain!, replace it with yours.

    You will notice a page that will announce a "building article" note.

    In 5 seconds you will have a whole page for your website and SE's will crawl that fast.

    Another one is domaintools, you probably all know it, just one trick:
    Over the address bar click:
    www.whois.domaintools.com/www.domain.com

    Don't forget, www.domain.com should be your domain!, replace it with yours.

    It will do the same thing, 1 page for your website and many other pages will link to this, again fast crawl from SE's.

    This should make your sites get crawled frequently. Believe me, it works!
     
    mirisaamali, Aug 2, 2008 IP
    Sunlust likes this.
  9. Lerris

    Lerris Peon

    Messages:
    25
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #9
    You can only change the crawl rate if it is deemed to be a problem with how fast your site is being crawled.

    As others have said; backlinks, backlinks, backlinks.

    The more you have, the more authoritative you become, the more often Gbot visits your site.
     
    Lerris, Aug 2, 2008 IP
  10. Yousif

    Yousif Banned

    Messages:
    233
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #10
    I find the classical method of just being a good web master and updating your content one of the easiest ways for Google to chase you down!
     
    Yousif, Aug 2, 2008 IP
  11. genuineseo

    genuineseo Well-Known Member

    Messages:
    783
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    108
    #11
    yes dir, social bookmarking pages or submitting press releases/articles to increase the crawling rate and improve back links.
     
    genuineseo, Aug 3, 2008 IP
  12. medicalsupplies

    medicalsupplies Banned

    Messages:
    168
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #12
    post at high pr forums with your sig, get high pr back links, add some new content often.
     
    medicalsupplies, Aug 3, 2008 IP
  13. Ibn Juferi

    Ibn Juferi Prominent Member

    Messages:
    6,221
    Likes Received:
    365
    Best Answers:
    0
    Trophy Points:
    310
    #13
    Add a Google Sitemap and submit it at Google Webmaster Tools. That's the only way I know that can help increase your crawl rate.
     
    Ibn Juferi, Aug 3, 2008 IP
  14. milvos

    milvos Peon

    Messages:
    189
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Keep adding new content, keep getting backward links and set up google webmaster tools to help in keeping an eye on things.
     
    milvos, Aug 3, 2008 IP
  15. Aussie Bob

    Aussie Bob Peon

    Messages:
    54
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #15


    No idea if this works, but figured it cant hurt, so i Have created a page for all my sites, thanks for this one

    J
     
    Aussie Bob, Aug 3, 2008 IP
  16. gusher

    gusher Banned

    Messages:
    155
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    i agree with "Adding a Google Sitemap", i think that would really help. ;)
     
    gusher, Aug 4, 2008 IP
  17. aliun

    aliun Peon

    Messages:
    103
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Try signature and web directory
     
    aliun, Aug 4, 2008 IP
  18. Sunlust

    Sunlust Active Member

    Messages:
    448
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    60
    #18
    The links there are nofollow :< will the site still get crawled?
     
    Sunlust, Aug 4, 2008 IP
  19. Blogspotter

    Blogspotter Notable Member

    Messages:
    2,327
    Likes Received:
    285
    Best Answers:
    0
    Trophy Points:
    205
    #19
    I have noticed that just one or two good back links is enough to invite the bot.
    The freqency will increase as you keep increasing the frequency if updating your site.

    eg: Google only need to come to your site once via ONE link.
    Google comes back after few days and see that you have 10 new pages.
    Next time around google will come back sooner.. if Google still sees new pages, google will come back sooner and so on as long as it finds new content when it comes back the crawl becomes faster..

    I have sites with very active commentors and I am more hurt by their frequent crawls... Few weeks back site was down due to database issues and whooosh went down my ranking once rank at a time... Of course the ranking came back but still... google was too quick to derank me.. i am sure it has to do with the crawl rate
     
    Blogspotter, Aug 4, 2008 IP
  20. Sunlust

    Sunlust Active Member

    Messages:
    448
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    60
    #20
    My website has over 300 backlinks, so that shouldn't be a problem.
    I upload new content each 2-3 days.
    I submitted my website to digg two days ago and still nothing

    Hmmm, I'm really confused about it.
     
    Sunlust, Aug 4, 2008 IP