1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Googlebot everyday?

Discussion in 'Google Sitemaps' started by Bombaywala, Nov 6, 2006.

  1. #1
    How do I make googlebot visit my homepage everyday? I don't care about other pages - there are 3000+ and Googlebot can take it's own sweet time to crawl those pages but the front page - I would definitely want it to visit once a day.

    Any pointers in my sitemap update?
     
    Bombaywala, Nov 6, 2006 IP
  2. mad4

    mad4 Peon

    Messages:
    6,986
    Likes Received:
    493
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Crawl rate is a direct function of the PR of your pages. Get more high PR (and high quality) links and you get crawled more.

    Google Sitemaps allows you to increase the crawl rate as well.
     
    mad4, Nov 6, 2006 IP
  3. disgust

    disgust Guest

    Messages:
    2,417
    Likes Received:
    133
    Best Answers:
    0
    Trophy Points:
    0
    #3
    mad4's hit part of the equation but there's a bit more to it.

    the page needs to be changed often. if it's static, why would google bother to visit it every day? if it's not dynamic, you have another option: have content constantly added. the only way to have a lot of content constantly added is through some sort of user contribution system-- may be a forum, may be that you allow users to submit content, etc.

    why do you need it to visit everyday, anyway?
     
    disgust, Nov 6, 2006 IP
    mad4 likes this.
  4. dastuff

    dastuff Peon

    Messages:
    475
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Yes, I think I remember hearing that a PR of ~5 will have the spider visiting every 2 days or so... (that is of course, that the content is changing regularly)
     
    dastuff, Nov 6, 2006 IP
  5. mad4

    mad4 Peon

    Messages:
    6,986
    Likes Received:
    493
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Quite right disgust. :)

    If Google visits your page and finds its not changed since the last visit then it will decrease the crawl frequency. If the content has changed then it will increase the crawl frequency.
     
    mad4, Nov 6, 2006 IP
  6. dotcompals

    dotcompals Prominent Member

    Messages:
    2,905
    Likes Received:
    254
    Best Answers:
    0
    Trophy Points:
    320
    #6
    I think, now google is providing a new function in the Google Sitemap, where one can adjust the crawl rate to highest, normal & lowest. Do chack that out by logging into Google Sitemap services.
     
    dotcompals, Nov 6, 2006 IP
  7. Bombaywala

    Bombaywala Peon

    Messages:
    1,249
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Need it to visit everyday - it's article site - I get 100's everyday but I approve only about 25-30 so they stay on first page. So 30 articles on front page needs to be crawled and when the bot visits next day - there are 30 new articles - the previous links are now gone.
     
    Bombaywala, Nov 6, 2006 IP
  8. Bombaywala

    Bombaywala Peon

    Messages:
    1,249
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Already did it. Doesn't really help much.
     
    Bombaywala, Nov 6, 2006 IP
  9. disgust

    disgust Guest

    Messages:
    2,417
    Likes Received:
    133
    Best Answers:
    0
    Trophy Points:
    0
    #9
    The sitemaps option is more about how hard it hits rather than how often it hits.

    with higher pagerank they'll get crawled anyway. I'd try an "archive" style index of your articles, a la vbulletin.
     
    disgust, Nov 6, 2006 IP
  10. Bombaywala

    Bombaywala Peon

    Messages:
    1,249
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Hmm so now it's about waiting and getting PR!!! Well then not much I can do there.

    Thanks for the responses guys!
     
    Bombaywala, Nov 6, 2006 IP
  11. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #11
    You should make sure that your articles link back to your front page.
    (as your articles may get linked from other sources)

    If you are interested in knowing how your entire website distributes "link power" within your website, you may be interested in *cough* my website analyzer software :)

    Still, under all circumstances, backlinks from other websites are #1 thing.
     
    websitetools, Nov 6, 2006 IP
  12. disgust

    disgust Guest

    Messages:
    2,417
    Likes Received:
    133
    Best Answers:
    0
    Trophy Points:
    0
    #12
    it does not have to do with your visible PR, it has to do with your internal google PR, which is updated much, much more frequently... just because you can't see the PR doesn't mean you don't have it. :)
     
    disgust, Nov 6, 2006 IP
  13. Bombaywala

    Bombaywala Peon

    Messages:
    1,249
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Internal PR - hmmm - so far I can conclude that I really haven't received any pointers on how to invite Gbot everyday :)
     
    Bombaywala, Nov 6, 2006 IP
  14. disgust

    disgust Guest

    Messages:
    2,417
    Likes Received:
    133
    Best Answers:
    0
    Trophy Points:
    0
    #14
    getting more inbound links, and links from pages with high PR, will increase your PR. it'll first increase it internally (and it will be invisible), but it'll later be visible on the toolbar.
     
    disgust, Nov 6, 2006 IP
  15. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #15
    If you have installed Google toolbar you can see your visible GooglePR. However, that "public" visible value is not updated very often.
     
    websitetools, Nov 7, 2006 IP
  16. MattKNC

    MattKNC Peon

    Messages:
    2,578
    Likes Received:
    107
    Best Answers:
    0
    Trophy Points:
    0
    #16
    I find that even with an active forum included on one of my sites, that the googlebot only visits every three to four days. I am leaning toward the thought that html pages get updated faster than forum pages, but I may not be correct about that.
     
    MattKNC, Nov 7, 2006 IP