Google bot "SEO"

Discussion in 'Search Engine Optimization' started by triplex, Jan 29, 2008.

  1. #1
    hi to all!

    im doing some SEO, but i dont understand something, i keep track of google bot every day in my awstats and i notice that he comes by gives me over a 1000 hits and download 40megs and more everyday, i also noticed that everyday he gives more and more hits and downloads more megs

    this is the first time i do SEO.

    is it good that gbot downloads that much?
     
    triplex, Jan 29, 2008 IP
  2. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #2
    That is what GoogleBot does, it crawls your site over and over and over and if you keep adding new content it will end up using more resources to crawl your site. This is why people limit their crawl rate or prevent Googlebot from crawling certain sections of their website.
     
    astup1didiot, Jan 29, 2008 IP
  3. Markas

    Markas Well-Known Member

    Messages:
    710
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    128
    #3
    I have one more question adding to this:
    for example in Lithuania everyone uses Google, so should I block MSN and yahoo from crawling my site? Would that help saving some traffic?
     
    Markas, Jan 29, 2008 IP
  4. astup1didiot

    astup1didiot Notable Member

    Messages:
    5,926
    Likes Received:
    270
    Best Answers:
    0
    Trophy Points:
    280
    #4
    Nope, MSN & Yahoo can still provide your site with organic traffic, they also aren't as resource hungry as Google Bot.
     
    astup1didiot, Jan 29, 2008 IP
  5. rkalajian

    rkalajian Peon

    Messages:
    129
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Beware. Google Bot is large and in charge.

    I doubt even Godzilla or the Cloverfield monster could take it on.
     
    rkalajian, Jan 29, 2008 IP
  6. budhanes

    budhanes Peon

    Messages:
    245
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I cant prove this, but it seems that the more G crawls, the quicker you get listed. I have a newer site that G crawled 300 megs of this month, 250 last month. I want to see more crawls next month (Feb). I have a 150k - 250k page site I'm very anxious to get listed. Starting to sporadically show up. I had another large site before and it took forever to get crawled and listed. Seems like the more pages, the longer it takes. Good luck though, sounds like you have a very large site. Just give it some time!
     
    budhanes, Jan 29, 2008 IP
  7. Valley

    Valley Peon

    Messages:
    1,820
    Likes Received:
    47
    Best Answers:
    0
    Trophy Points:
    0
    #7
    There is an error in your site probally and the Google ball is a bouncing and trapped. PM Sweetfunny He is good at this sort of stuff
     
    Valley, Jan 29, 2008 IP
  8. Trapped

    Trapped Well-Known Member

    Messages:
    1,832
    Likes Received:
    48
    Best Answers:
    0
    Trophy Points:
    130
    #8
    Trapped? What did I do this time? :rolleyes:
     
    Trapped, Jan 29, 2008 IP
  9. triplex

    triplex Peon

    Messages:
    380
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #9
    40 megs per day = 1200megs a month! Could this be an error?
     
    triplex, Jan 30, 2008 IP
  10. triplex

    triplex Peon

    Messages:
    380
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #10
    for example: my awstats say that google gave me 1200 hits yesterday and 40,50mb downloaded, today google gave me 1479 hits and downloaded 46,89mbs

    Keeps on growing everyday
     
    triplex, Jan 30, 2008 IP
  11. rehash

    rehash Well-Known Member

    Messages:
    1,502
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    150
    #11
    are you talking about the site in your sig?
    that is not original content, is it?
    do you actually have human trafic from google or only googlebot comes?
    you have many subpages, that's why you get so many hits
     
    rehash, Jan 30, 2008 IP
  12. triplex

    triplex Peon

    Messages:
    380
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #12
    nooooo,that site is just for testing :)
     
    triplex, Jan 30, 2008 IP
  13. triplex

    triplex Peon

    Messages:
    380
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #13
    i normally have about 60 visitors from google everyday on the site that we are talking about, and google bot pays me a visit everyday
     
    triplex, Jan 30, 2008 IP