Gbot and the deep crawl

Discussion in 'Site & Server Administration' started by mortgage-pro-seo, Mar 27, 2006.

0
  1. #1
    Gbot has not hammered one of my sites in a while. Yahoo is sucking up 700 megs of bandwidth a day and Gbot is only nibbling on about 55 megs.

    Has anyone else noticed this?
     
    mortgage-pro-seo, Mar 27, 2006 IP
  2. Slapyo

    Slapyo Well-Known Member

    Messages:
    266
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    108
    #2
    Google is all over my sites as well as Yahoo and MSN. Is your content changed frequently and do you use Google Sitemaps?
     
    Slapyo, Mar 27, 2006 IP
  3. mortgage-pro-seo

    mortgage-pro-seo Peon

    Messages:
    170
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Content changes daily and sitemap are in place.
     
    mortgage-pro-seo, Mar 28, 2006 IP
  4. Slapyo

    Slapyo Well-Known Member

    Messages:
    266
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    108
    #4
    It should be there. However I do notice there are some days it's hardly around, other days it's there, and some days I get hammered.
     
    Slapyo, Mar 28, 2006 IP
  5. demonsnakeyes

    demonsnakeyes Guest

    Messages:
    199
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    hi! i just want to ask how do you know that what's wrong with your sitemap?
    thanks! :D
     
    demonsnakeyes, Mar 28, 2006 IP
  6. mortgage-pro-seo

    mortgage-pro-seo Peon

    Messages:
    170
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I am glad to report that Gbot has been hammering away everyday now. New pages are being added to the index almost daily.
     
    mortgage-pro-seo, Mar 31, 2006 IP