1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How long for google to crawl?

Discussion in 'Google Sitemaps' started by crazyryan, Jul 27, 2006.

  1. #1
    I submitted my sitemap to google 2 days ago and still haven't had it crawled. How long on average does it take?
     
    crazyryan, Jul 27, 2006 IP
  2. crazyryan

    crazyryan Well-Known Member

    Messages:
    3,087
    Likes Received:
    165
    Best Answers:
    0
    Trophy Points:
    175
    #2
    Anyone? :(
     
    crazyryan, Jul 28, 2006 IP
  3. Christine8

    Christine8 Peon

    Messages:
    257
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    In my experience I can usually see GoogleBot on my servers 2 hours after I (re-) submit a site. This may not be typical though.
     
    Christine8, Jul 28, 2006 IP
  4. crazyryan

    crazyryan Well-Known Member

    Messages:
    3,087
    Likes Received:
    165
    Best Answers:
    0
    Trophy Points:
    175
    #4
    Googlebot is showing on my awstats .. but I haven't been indexed. I thought googlebot was for adsense?
     
    crazyryan, Jul 28, 2006 IP
  5. Cryogenius

    Cryogenius Peon

    Messages:
    1,280
    Likes Received:
    118
    Best Answers:
    0
    Trophy Points:
    0
    #5
    It can take a while for pages to appear in Google's index. Googlebot is the bot for Google, there is a different one for Adsense. The fact that Googlebot has been to visit your site is a good sign. Login to Sitemaps and check that no errors were found. Expect deaper pages to take a while before they are indexed.

    Cheers, Cryo.
     
    Cryogenius, Jul 28, 2006 IP
  6. kiviniar

    kiviniar Notable Member

    Messages:
    1,964
    Likes Received:
    256
    Best Answers:
    0
    Trophy Points:
    255
    #6
    And also get quality backlinks to your site and have a sound in site linking for all your inner pages..once the bot come looking, it all depends on whether in can find its way within the site...;-)
     
    kiviniar, Jul 28, 2006 IP
  7. crazyryan

    crazyryan Well-Known Member

    Messages:
    3,087
    Likes Received:
    165
    Best Answers:
    0
    Trophy Points:
    175
    #7
    According to AWStats googlebot has visited my site 29 times.
     
    crazyryan, Jul 28, 2006 IP
  8. Black_Hand

    Black_Hand Peon

    Messages:
    726
    Likes Received:
    46
    Best Answers:
    0
    Trophy Points:
    0
    #8
    depends...sometimes in 3-5 hours, sometimes in 3-5 days!
     
    Black_Hand, Jul 28, 2006 IP
  9. stackman

    stackman Peon

    Messages:
    840
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    0
    #9
    I submitted a new site to Google yesterday using both AddURL and a sitemap -- and added a link to the site from a frequently-crawled PR6 site I own. Googlebot crawled me within two hours, twice. Of course, it hasn't indexed me yet, but one step at a time.
     
    stackman, Jul 30, 2006 IP
  10. crazyryan

    crazyryan Well-Known Member

    Messages:
    3,087
    Likes Received:
    165
    Best Answers:
    0
    Trophy Points:
    175
    #10
    crazyryan, Jul 31, 2006 IP
  11. advertiser

    advertiser Peon

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #11
    Only submitting your site to google will not be enough.I think you have set meta tags in your website before.Apart from this,you must add your website to directories whose pagerank is more than four such as dmoz.com,allwebscape.com.Also,sitemap can give an opportunity for google to index the page quickly. ;)
     
    advertiser, Jul 31, 2006 IP
  12. ibnuasad

    ibnuasad Notable Member

    Messages:
    1,045
    Likes Received:
    132
    Best Answers:
    0
    Trophy Points:
    275
    #12
    Well, Google crawled my site just after 30 minutes after I re-submit my sitemap....according to awstats...google visited me 105 times :)
     
    ibnuasad, Aug 1, 2006 IP
  13. genius

    genius Well-Known Member

    Messages:
    535
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    108
    #13
    In my case it took about an hour after submiting the site map
     
    genius, Aug 1, 2006 IP
  14. bonjurkes

    bonjurkes Well-Known Member

    Messages:
    106
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    105
    #14
    i have like 15 backlinks, not from a high quality sites, and i made a sitemap, like 6 months passed and i am not still indexed by google. When i submit my sitemap, googlebot visit the site but didnt crawl it :(
     
    bonjurkes, Aug 1, 2006 IP
  15. crazyryan

    crazyryan Well-Known Member

    Messages:
    3,087
    Likes Received:
    165
    Best Answers:
    0
    Trophy Points:
    175
    #15
    I bought $7 of ads on adengage today and ever since google was visiting my site absolutely loads.

    I have had 179 visit from google just from today and have noticed a few of my pages have been indexed. Hopefully it will gain overnight.
     
    crazyryan, Aug 1, 2006 IP
  16. WhatUdo!

    WhatUdo! Guest

    Messages:
    211
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #16
    Time, just give it time.
     
    WhatUdo!, Aug 1, 2006 IP
  17. P8ntballer

    P8ntballer Peon

    Messages:
    115
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Well it depends on the site and how it's built for google to crawl it..
     
    P8ntballer, Aug 3, 2006 IP
  18. svajdlenka

    svajdlenka Well-Known Member

    Messages:
    404
    Likes Received:
    15
    Best Answers:
    0
    Trophy Points:
    160
    #18
    I have the same experiences. My site is added 2 days on google and I made sitemp too. Is verified with meta tags. But still isn't crawled. I still don't have statistic, i am still not in index.
     
    svajdlenka, Aug 3, 2006 IP
  19. DigitalPeon

    DigitalPeon Active Member

    Messages:
    119
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #19
    Here are some tests i did.

    1. only submit a new site to google and wait.
    2. only submit a site and sitemap to google and wait.
    3. only submit a site to a PR7 site such as craigslist.org on relevant topic and wait.

    Results:
    1. site got indexed after a few days and internal pages are crawled alittle but not indexed even after 2 weeks.
    2. site got indexed after a few days and internal pages are crawled but not indexed even after 2 weeks of sitemap submission.
    3. site got indexed within 2 days and at least 50% of internal pages are indexed within a week.



    :D :D
     
    DigitalPeon, Aug 3, 2006 IP
  20. stackman

    stackman Peon

    Messages:
    840
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    0
    #20
    I created a new site last week and you can see the results of my work to get crawled at the website blog (see signature).
     
    stackman, Aug 4, 2006 IP