Googlebot hit my site 5 minutes after domain goes active!

Discussion in 'Site & Server Administration' started by dvduval, Aug 20, 2005.

  1. #1
    Check this out
    1. buy domain
    2. point to nameserver
    3. use cpanel to install phpbb
    4. login to admin of phpbb
    5. Googlebot is listed as hitting the forum

    This is all I have so far
    http://www.phpdictionary.com/

    We're talking 10 minutes max. There are no known links pointing to the site!

    WT*!
     
    dvduval, Aug 20, 2005 IP
  2. Ned

    Ned Active Member

    Messages:
    402
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    78
    #2
    You sure its not the adsense bot? rather than the search index bot?
     
    Ned, Aug 20, 2005 IP
  3. fryman

    fryman Kiss my rep

    Messages:
    9,604
    Likes Received:
    777
    Best Answers:
    0
    Trophy Points:
    370
    #3
    I was going to ask the exact same question
     
    fryman, Aug 20, 2005 IP
  4. Bernard

    Bernard Well-Known Member

    Messages:
    1,608
    Likes Received:
    107
    Best Answers:
    0
    Trophy Points:
    185
    #4
    Google is checking domain registrations these days.
     
    Bernard, Aug 20, 2005 IP
  5. Shoemoney

    Shoemoney $

    Messages:
    4,474
    Likes Received:
    588
    Best Answers:
    0
    Trophy Points:
    295
    #5
    really... where do you get that from?
     
    Shoemoney, Aug 20, 2005 IP
  6. compar

    compar Peon

    Messages:
    2,705
    Likes Received:
    169
    Best Answers:
    0
    Trophy Points:
    0
    #6
    But the question isn't how soon they crawl it. The question is how soon they list in the SERPs. I'll bet you find it on MSN before you find it in Google.

    The other question is did you put up any links to it before you installed it on the server? Because if you didn't how did they find it, unless of course you had AdSense scripts on the site and then the suggestion about the AdSense bot is probably the explanation.
     
    compar, Aug 20, 2005 IP
  7. gdtechind

    gdtechind Peon

    Messages:
    414
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #7
    must have been googlebot for adsense
    i don't think google will come so easily
     
    gdtechind, Aug 21, 2005 IP
  8. Bernard

    Bernard Well-Known Member

    Messages:
    1,608
    Likes Received:
    107
    Best Answers:
    0
    Trophy Points:
    185
    #8
    Bernard, Aug 21, 2005 IP
  9. Shoemoney

    Shoemoney $

    Messages:
    4,474
    Likes Received:
    588
    Best Answers:
    0
    Trophy Points:
    295
    #9
    Shoemoney, Aug 22, 2005 IP
  10. Bernard

    Bernard Well-Known Member

    Messages:
    1,608
    Likes Received:
    107
    Best Answers:
    0
    Trophy Points:
    185
    #10
    I just checked the stats for a domain which I bought over a year ago and have not developed yet. It has had a single page up since I bought the domain (my own page, not a web host parking page).

    At any rate. The site/page has had consistent traffic of 1 visitor a day and visits from Googlebot and Inktomi Slurp make up 90% of the traffic. The only referrers listed are whois.sc and Yahoo search. I have no idea why Yahoo is showing my page in SERPs when the only link pointing to it is from whois.sc (but it looks like it may be time to develop that site...).
     
    Bernard, Aug 24, 2005 IP
  11. intek

    intek Guest

    Messages:
    67
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #11
    When you whois a site such as yours, it will be stored and google with crawl that information. I have several sites i havnt even put a page on yet and still i am seeing google and msn crawl it.

    On the otherhand as said, this could quite possibly be the adsense bot ( he does not waste time)
     
    intek, Aug 27, 2005 IP
  12. TechEvangelist

    TechEvangelist Guest

    Messages:
    919
    Likes Received:
    140
    Best Answers:
    0
    Trophy Points:
    133
    #12
    I've seen the same thing happen with Yahoo twice. Yahoo has hit two sites while I was installing and tweaking the code just after the DNS changes kicked in. Both times it resulted in garbage content in Yahoo's database until the spider returned.

    There were no inbound links to either of these sites and I do not use the Yahoo toolbar. I speculated that Yahoo is somehow monitoring DNS changes. I have not yet seen Google or MSN do this, but it sounds like others have.
     
    TechEvangelist, Aug 27, 2005 IP