Googlebot / Google index ~ what causes this?

Discussion in 'Google' started by mcfox, Jun 16, 2005.

  1. #1
    I'm a bit stumped. Does anyone know why Google would index a site like this:
     

    Attached Files:

    mcfox, Jun 16, 2005 IP
  2. Michael

    Michael Raider

    Messages:
    677
    Likes Received:
    92
    Best Answers:
    0
    Trophy Points:
    150
    #2
    Because that's what the googlebot found when it last visited the url, as you can see here.

    - Michael

     
    Michael, Jun 16, 2005 IP
  3. mcfox

    mcfox Wind Maker

    Messages:
    7,526
    Likes Received:
    716
    Best Answers:
    0
    Trophy Points:
    360
    #3
    Clever. Heh! ;)

    Yeah, I've got that but *why* didn't it index the site?
     
    mcfox, Jun 16, 2005 IP
  4. T0PS3O

    T0PS3O Feel Good PLC

    Messages:
    13,219
    Likes Received:
    777
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Why they indexed it?

    Because they found a link to it (live or raw text).

    Because someone browsed it (with the toolbar).

    Because it was a referer.

    Because Google saw the domain being registered.

    Because someone submitted the URL.

    Why they didn't index the html instead of the directory tree shown?

    I see no index/home/default file so it won't load anything.
     
    T0PS3O, Jun 16, 2005 IP
    mcfox likes this.
  5. Blogmaster

    Blogmaster Blood Type Dating Affiliate Manager

    Messages:
    25,924
    Likes Received:
    1,354
    Best Answers:
    0
    Trophy Points:
    380
  6. mcfox

    mcfox Wind Maker

    Messages:
    7,526
    Likes Received:
    716
    Best Answers:
    0
    Trophy Points:
    360
    #6
    This is what I cannot understand, Tops :confused: The site has all the necessary pages, including the index page and has been live for months. I suppose I should be grateful it is finally in the Google listings. I'm puzzled. Other sites are indexed no problem.
     
    mcfox, Jun 16, 2005 IP
  7. mcfox

    mcfox Wind Maker

    Messages:
    7,526
    Likes Received:
    716
    Best Answers:
    0
    Trophy Points:
    360
    #7
    AHA!
    The year is 2004! (thnx Tops and SiteTutor)

    I have since purchased and developed the domain name.

    I also recently wrote to Google asking if perhaps the url had been banned/excluded for some reason due to previous .. whatever? I didn't know. I just knew it was unavaliable in the Google index after many months of waiting. Looks like it has now been reincluded. No doubt the listing will change once the site is properly spidered.
     
    mcfox, Jun 16, 2005 IP
  8. wrmineo

    wrmineo Peon

    Messages:
    3,087
    Likes Received:
    379
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I've seen this on folders/directories that I have that do not have an index page associated with them; mainly images folders and the like.

    If this is not the case with your site, make sure your robots.txt file is present and that your index page has a robots meta present for G to know it's allowed there.

    Which site was this done on? That would help in determining the cause maybe ...
     
    wrmineo, Jun 16, 2005 IP