Google won't index my site, why?

Discussion in 'Search Engine Optimization' started by gareth_esutera, Sep 29, 2009.

  1. #1
    I know, there's no certainty when Google will index your site.

    However, I just find it unusual that it's more than 2 weeks and Google still haven't index my new website. I installed Google Analytics and Google webmaster's tools on Sept 11. I also submitted a site map. I also build a handful of backlinks from forums such as this but it's still not there until today.

    Yahoo already indexed my site. Ask, Bing and Lycos also haven't indexed my site yet.

    I find it unusual because all my previous sites are usually indexed by Google in less than a week (10 days at most, except for this one). As long as there are links to my site from somewhere, Google can find it immediately. There's even a case where I didn't do any back linking or submission and yet, Google still found my site (maybe it's through WordPress feed).

    But now, it's 19 days and Google still haven't indexed my site.

    I hope any of you guys can tell if there's anything wrong with my site? If maybe I did something that Google didn't like.

    This is the site that I'm referring to: http://prefr.hub.ph/

    Thanks a lot.
     
    gareth_esutera, Sep 29, 2009 IP
  2. bryanon

    bryanon Well-Known Member

    Messages:
    806
    Likes Received:
    29
    Best Answers:
    0
    Trophy Points:
    145
    #2
    Is everything OK with your robots.txt file? Is your content unique? Does Google Webmaster Tools indicate any crawling errors? All I can think of from the top of my head ..
     
    bryanon, Sep 29, 2009 IP
  3. ohteddy

    ohteddy Member

    Messages:
    128
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    28
    #3
    I've done a quick analysis and everything looks fine except for your robots.txt.
    Try changing it from:
    
    User-agent: *
    Disallow:
    
    Code (markup):
    to
    
    User-agent: *
    Allow: /
    
    Code (markup):
    Incidentally you might also want to add the Sitemap directive to your robots.txt
    so your robots.txt would look like:
    
    User-agent: *
    Allow: /
    Sitemap: http://prefr.hub.ph/path/to/sitemap.txt
    
    Code (markup):
     
    ohteddy, Sep 29, 2009 IP
  4. shanmugasundaram

    shanmugasundaram Active Member

    Messages:
    230
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    70
    #4
    even
    Disallow:

    is fine

    add XML site map and try to ping it once

    use hubpages or squidoo or ask your friends to reddit or digg any of the posts
     
    shanmugasundaram, Sep 30, 2009 IP
  5. mimran

    mimran Peon

    Messages:
    262
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    add XML Site Map to your site.
     
    mimran, Sep 30, 2009 IP
  6. Beefandy

    Beefandy Active Member

    Messages:
    773
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    90
    #6
    I added an XML site map and it helped mine get indexed. I Used Google Webmaster tools
     
    Beefandy, Sep 30, 2009 IP
  7. gareth_esutera

    gareth_esutera Member

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #7
    Thanks guys

    ohteddy
    My other website http://codeleet.hub.ph/ has exactly the same robots.txt configuration and Google doesn't have any problem indexing it. In fact it can index my new post within 24 hours.

    shanmugasundaram, mimran and Beefandy
    I already used digg and has xml sitemap submitted to Google webmaster's tools
     
    gareth_esutera, Sep 30, 2009 IP
  8. mrandrei

    mrandrei Peon

    Messages:
    1,133
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #8
    Did you start building links for your site even if it hasn't been indexed by Google. If yes, you have probably been sandboxed. Google bans new sites that have generated too much links in a short period of time.
     
    mrandrei, Sep 30, 2009 IP
  9. farangkwaiyai

    farangkwaiyai Guest

    Messages:
    317
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #9
    Your h1 tag is "HOME" you need to make it relevant, for google to index your site, you at least need to tell them what the most important thing is on the page! Change your H1 tag to "Philippine Real Estate"
     
    farangkwaiyai, Sep 30, 2009 IP
  10. careertargetph

    careertargetph Peon

    Messages:
    23
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Maybe your didn't add your url in google. For new websites, it takes time in order google spider will crawl and find your site. Be patient.
     
    careertargetph, Sep 30, 2009 IP
  11. gareth_esutera

    gareth_esutera Member

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #11
    mrandrei
    How can Google index my website if there's no link through which its spider will arrive to my site? How many links is "too much" because the number of links that I created is less than 10?

    farangkwaiyai
    Please note that I'm not trying to reach the top of search results for the moment, so whatever is in h1 is irrelevant.

    careertargetph
    The site is already in my Google Analytics and Webmaster's tools account.
     
    gareth_esutera, Sep 30, 2009 IP
  12. farangkwaiyai

    farangkwaiyai Guest

    Messages:
    317
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Actually I never mentioned at the top, I mentioned to get indexed. IMO if you don't have a heading, it may have no place in the index. Not totally true, but it could swing it in some cases.
     
    farangkwaiyai, Oct 1, 2009 IP
  13. risefromthedust

    risefromthedust Peon

    Messages:
    7
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Check all of the above AND copy some of your content on your page and then do a Google search and see if more than your site or more than one page of your site shows up. Duplicate content is a No No!
     
    risefromthedust, Oct 1, 2009 IP
  14. risefromthedust

    risefromthedust Peon

    Messages:
    7
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #14
    Too many links is too "broad." How many exactly?
     
    risefromthedust, Oct 1, 2009 IP
  15. gareth_esutera

    gareth_esutera Member

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #15
    farangkwaiyai
    The reason why I didn't set any h1 in the main page is that the posts have it in their title. Basically, I don't really expect any traffic coming through the main page. I expect them to come through the post pages.

    risefromthedust
    I did search "prefr.hub.ph" (with quotes) in Google. It's the exact URL. It's more than enough to force my website to appear in search results even if there's duplicate content... and I don't have duplicate content. Yet the results that appear are those forum pages where I'm asking for help, like this forum. None of the pages from my site appeared.

    My statistics in Google Webmaster's tools indicate that it found my sitemap with no errors and all URLs were FOUND, and yet the number of URLs INDEXED is zero?
     
    gareth_esutera, Oct 4, 2009 IP
  16. aimex77

    aimex77 Active Member

    Messages:
    70
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    63
    #16
    Do some backlinks to your website, backlink from ezinearticle is the best.
     
    aimex77, Oct 4, 2009 IP
  17. aimex77

    aimex77 Active Member

    Messages:
    70
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    63
    #17
    Now I take a second look at your domain, is it because of the domain name?
     
    aimex77, Oct 4, 2009 IP
  18. andybush

    andybush Member

    Messages:
    75
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    35
    #18
    try adding a link from your indexed sub-domain to non-indexed one...in fact noone can give you an exact answer. Google has 1 billion factors which influence on domain indexing...
     
    andybush, Oct 4, 2009 IP
  19. gareth_esutera

    gareth_esutera Member

    Messages:
    47
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    41
    #19
    This is getting out of hand. My site is no longer in Yahoo either.

    Using Yahoo Site Explorer, I found out that Yahoo already found 21 inbound links to my site. And yet, Yahoo didn't index any of my pages?

    In Google Webmaster Tools, Google found only 2 inbound links, but then we all know that Google don't display all inbound links. However I have a sitemap there, and it's indicated there that 24 URLs are submitted. Yet Google didn't index anyone of them?

    Checked the robots.txt, there's nothing there to prevent my site from getting indexed.

    Checked the meta and there's meta robots (except for pages that I really do not want to get indexed).

    aimex77
    What's wrong with my domain name?

    andybrush
    There are already links from my index subdomain to that site.
    http://digicon.hub.ph/portfolio/
    http://codeleet.hub.ph/autogenerated-robotstxt-file-in-wordpress/
     
    gareth_esutera, Oct 5, 2009 IP
  20. robin29

    robin29 Active Member

    Messages:
    109
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    63
    #20
    Hi gareth_esutera ,

    My new website has also the same problem.
    if you find a solution please do message me.
    If i find a solution i will inform you
     
    robin29, Oct 6, 2009 IP