Site is being crawled by Google but not indexed?

Discussion in 'Search Engine Optimization' started by LazyD, Oct 30, 2006.

  1. #1
    What the are the common reasons for a site to be crawled but not indexed by Google?

    AWStats for the month of october.

    Googlebot 166+20 1.61 MB 29 Oct 2006 - 00:49

    And if anyone can tell me what the +20 means, id appreciate it too...

    Im getting a comperable number of hits frmo MSNBot and Yahoo's Slurp and im indexed on both of them
     
    LazyD, Oct 30, 2006 IP
  2. sezerb

    sezerb Guest

    Messages:
    685
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Be patient. If your site is getting crawled then you will turn up in the index sooner or later. Work on getting more backlinks pointing to your site.
     
    sezerb, Oct 30, 2006 IP
  3. alpalino

    alpalino Peon

    Messages:
    1,119
    Likes Received:
    69
    Best Answers:
    0
    Trophy Points:
    0
    #3
    When it comes to indexing, google takes its time compare to others. But you would get indexed eventually. I had to wait for a month for my blog to get indexed.
     
    alpalino, Oct 30, 2006 IP
  4. cientificoloco

    cientificoloco Well-Known Member

    Messages:
    1,742
    Likes Received:
    47
    Best Answers:
    0
    Trophy Points:
    110
    #4
    Google indexed one of my sites in a couple of days without me doing anything, and it is taking more than one months for another website, even though I'm building links and doing the homework.
     
    cientificoloco, Oct 30, 2006 IP
  5. LazyD

    LazyD Peon

    Messages:
    425
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yea it seems Google is taking its sweet time....

    In addition to those stats I also have a predicted PR of 2 if that means anything...
     
    LazyD, Oct 30, 2006 IP
  6. Neale

    Neale Peon

    Messages:
    583
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #6
    One small thing I have noticed if you have even a small amount of duplicate
    content it can take considerably longer than if your site is totaly unique.
    Worse still if you are on a subdomain like blogger with duplicate content.
    Use www.copyscape.com to check if their are other sites with even a little
    content the same as yours. The only exception to this is if you are running a News type site & linking back to the news in the correct way you do not seem to get penalised www.yabenews.com in my sig was indexed in hours and deeply in a few days all content was dup at the time but all news.
     
    Neale, Oct 30, 2006 IP
  7. cientificoloco

    cientificoloco Well-Known Member

    Messages:
    1,742
    Likes Received:
    47
    Best Answers:
    0
    Trophy Points:
    110
    #7
    Thats a god point. The site that was not indexed has some duplicated content (articles from article banks). The other one had only original content (little at that time, but original)

    Maybe one should wait until the site shows up in google before adding dup.
     
    cientificoloco, Oct 30, 2006 IP
  8. LazyD

    LazyD Peon

    Messages:
    425
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #8
    The 3 articles I currently have up in my "article library" are completely unique.

    I have another 5 articles being written as we speak, the only duplicate content on the entire site is in the blog area which has news from CNN Personal Finance, Smartmoney.Com, Forbes etc.

    Could it be that a large portion of the content on the site is via affiliates? I mean, its not spamming but its a credit card site and a dominate number of pages have Credit Card listings and listings of loans/insurance displayed by type etc.
     
    LazyD, Oct 30, 2006 IP
  9. guru-seo

    guru-seo Peon

    Messages:
    2,509
    Likes Received:
    152
    Best Answers:
    0
    Trophy Points:
    0
    #9
    guru-seo, Oct 30, 2006 IP
  10. DFischer

    DFischer Peon

    Messages:
    381
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Google doesn't index a site immediately you have to wait a little bit :)

    And for whatever reason a site can be sand boxed even with a page rank. It depends on the content, maybe there was even a conflict.

    At times like that though, it's best to contact google about it.
     
    DFischer, Oct 30, 2006 IP
  11. Neale

    Neale Peon

    Messages:
    583
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #11
    What makes you think this ? Maybe you have never had a site indexed quickly many of us have ;) It is also true that at times google does not index quickly but normaly for a reason hence this thread.

    LazyD what site are you talking about ? the blog in your sig ?
    This has no links going back to the source if thats what you are refering to.
    If these are News snippets with no refference to the source they are now Duplicate Content I just ran the blog by www.copyscape.it has loads of
    Duplicate Content. As the source is probably indexed you now have Dup Content.
     
    Neale, Oct 30, 2006 IP
  12. Neale

    Neale Peon

    Messages:
    583
    Likes Received:
    19
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Thanks I thought their may be some truth in what I was thinking/experiening I had a blog on blogger account with dup content waited forever to get it indexed just gave up eventualy

    ""Maybe one should wait until the site shows up in google before adding dup""

    Your Call ;)

    I can only add if its deep enough it may never get found or you could use robots to exclude or

    The other thing I have heard is its all about percentages if you have 90% unique a little dup will not hurt but if your first article home page is dup you are off to a bad start :)


    Good Luck
     
    Neale, Oct 30, 2006 IP
  13. LazyD

    LazyD Peon

    Messages:
    425
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Yea, I dont have a reference URL back to the story, I honestly dont know how to set up an RSS feed into to Wordpress with only the articles I want, I tried RSS feeds before when I was running bblog but they just showed all articles and I only want certain ones. If anyone could advise me on how I could fix that...
     
    LazyD, Oct 30, 2006 IP
  14. rosiee007

    rosiee007 Notable Member

    Messages:
    3,352
    Likes Received:
    179
    Best Answers:
    0
    Trophy Points:
    230
    #14
    With duplicate content, your pages will end up in Supplemental results. And as you're facing, it will take longer to get indexed. Try adding more content around the articles to avoid this problem.
     
    rosiee007, Oct 30, 2006 IP
  15. shelleyh

    shelleyh Peon

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Hi Guys,

    Which tools do you recommend to predict page rank?

    Thanks!
     
    shelleyh, Oct 31, 2006 IP
  16. infonote

    infonote Well-Known Member

    Messages:
    4,032
    Likes Received:
    68
    Best Answers:
    0
    Trophy Points:
    160
    #16
    Wordpress has RSS feeds by default, so you don't need to add them.
     
    infonote, Oct 31, 2006 IP
  17. Cryogenius

    Cryogenius Peon

    Messages:
    1,280
    Likes Received:
    118
    Best Answers:
    0
    Trophy Points:
    0
    #17
    "Numbers after + are successful hits on "robots.txt" files."

    Cryo.
     
    Cryogenius, Oct 31, 2006 IP
  18. LazyD

    LazyD Peon

    Messages:
    425
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #18
    LazyD, Oct 31, 2006 IP