Google Stopped Indexing New Pages. Anyone Experiencing This?

Discussion in 'Google' started by raymondcc, May 26, 2008.

  1. #1
    I have a tech blog site with pretty good stats.

    Site: raymond.cc
    PR: Recently went up to 5
    Alexa: 6255
    Subscribers: 23630
    Daily Uniques: About 60,000

    I've upgraded my dedicated server hardware on 21st May and there was a 5 hours downtime. Added RAM, upgraded hard drive and did an OS reload. Everything had to be installed from scratched and data restored from backup.

    Here's the problem.
    I usually post one article a day and it will get indexed by Google. However, I noticed that Google has stopped indexing my NEW articles since 22nd May. I tried searching on multiple Google Search datacenters but nothing at all. Old articles are still being indexed.

    Any idea what could be causing this? What should I be checking? Is anyone experiencing this similar problem around middle of May08?
     
    raymondcc, May 26, 2008 IP
  2. metros

    metros Notable Member

    Messages:
    3,978
    Likes Received:
    373
    Best Answers:
    0
    Trophy Points:
    245
    #2
    Hi,
    Well, do you SEO you pages besides white hat?
     
    metros, May 26, 2008 IP
  3. an63

    an63 Banned

    Messages:
    45
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    there can be delay in index but i don't think so that they will stop Indexing New Pages.
     
    an63, May 26, 2008 IP
  4. raymondcc

    raymondcc Peon

    Messages:
    117
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    @metros: Nope I never do any specific SEO. Just basic stuff like what you see on the pages.

    @an63: Is it possible for Google to delay indexing up to a week? I've checked other tech blog sites and all their latest posts are indexed.
     
    raymondcc, May 26, 2008 IP
  5. godmode

    godmode Well-Known Member

    Messages:
    4,453
    Likes Received:
    156
    Best Answers:
    0
    Trophy Points:
    190
    #5
    Raymond the issue is similar to what happened to blogspot domains a few days back. After careful analysis, I realised that blogspot domain server were facing timeout issue when google was accessing robots.txt.

    Google tries to download your robots.txt at specific intervals. I noticed about every 45min-1 hr. Now if it doesnt get your robots.txt after 4-5 attempts, It flags your website and completely wipe-out from SERPS and also stop indexing your site.

    I noticed this happened to me for 2 days after that it got back to normal once robots.txt was downloaded a couple of times.

    I recommend checking any errors in google webmaster tool for more clarification. PM me if you need help.
     
    godmode, May 27, 2008 IP
  6. raymondcc

    raymondcc Peon

    Messages:
    117
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I tried accessing robots.txt and I have no problems with it.

    Even in Google Webmaster Tool doesn't reveal anything except some errors on the 19th of May. That is the day when my server was having high load and I had to upgrade the hardware on 21st. Everything has been working fine since then. My server achived 100% uptime since the upgrade.
     
    raymondcc, May 27, 2008 IP
  7. atulperx

    atulperx Banned

    Messages:
    3,949
    Likes Received:
    196
    Best Answers:
    0
    Trophy Points:
    0
    #7
    I don't think so because i have a pr4 tech blog and my post get indexed in two days every time . last got indexed at
    on 25 May 2008 16:18:07 GMT.
     
    atulperx, May 27, 2008 IP
  8. raymondcc

    raymondcc Peon

    Messages:
    117
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #8
    2 days is not so bad. Mine from daily became a week and reason is still unknown :(
     
    raymondcc, May 27, 2008 IP
  9. hubel

    hubel Grunt

    Messages:
    382
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    168
    #9
    hubel, May 27, 2008 IP
  10. raymondcc

    raymondcc Peon

    Messages:
    117
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #10
    I noticed that earlier too. That was the ONLY datacenter that indexed the particular post. If you search for other earlier post, you won't find it.
     
    raymondcc, May 27, 2008 IP
  11. hubel

    hubel Grunt

    Messages:
    382
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    168
  12. raymondcc

    raymondcc Peon

    Messages:
    117
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Is it right to search for the URL rather than the title? I usually search the whole exact title with the quotation marks.

    Try searching in Google for:
    "Download Full Version Steganos Password Manager 2007 With License Registration Key Code"
    "How To Copy Text or Error Messages from Any Dialog Boxes in Windows"
    "How To Enable and Access Disabled Grayed Out Buttons, Windows and Checkboxes"
    "2nd Round of FREE Webroot Spy Sweeper 5.5 License Registration Key Code"

    Usually when I search this way, my site will rank number 1. But now, it's not even in the search result.
     
    raymondcc, May 27, 2008 IP
  13. infomadness

    infomadness Peon

    Messages:
    246
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Raymond,
    I have had similar situation with Google indexing. Uptil May 9th, my site was hot pick from Google. Every article that I publish was hitting the home page within an hour. All of a sudden, it dropped all my keywords and now I get very minimal traffic from Google search.
    Traffic dropped from 4000/daily to merely 1000/day. I don't know how you guys get 60,000 uniques everyday. :(
     
    infomadness, May 27, 2008 IP
  14. hubel

    hubel Grunt

    Messages:
    382
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    168
    #14
    Whether you rank for something or if your pages are in Google's index are 2 completley different matters.
     
    hubel, May 27, 2008 IP
  15. vijethk

    vijethk Guest

    Messages:
    44
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    Can any one share how do u det 60,000 vistors very day, i jyst het 40 vists per day
     
    vijethk, May 27, 2008 IP
  16. raymondcc

    raymondcc Peon

    Messages:
    117
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #16
    Well I do not have any blackhat SEO method of getting the traffic that I am getting now. Just post original articles and it took more than 2 years to get there.
     
    raymondcc, May 27, 2008 IP
  17. shenron

    shenron Notable Member

    Messages:
    4,965
    Likes Received:
    374
    Best Answers:
    0
    Trophy Points:
    295
    #17
    Any reason why I can't access your site atm?
     
    shenron, May 27, 2008 IP
  18. Jez

    Jez Well-Known Member

    Messages:
    532
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    138
    #18
    I had this last month. I put about 15 to 20 new pages on my site and while all of the old pages go re crawled and cached none of the new ones did. I think this weekend the last one finally got cached. This is on a fairly busy pr4 site that is crawled quite regularly.
     
    Jez, May 27, 2008 IP
  19. CommonDavid

    CommonDavid Peon

    Messages:
    440
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #19
    CommonDavid, May 27, 2008 IP
  20. raymondcc

    raymondcc Peon

    Messages:
    117
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #20
    Seems like not many of you are experiencing this.

    Most probably it's the Google Dance :p
     
    raymondcc, May 27, 2008 IP