Google Stopped Crawling my site, Please Help!

Discussion in 'Google' started by lilquit, Aug 13, 2010.

  1. #1
    Hi
    My home page ranked #1 for all my keywords
    now, it is not to be seen
    other pages are indexed and webmaster tools says i have tons of pages of indexed and everything seems to be OK there, but that does not seem to be the case
    is something wrong with my site?
    am i blocking google or something?

    [​IMG]
     
    lilquit, Aug 13, 2010 IP
  2. Bohra

    Bohra Prominent Member

    Messages:
    12,573
    Likes Received:
    537
    Best Answers:
    0
    Trophy Points:
    310
    #2
    is robots.txt stopping google bot ?
     
    Bohra, Aug 13, 2010 IP
  3. weathor

    weathor Peon

    Messages:
    148
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    weathor, Aug 13, 2010 IP
  4. lilquit

    lilquit Peon

    Messages:
    452
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #4
    That is horrible
    3 pages!
    I used to have thousands
    What happened?
    In webmaster tools would they tell me if my site got penalized or something?
    DO you think my programmer inserted bad code maybe to block google?
     
    lilquit, Aug 13, 2010 IP
  5. lilquit

    lilquit Peon

    Messages:
    452
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #5
    I just uploaded robots.txt with the following

    User-agent: *
    Allow: /
     
    lilquit, Aug 13, 2010 IP
  6. lilquit

    lilquit Peon

    Messages:
    452
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #6
    lilquit, Aug 13, 2010 IP
  7. mario212

    mario212 Peon

    Messages:
    107
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    The graph is too suddenly drop down. Check robots.txt,check metatag noindex,check if server firewall ban Google IPs.
     
    mario212, Aug 13, 2010 IP
  8. lilquit

    lilquit Peon

    Messages:
    452
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I am on a dedicated server
    I will ask my programmer, but other sites on the same server rank high!
     
    lilquit, Aug 13, 2010 IP
  9. lilquit

    lilquit Peon

    Messages:
    452
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #9
    when i click view source, it says

    <meta name="robots" content="INDEX,FOLLOW" />
     
    lilquit, Aug 13, 2010 IP
  10. lilquit

    lilquit Peon

    Messages:
    452
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #10
    Support please?
     
    lilquit, Aug 13, 2010 IP
  11. accelerator_dd

    accelerator_dd Greenhorn

    Messages:
    57
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #11
    maybe you got deindexed? Sandboxed?
     
    accelerator_dd, Aug 13, 2010 IP
  12. Bohra

    Bohra Prominent Member

    Messages:
    12,573
    Likes Received:
    537
    Best Answers:
    0
    Trophy Points:
    310
    #12
    well is ur site working for all countries or blocking certain traffic ?? maybe ur dedi server blocked google thinking its trying to ddos u or something
     
    Bohra, Aug 13, 2010 IP
  13. gameutopia

    gameutopia Peon

    Messages:
    975
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #13
    Some people and scripts like anti-dos protection will automatically block an ip address due to heavy crawling. It can sometimes think it is an attack when it really isn't. Or you or your programmer / admin could have also manually blocked an ip address associated with google crawler. You can check your server firewall to make sure google ip's are not blocked, and you can also check your sites main .htaccess file to verify you do not have deny from google ip's. Just something to check just to make sure. Hope you get it squared away.
     
    gameutopia, Aug 13, 2010 IP
  14. newlogo

    newlogo Peon

    Messages:
    3,931
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #14
    This example indicates that no robots should visit this site further:

    # go away
    User-agent: *
    Disallow: /

    so change your format to below

    User-agent: *
    Disallow:
     
    newlogo, Aug 13, 2010 IP
  15. jamiesbeck

    jamiesbeck Peon

    Messages:
    110
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    if his main page is gone from google, doesnt this mean sandbox or delisted??
     
    jamiesbeck, Aug 13, 2010 IP
  16. lilquit

    lilquit Peon

    Messages:
    452
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    0
    #16
    Is this true? So bummed if so
     
    lilquit, Aug 13, 2010 IP
  17. manny07

    manny07 Peon

    Messages:
    438
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #17
    Do you have a sitemap? Google spiders crawl mostly on sites with a sitemap. Hope this helps.
     
    manny07, Aug 14, 2010 IP
  18. openxcell.webdevelopement

    openxcell.webdevelopement Peon

    Messages:
    151
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #18
    Mate have you check for penalized from search engine. As you said the site was available prior and it suddenly stops showing. I think you should check for penalized or there is a chance that site gets banned.
     
  19. Sxperm

    Sxperm Notable Member

    Messages:
    4,386
    Likes Received:
    142
    Best Answers:
    0
    Trophy Points:
    225
    #19
    I have checked via several factor and found none of them caused a reason. Your domain has not been penalized in most cases I tested. The best bet is wait and see if Google come back. Otherwise you may use some generic link building to inner page such as article writing and submission to helping your overall website a score.
     
    Sxperm, Aug 14, 2010 IP
  20. johngfcarey

    johngfcarey Peon

    Messages:
    446
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #20
    johngfcarey, Aug 14, 2010 IP