Google Bot Stopped Crawling My Site

Discussion in 'Google' started by bigmodo, Jan 11, 2010.

  1. #1
    I need help. For some months now, google bot has stopped crawling my site. I do not know whats the reason for it. Is there anyway to find out why and a way to fix it? My site is modospot.com/review
     
    bigmodo, Jan 11, 2010 IP
  2. Bohra

    Bohra Prominent Member

    Messages:
    12,573
    Likes Received:
    537
    Best Answers:
    0
    Trophy Points:
    310
    #2
    Bohra, Jan 11, 2010 IP
  3. scylla

    scylla Notable Member

    Messages:
    1,025
    Likes Received:
    33
    Best Answers:
    1
    Trophy Points:
    225
    #3
    lol, yep he's right. Your robots.txt will not only stop google but any other bot that tries to index the site with the way it currently is!!
     
    scylla, Jan 11, 2010 IP
  4. PankajKumar

    PankajKumar Active Member

    Messages:
    431
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    80
    #4
    remove"/" from ur robots.txt file and problem will be solved.
     
    PankajKumar, Jan 11, 2010 IP
  5. PankajKumar

    PankajKumar Active Member

    Messages:
    431
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    80
    #5
    currently it is
    User-agent: *
    Disallow: /

    I mean remove / from Disallow
     
    PankajKumar, Jan 11, 2010 IP
  6. bigmodo

    bigmodo Well-Known Member

    Messages:
    520
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    108
    #6
    how can i find the robots.txt? I have tried looking for it in my file manager but i did not see it.
     
    bigmodo, Jan 11, 2010 IP
  7. Bohra

    Bohra Prominent Member

    Messages:
    12,573
    Likes Received:
    537
    Best Answers:
    0
    Trophy Points:
    310
    #7
    its not there in ur public_html ??
     
    Bohra, Jan 11, 2010 IP
  8. bigmodo

    bigmodo Well-Known Member

    Messages:
    520
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    108
    #8
    Ya, it is not there. Nevertheless, i am using wordpress.
     
    bigmodo, Jan 11, 2010 IP
  9. Jelenik

    Jelenik Well-Known Member

    Messages:
    73
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    126
    #9
    In wordpress there is option to set if you want your blog be visible in search engines or not. It asks you when you are installing wordpress, maybee you check that you dont want to be visible.
     
    Jelenik, Jan 11, 2010 IP
  10. bigmodo

    bigmodo Well-Known Member

    Messages:
    520
    Likes Received:
    5
    Best Answers:
    0
    Trophy Points:
    108
    #10
    Thanks everyone. I have fixed it.
     
    bigmodo, Jan 11, 2010 IP