Help with my robots.txt file and crawl error

Discussion in 'robots.txt' started by shanmugasundaram, Sep 27, 2009.

  1. #1
    hi

    my robots.txt has

    User-agent: *
    Disallow: /

    and it shows "Restricted by robots" is webmaster tools

    how should i edit this file and where should i upload it again?

    please help i need to index all my webpages in my blog

    Error Message :

    Home page access: Googlebot is blocked from http://www.xxxxxx.info/

    Status : 200 (Success)
     
    Last edited: Sep 27, 2009
    shanmugasundaram, Sep 27, 2009 IP
  2. theapparatus

    theapparatus Peon

    Messages:
    2,925
    Likes Received:
    119
    Best Answers:
    0
    Trophy Points:
    0
    #2
    And please stop spamming. There's no need to send out PMs that contain the same content as your post here exactly two minutes afterwards.
     
    theapparatus, Sep 28, 2009 IP
  3. shanmugasundaram

    shanmugasundaram Active Member

    Messages:
    230
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    70
    #3
    it is not spamming my fellow Dper you have answered in few threads that is why sent message to you
     
    shanmugasundaram, Sep 28, 2009 IP
  4. theapparatus

    theapparatus Peon

    Messages:
    2,925
    Likes Received:
    119
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Fine. My fee is $85 to read your pm:

    http://drmikessteakdinner.com/contact.html

    Since you sent me that PM, you agreed to it.
     
    theapparatus, Sep 28, 2009 IP
    Dan Schulz likes this.
  5. AKSIN

    AKSIN Peon

    Messages:
    159
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    O my God! You have done just reverse. Please use like as follows -

    User-Agent: *
    Allow: /
     
    AKSIN, Oct 9, 2009 IP
  6. shanmugasundaram

    shanmugasundaram Active Member

    Messages:
    230
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    70
    #6
    yes corrected it
    thanks
     
    shanmugasundaram, Oct 10, 2009 IP