Webmaster Tool

Discussion in 'AdSense' started by Tashan007, Dec 30, 2009.

0
  1. #1
    I add my blog in google webmaster tool
    There is an error
    Crawl errors : Restricted by robots.txt 1
    That is the error can any one tell me what is it and how can i improve it?
     
    Tashan007, Dec 30, 2009 IP
  2. tanha_dil

    tanha_dil Peon

    Messages:
    324
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #2
    robots.txt is used to restrict indexing of some places in search engines. if you dont have restricted place you can remove it or allow the crawler . you can do so by generating a robots.txt from the webmasters tool by navigation to the crawler access option.
     
    tanha_dil, Dec 30, 2009 IP
  3. jason830

    jason830 Peon

    Messages:
    373
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    remove the robots,or you should check whether your robots is right.
     
    jason830, Dec 30, 2009 IP
  4. Tashan007

    Tashan007 Peon

    Messages:
    157
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    what is rebots?
    And how can i make is alright?
     
    Tashan007, Dec 30, 2009 IP
  5. DocuMaker

    DocuMaker Active Member

    Messages:
    427
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    60
    #5
    FTP into your web directory and look for a file named "robots.txt."

    There are some online robots.txt editors, but you have to give them your website's/blog's username and password for access. I'm not sure you'd be comfortable doing that.
     
    DocuMaker, Dec 30, 2009 IP
  6. Tashan007

    Tashan007 Peon

    Messages:
    157
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    it is too risky
    tell me that there will be a problem in future on robots.txt?
     
    Tashan007, Dec 31, 2009 IP
  7. Abhik

    Abhik ..:: The ONE ::..

    Messages:
    11,337
    Likes Received:
    606
    Best Answers:
    0
    Trophy Points:
    410
    Digital Goods:
    2
    #7
    what's your robots.txt URL? or, what are the contents in it?
     
    Abhik, Dec 31, 2009 IP