required help

Discussion in 'Google Sitemaps' started by prasannas, Nov 9, 2009.

  1. #1
    Dear members,

    I am getting message "Restricted by robots.txt" when i visited to check the information about my blog from google webmaster tools at crowler error section and the number of restricted URL are increasing day by day.

    Will it affects my search engine ranking? What i have to do to solve this issue? Why this is happens?

    Please give some solution/answer if any one know about this type of issue.

    Thanks
    Prasanna
     
    prasannas, Nov 9, 2009 IP
  2. stylight

    stylight Peon

    Messages:
    38
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    It depends on the content of the robots.txt file i.e. which URLs it blocks.
    How does your robots.txt file is looking?
     
    stylight, Nov 9, 2009 IP
  3. kailash

    kailash Well-Known Member

    Messages:
    1,248
    Likes Received:
    42
    Best Answers:
    0
    Trophy Points:
    190
    #3
    Make sure you have not made mistake creating robots.txt file. If you are not sure you may remove the contents from robots.txt (if you have blogspot, you can not edit robots.txt and you do not need to worry about it). URLs mention in robots.txt will be de-indexed from search engines.

    Kailash
     
    kailash, Nov 9, 2009 IP