google webmaster tool crawl error "Restricted by robots.txt ‎(473)‎"

Discussion in 'robots.txt' started by waleed.khaliqi, Jan 11, 2012.

  1. #1
    Hi every one i am new to every thing according to Blogging and SEO

    i have a weblog in blogger.com here it is

    i am geting this error in google webmaster tool Restricted by robots.txt ‎(473)‎
    and i think it is the cause that i can not get a good traffic to my weblog

    here is my robot.txt file
    ______________________________________________________________________________
    User-agent: Mediapartners-Google
    Disallow:


    User-agent: *
    Disallow: /search
    Allow: /


    Sitemap: (here i have my sitemap link but this forum dont let me to pot it)
    _______________________________________________________________________

    is there anything wrong with it. plz help me someone.


     
    waleed.khaliqi, Jan 11, 2012 IP
  2. umerplz

    umerplz Peon

    Messages:
    42
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    if u want to restrict "search" directory and allow other directory and pages to be index then use code below:

    ///
    User-agent: *
    Disallow: /search/

    //

    dont put any other code like "Allow: /"

    after changes check your robots.txt from tool.motoricerca.info/robots-checker.phtml

    !!!
     
    umerplz, Jan 25, 2012 IP