1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

google webmaster tool crawl error "Restricted by robots.txt ‎(473)‎"

Discussion in 'robots.txt' started by waleed.khaliqi, Jan 11, 2012.

  1. #1
    Hi every one i am new to every thing according to Blogging and SEO

    i have a weblog in blogger.com here it is

    i am geting this error in google webmaster tool Restricted by robots.txt ‎(473)‎
    and i think it is the cause that i can not get a good traffic to my weblog

    here is my robot.txt file
    ______________________________________________________________________________
    User-agent: Mediapartners-Google
    Disallow:


    User-agent: *
    Disallow: /search
    Allow: /


    Sitemap: (here i have my sitemap link but this forum dont let me to pot it)
    _______________________________________________________________________

    is there anything wrong with it. plz help me someone.



     
    waleed.khaliqi, Jan 11, 2012 IP
  2. umerplz

    umerplz Peon

    Messages:
    42
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    if u want to restrict "search" directory and allow other directory and pages to be index then use code below:

    ///
    User-agent: *
    Disallow: /search/

    //

    dont put any other code like "Allow: /"

    after changes check your robots.txt from tool.motoricerca.info/robots-checker.phtml

    !!!
     
    umerplz, Jan 25, 2012 IP