Blocke a page using robots.txt

Discussion in 'Search Engine Optimization' started by vamsi, Aug 2, 2011.

0
  1. #1
    I have a url similar to

    http://www.abc.co.uk/template/products.aspx?pid=689&id=210, but on server there is no template folder and webmaster tools giving numerous error like above url.I wanna block this page using robots.txt.If i restrict this folder then webmaster wont give such error?

    Disallow:/tempelate/

    Please help me out.
     
    vamsi, Aug 2, 2011 IP
  2. rankexperts

    rankexperts Peon

    Messages:
    164
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    hi vamsi, if there is nothing in this folder of your website you can block the spiders from crawling it with a little modification in robots.txt. For example if you want to block Google Bot you should write this in your robots.txt
    User-Agent: GooglebotDisallow: /templates/
    kindly tell the exact error you are getting in webmaster tools.
     
    rankexperts, Aug 2, 2011 IP