Hi, I don't have much knowledge of html.... I want to remove a page from indexing , so from webmaster tool I generated a robots.txt file like User-agent: * Disallow: /p/page.html Allow: / everyone say to upload it to top-level directory ... but my question is where ? should I go and just paste it as it is below my <head> or there is a proper way ... pls suggest.
Hi smsinhindi, All you need to do is upload the robots.txt to your root directory. It doesn't need to be linked anywhere, it just has to be there. Google will then spider your site, and look for that file first.
The robots.txt file goes in your root directory. It's easy to make one... just follow the instructions here:
You could also put in the header of page.html the following code: <meta name="robots" content="noindex" />