if i want remove 5 page like www.abc.com/demo/c.html www.abc.com/demo/d.html so what type of code i add in robots.txt please help me
Nothing, or just type in.... User-agent: Bot name Disallow: /directory/page1.html User-agent: bot name Disallow: /directory/page2.html Code (markup): Thats how i do mine, but im thinkin it could be kinda redundent...