Internet Advertising - Wire Transfer - New Vauxhall Cars - Myspace Codes - Blog5 Game Cheats
PDA

View Full Version : robots.txt and delet the pages

surekhaweb
Oct 2nd 2007, 1:32 pm
if i want remove 5 page like

www.abc.com/demo/c.html

www.abc.com/demo/d.html

so what type of code i add in robots.txt

please help me
Nucca_The_Warrior
Oct 22nd 2007, 5:12 am
Nothing, or just type in....

User-agent: Bot name
Disallow: /directory/page1.html

User-agent: bot name
Disallow: /directory/page2.html
Thats how i do mine, but im thinkin it could be kinda redundent...http://shadowmasters.sytes.net/smile/10.gif