Internet Advertising - Tea Forums & Tea Industry Forum - Cheap airsoft - Free Advertising - Deaf Topics
PDA

View Full Version : Need help controlling bots (robots.txt - htaccess - etc)

mdvaldosta
Dec 1st 2005, 1:09 pm
Ok, here's the deal. I want to disallow two dynamic pages - activity.php and profile.php

If I put it into robots.txt to disallow /profile.php - will that disallow all the wildcards like /profile.php?mode=viewprofile&u=92

if not, can this be done in htaccess?
mdvaldosta
Dec 2nd 2005, 6:52 pm
bump in the night
Integrov
Jan 1st 2006, 12:47 pm
maybe you can a noindex meta tag...

or you can put the file in a diffrent directory and disallowing the directory