Free Ringtones - Loan Secured - Rapidshare eBooks Download - Cheap Loan - Mortgages

PDA

View Full Version : robots


noelves
Nov 28th 2005, 10:22 pm
I realize link popularity is kicking meta tags to the curb, but I include them anyway.

When I submitted to "Scrub The Web" they sent a message saying my site may not be search engine friendly because my robot.txt tags are either missing or configured wrong.

This is the tags I use: <META NAME="robots" CONTENT="FOLLOW,INDEX">

It went on the say I needed a robot.txt file in my root folder. I done some research on the web concerning robot meta tags, and only a couple of the articles mentioned using a robot file. The rest of them suggests using the tags like I have above. Which one is right?

Thanks,
noelves

frankm
Nov 28th 2005, 10:35 pm
robots.txt is site wide, the <meta name="Robots" ...> is per page.
so both are right I guess.

check out www.robotstxt.org

noelves
Nov 28th 2005, 11:28 pm
OH! OK!

I'm doing per page, so I should be ok. Thanks for the help!

noelves