Hi all, Here's a question that I am hoping that one of the SEO guru's here can answer. Should I have a robots.txt file, plus a <META NAME="ROBOTS" CONTENT="ALL"> tag? I just redid the content on this site. (We are talking basic dreamweaver here), and google won't index the rest of the pages. The first page is ranked as a 2. http://www.visionhr.com.au Any ideas? Much appreciated. Malcolm - Brisbane Australia
NA........They will get it all dont worry, Bots can crawl anything these days Its the stuff you DON'T want crawled you have to worry about
One quick thought - your 'home' link points to: http://www.visionhr.com.au/index.html For SEO purposes it's best to use an absolute URL here to be consistent and point it to: http://www.visionhr.com.au/
You need to remove the blank line from the middle of your robots.txt file: User-agent: * Disallow: /Images/ Code (markup): You can use this tool to validate it. For mor information on the robots.txt file as well as the robot meta tag, visit the offical website. Google has indexed 7 pages from your site, MSN has indexed 23. You need to give it time... Cryo.