lets say i have a page indexed in yahoo which isnt on my server, i want the user who clicks that to go to the home page so im setting up an 404 redirect. Will the bots also follow this redirect and spider the rest of the site
404 will tell the search engines "hey, this doesn't exist, GO AWAY!" use 301 if you want search engines to follow it.
thanks for the advice. The problem is i have 1000s of pages with different extentions so its prooving a problem. Is there a way i can use the 404 and get the spiders to follow it by maybe using a robots.txt?