I'm looking for a tool or tools that will crawl a site and show you what the SE's spiders see. I use to have several bookmarked, but when my laptop got stolen I lost them all. Thanks for you help.
I'm using win2k, I have php and mysql working fine w/"localhost" apache. I've tried to install phpdig but haven't gotten anywhere - I can't even begin to understand the install. Having trouble finding other PHP spiders. Are there any others with good support and documentation?
Check PageRank for all outgoing links from an URL with the powerful PageRank Crawler prdisplay.com/pagerank-crawl.php