Online Advertising - Wordpress Theme - Self Improvement Articles Directory - Christmas Ecards - Wordpress Themes
PDA

View Full Version : Is there a program that can list all the links on a site?

ronmojohny
Oct 3rd 2006, 11:35 pm
software to go to a site, follow all the links, and make a list of all the links it finds on that website. (I want to submit all the pages to a SE)

Thanks, RonMo
niceboy
Oct 4th 2006, 12:38 am
i think u need a site map tool. try http://www.xml-sitemaps.com/ which is free upto 500 pages.
ronmojohny
Oct 4th 2006, 3:18 pm
what I'm really looking for is a program that strips out just the urls and puts them in a text file, one URL for each line.

-Ron
svajdlenka
Oct 4th 2006, 11:57 pm
My program show you all internal links for domain, but it have no funcionality to write it to file.
rosiee007
Oct 5th 2006, 12:09 am
Xenu Link Sleuth can do that. You need to download and install it.

It will generate a report in the end which will have errors (if any) and then a list of all the internal and external links on the website you checked.

If you want an online tool, you can try this Dead and Broken Links Checker (http://www.dead-links.com). It takes about 30 minutes to run (if you have a large site) and gives a list of internal and external pages in the end.

However, this might not work for VERY large sites, so Xenu will be good for VERY large sites.
hubel
Oct 6th 2006, 12:46 pm
what I'm really looking for is a program that strips out just the urls and puts them in a text file, one URL for each line.

-Ron

http://www.xml-sitemaps.com will do that. It will give you options for text files containing a list of urls as well as html, xml and ror sitemaps.