Finding all external links within a site?

Hey guys..

Just wondering if a tool exists that can scan a sites link directories and display all the external URL's that the site links to?

I don't know if this is unethical, but it would certainly be useful.

For example, there is a site whose links page is in this format..

www.site.com/links/themes.html

In this example the themes page has no external links, but over 100 internal links with all the external links only viewable from the sub-pages.

brown-links.html
black-links.html

etc.. etc..

There are over a 100 of these pages, all linked to from the links overview.

What I'm wondering if there is a way to crawl all of the sub-pages (using the overview page as a starting point), and display all the external links contained within those sub-pages.

I know it's lazy, and you could just visit all the links pages to view the outgoing links, but I know that in this business there are time-saving tools for everything

Any ideas or suggestions would be most welcome

 

Try Xenu. It's free.

 

Yea, I tried this already - xenu crawls all of the internal links and builds a sitemap of internal links. the report function didn't return the external links, although it did crawl them.

Xenu is a nice tool for checking structure of internal links and building sitemaps, but it isn't gonna do what I want it to, unfortunately.

Thanks for the suggestion though

 

When you run Xenu and select Check URL, be sure to check the little box that says "Check External Links". The "List of valid URLs you can submit to a search engine" in the report will include all external links.