script that crawls website urls

Is there a script that can crawl my website url and save all the links in urllist.txt file. Help will be highly appreciated.

 

You can use Regular Expression for this case.

 

Grab the contents of the page, then use preg_match on it.

 

Thanks Matthew. I'm not an expert in this field. How can I start proceedings with preg_match (don't know anything). Help Appreciated, sir.

 

php.net/preg_match , or hire me

 

use this free spider :
http://home.snafu.de/tilman/xenulink.html

Only takes a couple minutes to download and install it on ur computer .. its a nice windows app .. jus enter ur website address .. and go!

 

thanks random. But is there any script that can be integrated on website and which can be cron job to fetch all the website links automatically.

 

I will create a simple PHP script to spider URLS/Emails when I have time.

Peace,

 

Here is the script I promised:

http://www.phptricks.com/lesson.php?id=21

It might not work perfectly, but I'll try to perfection it some time later.

Peace,

 

Doesn't work that url dude