Any good site crawler software?

I need a site crawler which will allow me to search any site for a specific keyword/keyphrase. Any suggestion will be much apreciated.

Thanks in advance.

 

Mnogosearch or Htdig are 2 good site crawlers. They are suporting a lot of configs.

http://www.mnogosearch.org/
http://www.htdig.org/

What OS do you use ?

Regards

 

Thanks for the links. I will try these out.

btw, my os is windows.

 

It's also possible to run wget -r and then use a regular desktop search application like Google's or X1 to search through it.