The site is run by Invison Power Board forum software. Under Admin tools, you can click on "View Bot Log", which will list each spider that visited, keep a count for each and keep track of which page they requested. The tool is telling me it's yahoo.com. I see the ipaddresses coming in are from the following... 72.30.xx.xx and 68.142.xx.xx
Also, if you have Cpanel installed on your server (domain.com/cpanel), you can use the statistics program to show you bot activity as well.
Yahoo Slurp Spider has been known for unnecessary visits, people even had to set up robots.txt to stop yahoo going in or control it. Our site, Maternity.com has average of 150 Yahoo bots a day. However; google is a different story.
We have 357 listing on yahoo atm, I had just rebuild the site 2 months ago. Usually we have 4,5 new pages lising to yahoo SERP every week.
My problem is that slurp visits 100+ times each day but still only indexes main page. If slurps wants to visit fine but atleast index some of the 100 pages he is requesting each day.
Yahoo did the same thing to me for 2,3 weeks, only put the forum index page on the SERPs, all other pages are old, even non existance. After that time, I got 1,2 pages in then slowly moving. I think it just matter of time.
not only the slurp, but their Yahoo search marketing bot too. http://www.jensense.com/archives/2006/06/yahoo_search_ma.html
I will start feeling the love once #indexed_pages > 1 It seems odd yahoo has been visiting since mid-april and still only 1 page. Forget about 2 - 3 weeks, I am talking 12+ weeks. I wonder what yahoo spider does with the pages it indexes.