someday around 5th-8th April 2005 slurp started a double power-session on 2 separate days to fully indexing my site in April i suddenly have 32189 hits by Slurp Yahoo now Yahoo fresher in its cache than ever before most of this indexing has been done in two monster sessions of 10'000+ hits and the remainder daily as opposed to 13852 Googlebot after this initial indexing the increased slurp/Yahoo indexing went on to remain almost equal to Google in all earlier months - like March - it was something like 11680 Googlebot 7566 Slurp Yahoo 3216 msnbot accordingly a sudden substantial increase in traffic from Yahoo within days after this power-indexing referrers - before ( march ) 66728 4.16% Google 9350 0.58% Yahoo! 2554 0.16% MSN and after ( April ) 91498 3.97% Google 15688 0.68% Yahoo! 3754 0.16% MSN and until mid May 57011 3.29% Google 25571 1.48% Yahoo! 2551 0.15% MSN hence something most have changed in Yahoo and they apparently stepped up their activities and power to match or near match Googlebot. myself i have changed nothing really on my 8 yr old site - hence it all must be Yahoo - leading to an instant 50% increase in traffic within a month did anyone else make same experience in past weeks with Yahoo's slurp and Yahoo traffic
I'm a bit biased towards Yahoo because most of the traffic I receive is from them. Up until a couple of months ago, I wasn't getting anything from them, but now they seem to index all my pages quickly, and I rank very well for certain keywords. After starting one of my sites 7 months ago, I'm still nowhere on google. It's driving me nutts, I just wish they would rank me fairly like MSN and Yahoo. If people dropped google and started using Yahoo, I'd be very happy. They seem to have improved massively by indexing more pages, and doing it quickly. They provide about 80% of the traffic I receive.
We have an online Jewelry Store. It was just hit recently by the slurp. It would be interesting to see what happens in the next few days.
Slurp goes off. We have a script that takes a site offline each night for about 60 seconds to clean up the db. It will email us any page requests that come in...every night Slurp is good for 5 or 6 requests in that 60 seconds.
Slurp is a bit over active. I have a forum where the robot seems to be every day or what. Anyway its fun to see about 150-200 guest online most of the time.
Gede specially in a forum wiht daily visitors a bot never can be over active - best ist to daily index all new posts and replies ... many others would be happy to have daily slurp visits
Had over 200 yahoo bots on my site about a week ago and they only indexed 2 more pages so now I have the BIG 4 pages indexed. I do well with MSN and have about 136 pages indexed with google... I have an RSS feed on my site and a My yahoo page with the site RSS to it but yahoo must just hate me....LOL
Chico 1. do you actually PING yahoo for your RSS feed each time you have a new article in the feed ?? 2, do you have your own RSS feed as SSI ( NOT via javascript !! ) on a few of your pages it helps substantially to get fresh content faster into SE indexing 3. do you have a sitemap with links to all pages of your site ? the last few days again slurp visited intensely to make it in May so far 25986 slurp visits ( most of them again in the past 3 days ) as opposed to 6736 Googlebot visits
When you say sitemap do you mean Nav Bar ?? Im rather new so bare with me. My Nav bar goes to each one of the different Forums. I do Ping on a Reg basis. Chico
Chico nav bar is nav bar and site map is site map ! site map goes to each file makes indexing easier to have one do you have any plans in getting into guiness book of worldrecords with your code http://validator.w3.org/check?verbose=1&uri=http://www.politicalgroundzero.com/ Errors: 787 787 errors is quiet a lot if you dream of getting indexed in full by all major SE !! most likely its created by a extremely faulty forums software ... youi may have to work on it - many threads in this forum cover basic SEO topics some of the code errors are FATAL errors to bots and need to be solved
Damn..........Thanks for the input. Is there any quick way to resolve these issues or must I fix them 1 by 1. Also how can I access this 1 place to make much needed repairs of this code. I see at the bottom of the validation were it got this info from but how can I get to that one page ? Do I have to go to each page individually or can I go to one page like its listed there ? Also MSN seems to index just fine. Chico
if these pages are created by forum software then you have to change templates and scripts accordingly but thats goind either way to be lots of work and out of topc on this thread other option is to change forum software or to make domain root a static page and only unimportant pages by such generators as the one used now pls see other threads about what forum software is best ... good luck
405933 Googlebot 19356 Inktomi Slurp 118933 MSNbot per month on one of my commercial datafeed sites as of late msnbot seems to have awakened from it's sleep 0_o About 5000 uniques a day from the search engines and rising everyday. Sure hope to keep this trend for a long long time :->
I've noticed slurp has been over one of my sites big time in the last few months... don't think I'm doing anything different. They definitely have something going on that's taking a different approach.