Yahoo stepping up - slurp is flooding my site and Yahoo traffic going up substantiall

someday around 5th-8th April 2005 slurp started a double power-session on 2 separate days to fully indexing my site
in April i suddenly have
32189 hits by Slurp Yahoo
now Yahoo fresher in its cache than ever before

most of this indexing has been done in two monster sessions of 10'000+ hits and the remainder daily as opposed to
13852 Googlebot

after this initial indexing the increased slurp/Yahoo indexing went on to remain almost equal to Google

in all earlier months - like March - it was something like

11680 Googlebot
7566 Slurp Yahoo
3216 msnbot

accordingly a sudden substantial increase

in traffic from Yahoo within days after this power-indexing

referrers - before ( march )

66728 4.16% Google
9350 0.58% Yahoo!
2554 0.16% MSN

and after ( April )

91498 3.97% Google
15688 0.68% Yahoo!
3754 0.16% MSN

and until mid May
57011 3.29% Google
25571 1.48% Yahoo!
2551 0.15% MSN


hence

something most have changed in Yahoo and they apparently stepped up their activities and power to match or near match Googlebot. myself i have changed nothing really on my 8 yr old site - hence it all must be Yahoo - leading to an instant 50% increase in traffic within a month

did anyone else make same experience in past weeks with Yahoo's slurp and Yahoo traffic

 

I'm a bit biased towards Yahoo because most of the traffic I receive is from them. Up until a couple of months ago, I wasn't getting anything from them, but now they seem to index all my pages quickly, and I rank very well for certain keywords.

After starting one of my sites 7 months ago, I'm still nowhere on google. It's driving me nutts, I just wish they would rank me fairly like MSN and Yahoo.

If people dropped google and started using Yahoo, I'd be very happy. They seem to have improved massively by indexing more pages, and doing it quickly. They provide about 80% of the traffic I receive.

 

We have an online Jewelry Store. It was just hit recently by the slurp. It would be interesting to see what happens in the next few days.

 

Slurp goes off. We have a script that takes a site offline each night for about 60 seconds to clean up the db. It will email us any page requests that come in...every night Slurp is good for 5 or 6 requests in that 60 seconds.

 

I'm getting more referrers from mail.yahoo.com than from search.yahoo.com

 

Y traffic dropped off for me on the April 1 update. Last two days it's back. I hope it sticks.

 

Slurp is a bit over active. I have a forum where the robot seems to be every day or what. Anyway its fun to see about 150-200 guest online most of the time.

 

Gede

specially in a forum wiht daily visitors a bot never can be over active - best ist to daily index all new posts and replies ...
many others would be happy to have daily slurp visits

 

Had over 200 yahoo bots on my site about a week ago and they only indexed 2 more pages so now I have the BIG 4 pages indexed. I do well with MSN and have about 136 pages indexed with google...

I have an RSS feed on my site and a My yahoo page with the site RSS to it but yahoo must just hate me....LOL

 

Chico

1.
do you actually PING yahoo for your RSS feed each time you have a new article in the feed ??

2,
do you have your own RSS feed as SSI ( NOT via javascript !! ) on a few of your pages it helps substantially to get fresh content faster into SE indexing

3.
do you have a sitemap with links to all pages of your site ?

the last few days again slurp visited intensely to make it in May so far

25986 slurp visits ( most of them again in the past 3 days ) as opposed to 6736 Googlebot visits

 

When you say sitemap do you mean Nav Bar ??

Im rather new so bare with me.

My Nav bar goes to each one of the different Forums.

I do Ping on a Reg basis.

Chico

 

Chico

nav bar is nav bar
and site map is site map !
site map goes to each file
makes indexing easier to have one

do you have any plans in getting into guiness book of worldrecords with your code
http://validator.w3.org/check?verbose=1&uri=http://www.politicalgroundzero.com/

Errors: 787

787 errors is quiet a lot if you dream of getting indexed in full by all major SE !! most likely its created by a extremely faulty forums software ...
youi may have to work on it - many threads in this forum cover basic SEO topics

some of the code errors are FATAL errors to bots and need to be solved

 

Damn..........Thanks for the input.

Is there any quick way to resolve these issues or must I fix them 1 by 1.

Also how can I access this 1 place to make much needed repairs of this code.

I see at the bottom of the validation were it got this info from but how can I get to that one page ? Do I have to go to each page individually or can I go to one page like its listed there ?

Also MSN seems to index just fine.

Chico

 

if these pages are created by forum software
then you have to change templates and scripts accordingly

but thats goind either way to be lots of work
and out of topc on this thread

other option is to change forum software
or to make domain root a static page and only unimportant pages by such generators as the one used now

pls see other threads about what forum software is best
...

good luck

 

Thanks..

I appreciate it.

Chico

 

405933 Googlebot
19356 Inktomi Slurp
118933 MSNbot

per month on one of my commercial datafeed sites as of late

msnbot seems to have awakened from it's sleep 0_o

About 5000 uniques a day from the search engines and rising everyday. Sure hope to keep this trend for a long long time :->

 

I've noticed slurp has been over one of my sites big time in the last few months...
don't think I'm doing anything different. They definitely have something going on that's taking a different approach.