Yahoo listing fast ?

[Fishing Forum]

Yahoo is indexing web sites fast at the moment - My new site was spidered and listed in Yahoo in 16 days :)

Or is it just me and my lucky charms that did it

Plus general traffic from Yahoo is constantly growing as discussed in other posts

Go Yahoo - nice to know it try finally

[SEbasic]

Seems to be a bit faster for me too.

Slurp's going crazy on one of my sites at the moment too...

Indexed 150 pages in the space of 2 weeks... Not too bad really. (Although there are roughly 500 pages in the site).

It is an improvement, but still not good enough.

[SEbasic]

Interestingly enough...

Look at these results.

http://www.google.co.uk/search?hl=en&ie=UTF-8&q=skiing+in+canada&btnG=Google+Search&meta=

Look at the top 3 - A bit confusing really. G should have picked up the meta redirect...

[pstatus]

Yahoo seems to be caching titles of some of my sites that i have changed a month ago. As far as picking up brand new sites... not too sure.

[Mel]

My experience has been just the opposite, Google indexs more pages than Yahoo and indexs them faster.

[hergo]

For me, Yahoo has hit almost 1000 new pages on my site in the past 2 - 3 weeks.

Funny thing though, only 3 new pages have appeared in the results so far.

[SEbasic]

Funny thing though, only 3 new pages have appeared in the results so far.
That's the problem. Y! is soooooooo sloooooooowwwwww.

[hergo]

Got to admit though Google has yet to go through the new pages. About a week old and its only hit one page. Even MSN has indexed them.

[minstrel]

See Andy Beal's comments about this issue in this article (http://www.searchenginelowdown.com/2004/09/yahoos-slurp-spider-not-crawling-on.html).

[hergo]

Interesting. But how can they compete with the other search engines such as Google and MSN if they intentionally only have a fraction of a search database?

I can understand them intentionally not including some sites in their directory. Especially if they've submitted via yahoo's free directory submission or someting similar.

Can see them looking at mine saying "He can pay".

[Dodger]

Interesting. But how can they compete with the other search engines such as Google and MSN if they intentionally only have a fraction of a search database?

I can understand them intentionally not including some sites in their directory. Especially if they've submitted via yahoo's free directory submission or someting similar.

Can see them looking at mine saying "He can pay".

Ah, the question that is buzzing all over the place. And one that I have no real answer for. But I do know that they are not playing favorites when it comes to the black hole (http://www.webstractions.com/news/2004/09/yahoo-black-hole-from-slurp-to-yahoo.html) that the Slurp pages fall into and never sees the light of day in the Search Index -- even Microsoft themselves are not showing up in that index at the same level as they are at Google.

There was recent post at WPW concerning some doorway pages that had javascript redirects attached to them. These were a certain section of Microsoft's Asian portal into their Solution Marketplace for that division. While all of the talk was concerned about spamming Google, my mind went off in another direction and wondered what was happening over at Yahoo (I am happy to see how it plays out at Google over the next couple of weeks anyway).

What I found was that there were close to 600 pages (http://www.google.com/search?num=100&hl=en&lr=&ie=UTF-8&safe=off&c2coff=1&q=inurl%3Awww.microsoft.com%2Fasia%2FsolutionMarketPlace%2F+portal%2F&btnG=Search) at Google to a mere 70+ (http://search.yahoo.com/search?p=inurl%3A%2Fasia%2FsolutionMarketPlace%2Fportal%2F&ei=UTF-8&n=100&fl=0&xargs=0&pstart=1&fr=my_top&dups=1) at Yahoo. Big disparate gap.

It does show that Yahoo is not playing any favorites when it comes to inclusion -- the pages get Slurped and then they vanish into thin air regardless of who you are. Not even Microsoft is immune -- maybe they should sign up for Yahoo's SiteMatch program eh? :D

With that said, I could not find any of the terms making it into the top 100 for those doorway pages or the pages they redirected to in the Yahoo SERP. This is pretty strange in itself, and is another problem with their Search right now.

[hergo]

Makes you wonder what the hell Yahoo's around for.

I can't remember if it was here, but there was a post about them moving into electronics. They've got the Y! on TV's, mobile phones, etc now apparently.

What the hell is Yahoo focusing their efforts on? Definately doesn't seem to be their search.

[GuyFromChicago]

What the hell is Yahoo focusing their efforts on? Definately doesn't seem to be their search.

Making money anyway they can :D

I'm of the opinion that Yahoo doesn't give a rats as* about it's "organic" results. Either that, or they just don't understand search. With the bank they have to play with, I'd be surprised if it had anything to do with them not understanding what was going on in search.

[digitalpoint]

Maybe give bad organic results to drive sales of Overture. :)

[Jenny Barclay]

Most of our sites get G daily, but Y is 2 months behind; we are not in Y dir.

[Fishing Forum]

Most of our sites get G daily, but Y is 2 months behind; we are not in Y dir.

I know one of my sites is a forum but Yahoo has not left it alone for about 1 month , with not an hour goes by with out a Yahoo friend being there . Its not new to Yahoo just this last month seems to be doing alot more just hope its not like the MSN spider - lots going on but no results

[minstrel]

I know one of my sites is a forum but Yahoo has not left it alone for about 1 month , with not an hour goes by with out a Yahoo friend being there . Its not new to Yahoo just this last month seems to be doing alot more just hope its not like the MSN spider - lots going on but no results
That is precisely the problem and the question, Fishing Forum.

These days, Slurp seems to be a very busy little creature, skittering about all over the place reading everything it can find.

But then what? What the heck is it doing with all these data?

MSN at least showed us a preview of what it is trying to do, although they know and we know they aren't yet where they want to be o will be in due course. What is Yahoo doing?

[nadlay]

Does anyone know any techniques for getting pages into Yahoo's index?

I have one site which has 614 pages in Google, but has only 3 in Yahoo.... and it's been around for about 4 years now.

Anyone think of anything I can do to try and pick it up a bit in Yahoo?

[minstrel]

Other than paying them, no... I'm not sure whether it's by design or incompetence but Yahoo search is pretty weak. They should have stuck with Google feeds...

[Dodger]

I think Minstrel is referring to the SiteMatch program. But even if you are admitted to the program is no guarantee that those "paid crawls" will make it into the Yahoo Index.

Of course, I hear about the non-paid free crawl horror stories -- not sure if this will apply to the SiteMatch crawls. I am just assuming that it would be the same pool of pages that they dump it all into.

If SiteMatch is bypassing that pool of pages and allowing them to go directly to the Index without passing Go -- then that would probably raise a big stink, eh? Anyone using SiteMatch around here that can verify that?

[eitemiller]

We also have the same problem with Y, which really sucks because we rank well in Y for our various kw's. OUr site is about 25k pages big - G has index 10k, while Y is at a mere 900. Is that what everyone else is getting roughly, Y has about 10% of the pages indexed compared to G?

[Dodger]

Slurp is an active little spider. The problem is that those pages take a few weeks to materialize in the Index. Sometimes they do not even show up at all. See Yahoo Black Hole: From Slurp to the Yahoo Index (http://www.webstractions.com/news/2004/09/yahoo-black-hole-from-slurp-to-yahoo.html) for a horror story.

Andy Beal, is a little less congenial than I am (http://www.searchenginelowdown.com/2004/09/yahoos-slurp-spider-not-crawling-on.html) though.

Suffice it to say, you are not alone when it comes to the Yahoo! Search index. We all seem to be in the same boat.

I have yet to hear any comments from people that use SiteMatch and how many pages they are getting into the index. This would be nice information to get a hold of.

[Spyware Remover]

Not to brag, but Yahoo found and indexed a new site in under 24 hours. Must have just caught things at the right time. Lucky? Yes, but I'll take it.

AJ

[Dodger]

Might I ask what site that was?

Also, was the site part of the SiteMatch program or are these purely organic results?

[minstrel]

I believe it was yahoo.ca, Dodger... :eek:

[Spyware Remover]

It was not site match and purely organic.

AJ

[Dodger]

...and the site? If you would prefer PMing with that information, I would greatly appreciate it and keep it in confidence.

It is just that it is rare to hear this kind of story, and each time I do hear it, they never leave a link.

[Olney]

I really got lucky with Yahoo recently. I developed a forum about 4 years ago. Completely forgot about it & the site went down. I went to relaunch the site again & now I have the #2 keywords for that & I'm still configuring the site.

[hergo]

I dont know how much truth there is to this but - I remember reading a few months ago that having someone view your site with the yahoo toolbar installed is enough to trigger a crawl.

I installed the toolbar a while ago to check it out but deinstalled it about 30 mins later. Its shit.

As i say, I dont know if its true. Though I doubt it. Anyone else know?

[minstrel]

It probably is true, hergo, but what does it matter? Getting slurp to your site isn't difficult -- getting it to do anything useful with all that data is another matter.

[Las Vegas Homes]

I had a website that I let lapse for about 6 months. I then reactivated it and within 24 hours I was ranked top 10 in Y for my main key phrase.

There were only a few links and pages still indexed but I guess it saw my site as being important for that key phrase.