getting indexed by Yahoo

[fluke]

Hi - after waiting a few months i have finally got indexed by yahoo - however - it seems that it has only indexed my home page- should i have submitted every page in my site?

now it has indexed my home page - will it index the rest of my site automatically or will i have to manually submit the other pages ? (i have no IBLS to other pages in my site - but they are all linked one way or another to my home page)

[disgust]

at this point you don't even NEED to submit to search engines anymore. I don't bother. just get some good steady incoming links from different domains and you should be set.

I'd imagine that submitting internal pages makes no difference at all.. my guess is that you just have to wait.

[fluke]

OK - thanks

[Old Welsh Guy]

LINKS LINKS LINKS, that is what is going to encourage yahoo! slurp to spider you. After all why shoud they deep spider you for free when they can get you to pay for the privelidge?

Yahoo will spider you if they think your worthy.

[fluke]

are you suggesting i need some IBLs into the deeper pages on my site? - or just more to my home page?

[compar]

are you suggesting i need some IBLs into the deeper pages on my site? - or just more to my home page?
Assuming that your site navigation is complete and properly setup, IBLs to the home page should be sufficient I believe

[Spyware Remover]

Yahoo will find the others pages of your site on it's own. Get as many incoming links from like sites as you can and you will hasten the indexing.

AJ

[samsam]

A competitor of mine has linkdomain:domain.com showing 25k links.
My website shows 194k links.

My competitor shows site:domain.com as 80k pages
My website only shows 1500.

What can I do about it except buying more links ?

[tradefor]

I empathize very much with Fluke, although my site is much different in scale.

I have a small site with 22 live pages of content. Slurp visists about every day (including today), but the bandwidth used each time is tiny, and I still have only 3 pages Indexed in Yahoo vs. all in Google, and even 15 in MSN where the identifiable MSN bot on my logs hasn't been back since May 15th.
My page sizes always come out of the checkers as way too big, so there is no deep crawl from Yahoo - the bandwidth used would probably be about 1 page's worth
My search traffic shows that I haven't had a single Yahoo generated Search in 3 days.

The discrepancy can't be attributed to Links as Google shows none (as in: not any, zero), while Yahoo (& MSN) knows about 20 or so ( I cannot imagine how much work it must be to maintain 125K Links, btw)

Is this Yahoo essentially forcing a paid submission for all newish sites??? :(

[minstrel]

Actually, tradefor, the more common complaint is that Yahoo's spider (Slurp) is overly aggressive at spidering sites, new and old, but getting that data it grabs to appear in the Yahoo SE can take ages...

Another strategy for spider bait: New content. Daily if possible. Even small changes to your pages will do. And then make sure you have a text link to a site map on the home page with TEXT LINKS to all important pages on your site.

[tradefor]

Thank you for the tips.

Flycasting as we speak.

[Blue]

Don't feel bad.

For one of my hobby sites I have only three pages indexed by Yahoo. The site has been up since 2001 with 8,600 backlinks. Go figure.

When Yahoo was using Google results I had 300,000 pages indexed.

Here is the search result from today using the linkdomain command.

Search Results Results 1 - 10 of about 8,860 for linkdomain:mydomain.com

[chiefshuddle]

I know what you mean, I have been indexed with one page in yahoo for well over a year even though Slurp crawls my site on a daily basis. It makes no sense at all.

[iskandar]

IMHO Yahoo do not care much for links to your site too much.
I have almost none good links (apart from my sig files in forums) pointing to my site and almost all of my 100+ pages are now indexed. My only complain is the fact that Slurp visits daily BUT have been slow at updating the pages content.

My site is about 3 weeks old and i receive around 50-60 visits daily from yahoo. If not because of yahoo .. i wouldn't receive any visits at all. Google sandboxed all new sites for few months before you get better ranks whereas yahoo let your pages get good rank even if it's new.

I am not sure what i did that ACTUALLY get the yahoo bot (slurp) to come because i did 2 things. One is submitting my site to yahoo as almost everyone did .. the second is using the rss feed trick that ppl have been talking about. That is create rss feed file in your site, open a yahoo account and add content from your own site using the rss feed. I also bookmarked my own site in my yahoo account.

Some ppl believe that a link like that is good (since it comes from yahoo itself). I dunno if it's true. Like i posted before, after doing these 2 things, slurp came after 3 days and almost instantly get a few pages indexed. After that it makes daily visit and add more pages.

I like yahoo .. if not because of yahoo .. i would not receive any traffic at all ..

[compar]

I also bookmarked my own site in my yahoo account.

Iskandar,

There is some great advice in your post. But can you tell me how to bookmark a site in My Yahoo?

[minstrel]

I suspect superstitious thinking here but assuming there's some validity to it:

- open your My Yahoo page
- depending on how you've custoimized your layout, look in left column (upper right in my case) and click on Bookmarks | My Bookmarks | Add
- add url for your site

- then go to right column bottom | Add content
- add your RSS feed

[iskandar]

There you go Bob,

that's how you'd do it. i know some scoff the idea.. well, just try it. It does not violate any rules and takes only minutes. See if there's any difference this week

[compar]

I suspect superstitious thinking here but assuming there's some validity to it:

- open your My Yahoo page
- depending on how you've custoimized your layout, look in left column (upper right in my case) and click on Bookmarks | My Bookmarks | Add
- add url for your site

- then go to right column bottom | Add content
- add your RSS feed
I'll go and look again, but I wasn't able to find the Bookmark link. I found the RSS with no problem. Strange?

[minstrel]

Hmmm... maybe it isn't there by default. I've been using My Yahoo as my home page for quite some time now, even before the current version.

Look at the top left, Bob.

Do you see Add Content Change Layout Change Colors?

If so, try clicking on the content or layout buttons and see if you find an option to add "Bookmarks".

[iskandar]

Funny .. i think it's on the right side .. not top left.

If you use yahoo heavily and have customised it, it would be .. wherever you put it.

However, if you have not play with it, look at the right hand column. You will see weather, Inside my yahoo, and after that.. the third column is My Bookmark.

p/s another example where rss feed helps to get pages indexed is here :

http://forums.digitalpoint.com/showthread.php?t=7359&pp=10

Hope that proves something!

[chiefshuddle]

IMHO Yahoo do not care much for links to your site too much.
I have almost none good links (apart from my sig files in forums) pointing to my site and almost all of my 100+ pages are now indexed. My only complain is the fact that Slurp visits daily BUT have been slow at updating the pages content.

My site is about 3 weeks old and i receive around 50-60 visits daily from yahoo. If not because of yahoo .. i wouldn't receive any visits at all. Google sandboxed all new sites for few months before you get better ranks whereas yahoo let your pages get good rank even if it's new.

I am not sure what i did that ACTUALLY get the yahoo bot (slurp) to come because i did 2 things. One is submitting my site to yahoo as almost everyone did .. the second is using the rss feed trick that ppl have been talking about. That is create rss feed file in your site, open a yahoo account and add content from your own site using the rss feed. I also bookmarked my own site in my yahoo account.

Some ppl believe that a link like that is good (since it comes from yahoo itself). I dunno if it's true. Like i posted before, after doing these 2 things, slurp came after 3 days and almost instantly get a few pages indexed. After that it makes daily visit and add more pages.

I like yahoo .. if not because of yahoo .. i would not receive any traffic at all ..

Must be something else to it because I have been up for well over a year, have two XML feeds (content and forum) which are both listed in damned near every RSS directory out there, I have done mod rewrites, have a special read only version of my forum which is all mod rewritten along with a forum map, two different site maps, 14000 + backlinks (in yahoo) and also a blog on blogspot.com that gets pinged regularly, has links to most pages on my other site including XML feeds of my content on my regular site.

Now MSN and Google have more than 3000 pages indexed between the two of them, yahoo has 1.

It is the most ridicules thing I have seen in my life.

The funny thing is that Slurp crawls the heck out of my site daily.

[chiefshuddle]

I forgot to note that myself and 200+ members have my yahoo pages with both RSS content feeds added as well.

If this doesn't put that myth to bed then I don't know what will.

[iskandar]

Yes, that's why i said i do not know which action actually makes slurp came and index my pages. I know some said it's a myth and it does not work. If it is just a coincidence, I apologise.
So, it must mean that the the url submission to yahoo have weight, because i submitted to yahoo and have rss feed at the same time.

warm regards :D

[chiefshuddle]

Yes, that's why i said i do not know which action actually makes slurp came and index my pages. I know some said it's a myth and it does not work. If it is just a coincidence, I apologise.
So, it must mean that the the url submission to yahoo have weight, because i submitted to yahoo and have rss feed at the same time.

warm regards :D

I don't doubt that you did something that worked, I am simply stating that I have done everything possible that I have read about in order to make yahoo index more of my site and have failed miserably. If anyone out there has any other suggestions I would be more than happy to try them as well.

[minstrel]

If you're doing well in both Google and MSN, why even worry about Yahoo?

I know how my sites are doing in Google and MSN... I rarely even look at Yahoo. I don't use it as a search engine myself. I know from occasional checks that they have a lot of page indexed and that my rankings are acceptable to pretty good but I get little or no traffic from Yahoo (I get more even from Ask Jeeves and other smaller directories and engines). I don't lose any sleep over what Yahoo does or does not do... I see them as a distant #3 to the other two.

[spdude]

If you're doing well in both Google and MSN, why even worry about Yahoo?

I know how my sites are doing in Google and MSN... I rarely even look at Yahoo. I don't use it as a search engine myself. I know from occasional checks that they have a lot of page indexed and that my rankings are acceptable to pretty good but I get little or no traffic from Yahoo (I get more even from Ask Jeeves and other smaller directories and engines). I don't lose any sleep over what Yahoo does or does not do... I see them as a distant #3 to the other two.

I would disagree and say Yahoo has a bigger market share than MSN.

Yahoo was bringing in 20-30% more traffic than MSN, even though the rankings on MSN were in higher positions for the same keywords. For someone blasted by the Bourbon update, to take another hit in Yahoo does become significant... but life goes on..

[minstrel]

Well, as I've said before, I suspect that which SE gets used depends partly on what people are looking for... Google is the best for research and information; Yahoo seems to be preferred by certain kinds of on-line shoppers; MSN seems to cover the middle ground.

Whatever the reason, despite some fairly decent Yahoo rankings, I just don't see a lot of referrals from them.