View Full Version : Yahoo Deep Crawling My Site (Finally)
I noticed that Yahoo seems to be in the middle of a "deep crawl" on my site finally. I've had just my index page and one other page listed with them for what seems like forever (about two months), so hopefully when this is over they finally show the rest of the pages as well.
Sorry for the random post guys. I just had to get this off my chest because I've been waiting so long for them to get around to it :D
Ian
WhatiFind
Jun 7th 2005, 8:42 am
Congrats! I've been waiting for about 3 months now.. No luck so far, still about 3 pages indexed with my new site..
Canadianbacon
Jun 7th 2005, 8:51 am
good to hear. now will they index you though lol
good to hear. now will they index you though lol
LOL...exactly that's what I'm afraid of. Hopefully today's finally the day :D
Ian
Congrats! I've been waiting for about 3 months now.. No luck so far, still about 3 pages indexed with my new site..
It's been about three months for me as well that I've been staring at just 2 of my 2000 pages that they indexed. Getting up every day and seeing all of two pages in their index for that long has had me going crazy. Hopefully after this they finally index all of them. Then hopefully they'll move on to your site next :)
Ian
dm90210dm
Jun 7th 2005, 9:20 am
Hi guys, i'm new here so not sure if this is a taboo subject or not, but...uuuhhhh donesn't anybody know how to get crawled by yahoo in 20 mins and indexed within 48 hours? usually even 10hrs? VERY simple trick... dunno if this is common knowledge or not, just asking ;)
D
yfs1
Jun 7th 2005, 9:21 am
If it involves RSS, then yes, there are quite a few threads on the subject
Heres the biggest one:
http://forums.digitalpoint.com/showthread.php?t=7359
dm90210dm
Jun 7th 2005, 9:22 am
rss/xml too?
if so what categ can i find them ;)
yfs1
Jun 7th 2005, 9:23 am
Go through the thread I posted above ;)
dm90210dm
Jun 7th 2005, 9:25 am
but then i don't understand why the people who wrote above are waiting so long?? i got about 120 sites indexed with over 20,000 pages in under a month... am i missing something?
T0PS3O
Jun 7th 2005, 9:31 am
No, they are/were.
kipling
Jun 7th 2005, 9:44 am
I'm not using rss and have a few important pages indexed. The rankings don't come close to those in MSN or google though.
Ian
Jun 7th 2005, 11:05 am
Hi guys, i'm new here so not sure if this is a taboo subject or not, but...uuuhhhh donesn't anybody know how to get crawled by yahoo in 20 mins and indexed within 48 hours? usually even 10hrs? VERY simple trick... dunno if this is common knowledge or not, just asking ;)
D
I got crawled and indexed using that method (within a short period of time), and it worked great. Unfortunately Yahoo grabbed just two pages and never bothered to index the rest of them, and it had been three months before they all of a sudden started deep crawling last night and into today.
Not sure what the reason was, but that's what happened to me. However that method got my entire site indexed by Google within a matter of days, but Yahoo grabbed two and then quit.
That thread was extremely helpful and that method worked perfectly, and I would definitely encourage everyone to try it. Too bad it can't get me out of Google's sandbox any faster :)
Ian
noppid
Jun 7th 2005, 11:16 am
You can add changing content to your website for free. The news feeds are free and the software is free. Carp RSS (http://www.geckotribe.com/rss/carp/) is very popular, well supported and blazingly fast. It caches the news feeds on your site to deliver the pages of news very quickly. It is highly configurable with custom html at the feed level.
You can get a free Carp RSS Template (http://www.cpurigs.com/forums/showthread.php?t=1426) and tutorial to get started if you'd like as well.
Roze
Jun 17th 2005, 3:42 am
what command do you guys use to find out how many pages are indexed in yahoo? I'm having a hard time getting a straight answer. :o
crazyhorse
Jun 17th 2005, 3:55 am
what command do you guys use to find out how many pages are indexed in yahoo? I'm having a hard time getting a straight answer. :o
site:domainname.com would do ;)
Roze
Jun 17th 2005, 4:00 am
Thank you! Dont ask me what i was trying before, I forget.
Unfortunately they've still got pages and pages from my old phpBB forums indexed and cached - I wonder how soon will it be will they re-visit those URLs and realized they're all 404's that redirect to my new VBulletin forums? :eek:
And then how soon will it be till they reindex the new forums?? :eek:
vBulletin® v3.8.4, Copyright ©2000-2009, Jelsoft Enterprises Ltd.