Hey there. The Slurp bot thing keeps hitting my site, although mostly just ./ it sometimes will do a few file names. My site is about a week and a half old, google has indexed it how long for yahoo? Not sure why it keeps spidering as such but i do not show up in their index. Any general eta?
Don't hold your breath waiting for Yahoo to index. I have a site that's 4 months old that only has the homepage indexed. i have almost 600 pages. Google & MSN has been doing their job but Yahoo must be sleeping. I think they have a pretty aggressive "Sandbox" now.
I think the crawlers are becoming harder these days. It is a good idea to be well linked in the pages you wish to have indexed. Good luck
Yahoo indexed me within a few weeks - unless it's a business website, you can submit your link to them for free.
Yes - make sure you submit to them - my sites were indexed within a day of submission. But harder to get Yahoo to actually crawl much of the content1
Have you submitted a sitemap to Yahoo? I find the Yahoo spider visiting mysite (around 6 weeks old) quite a bit and there are a fair few pages indexed. http://siteexplorer.search.yahoo.com/ Jen
Its the total opposite for me, Yahoo indexed my page right away, but Google only has like 1 or 2 indexed pages.
Get more links, and if it is a larger site, get some links to inner pages. That will help speed up the indexing process and help to index deeper pages.
I have content generator site that being indexed quickly by Google, but not by Yahoo. It seems that Yahoo is bit slower to crawl. But it not applicable to my other site. So it more likely indexing by search engine is depends on site itself.
i have few pages on my blog, but yahoo keep spidering all day. is there a way to limit yahoo. Google has something in their webmasters tool to limit crawling speed. Anything similar for yahoo ?
Your site is still very new being only a little more than a week old! It can take several weeks to months to get indexed. I know, it's one of the toughest things at first.
I've been doing site explorer, and all other necessary things. I have another new site that, without even trying, Yahoo already indexed 10 pages (brand new site & domain). The site I'm concerned about is SEO friendly, so I'm really convinced there is evidence of a sandbox. see the crawl behavior?