google does not index a lot of my blog entries. My crawl rate for my blog, designpinas.com is really slow and is reducing by the day. I am also maintaining another blog, amomandmore.com made at around the same time as designpinas but it seems that amomandmore indexes all of the posts while the entries from designpinas.com is only 1/5th indexed. There's definitely no robots.txt I submitted a sitemap and it says '82' entries although google only indexed 10 (which I was definitely positive that it was around 18-22 a few days back). Yahoo is indexing correctly though which makes me wonder even more. Does this have anything to do with previous google reputation? I had a website that plummeted from PR5 to 0 (which didn't really index well either) and permanently redirected it to designpinas.com and I think the bad indexing waves are also coming through (but that's just me). I find it rather odd that my first blog which had 2500+ entries only got indexed with around 180 posts in google while it's fully indexed in yahoo and msn, and this new startup getting quite the same treatment. Reply With Quote
If you are using Wordpress you should add the SEO pack add-on or the google sitemaps add on to be sure you create a sitemap with all the entries in it, sitemap that will be submited to Google and ensure that all pages are crawled.
I actually added the seo pack add on, the google sitemaps and the dd sitemap generator, which I find strange that not all of my entries from the sitemap are generated. again, I already have 82 entries registered on the generated sitemap but google only acknowledges 10-12 on search. designpinas.com/sitemap.xml is working and registers my entries correctly
Or try to get more deeplinks? Most sites with unique content get indexed anyway, even without links.. but if you are still waiting for google to deepcrawl your pages, adding deep-links can be a timesaver.
how long does it usually take for google to deepcrawl pages? Not that I'm being impatient, but I'm afraid that this new startup blog might end up the same as my old blog with a lot of original content but ending up not getting indexed.
Here is a good technique I use and it help me a lot. Use Xenu (Google it) It will create a report. From that report highlight all the links that formatted with title. Paste this on a html with no format just a title tag. Call it contentmap.html (or any other extension) Drop it on your hosting, and link it in the bottom of your site with the anchor as content map. Any one can try this. I have seen my page count increment within days. Note: Besides all your sitemaps. No format or anything on this page, just plain links.
first I've heard of Xenu. My problem is not nearly as severe but I have a few pages that aren't indexed so i'll try it
The problem don't need to be severe. I do this for all new sites, old sites. The only downside of this is that you need to update the file manually. Personally I don't care doing this once a month for the sites. I have seen good results from it.
Please give it at least 4 days before posting your findings. Sometimes it takes less sometimes a little more. But for me it works every time. And is the first time I share it, so feedback would be great.
I've recently had my sitemaps added to google news, and I was reviewing my stats. I noticed some errors. Google says my sitemaps produce errors because they only want news from the last 3 days. Something to think about. maybe they're changing the way they want to index things like blogs and news. Exact warning: This is new too because up until yesterday it indexed all the way back to 3 years ago
they are duplicate entries, since the posts are events coming from the artists themselves and they want the content to be disseminated.
if there is nothink which prevents googlebot, you must find backlinks and wait it to index your pages