I've recently totally re-vamped a site. There are several new pages but they are 3 clicks from the home page. Google has re-indexed all the original pages but is still not seeing the new pages. Is this just a matter of time or will it only index to a certain level within a site? Thanks
I'm having similar "problems" with my site too. It has nearly 10,000 pages but they're all three clicks or more away from the home page. I don't know if that's the reason for the fact that so far only 89 pages have been indexed. The website is online since August this year.
Forgot to mention that the problem may also be caused by the ugly url's like this one: www. mydomain. com/index.php?termPrefix=Boatrent®ionNm=Europe&destinationId=16&countryNm=France&countryId=26 The webdesigners are working on rewriting these url's to google-friendly ones. Hope that helps.
There used to be this widespread belief that google will not go more than 3-steps away from the index page. "Steps" were loosely defined as "clicks" or "sub-directory" levels etc. I think that contemporary SEOs do not subscribe to that theory at all. Still, for a poorly linked site or for a very new site there might be some merit to what you say. It might have to do with Google finding a link to the deep pages in the first place. But, that should just be a matter of time. In the case of very big sites, it is not possible to be within 3 "steps" from the home page. So, do not necessarily bother too much about that. A solution to the situation could be getting more links to the home page as well as to inner-pages. You could consider the usual routine of directory submission to make multiple pleas to the search engines to spider your site. In the past few months I have noticed that there seems to be a growing selectivity in choosing pages for spidering. But that is not something that time and more links cannot solve. Note: Spidering is step one of a long journey. Quality of content will go a long way in some of the further steps. Good Luck.
Anything more then 3 clicks you should create a sitemap. Yes G**gle Will Spider the Non SEO Friendly URL but will take a lot longer then if it was SEO Friendly. Suggest you make a siteMap and Do Mod_rewrite. There are programs you can Use to make a sitemap for that many pages.
There is a sitemap which is already being spidered by google. Strangely though, the url's from there (still ugly ones) are not (yet) being indexed. From the sitemap it takes at least 2 steps to get all pages. The mod_rewrite is being implemented these days/weeks but these guys are telling me it takes a lot of time to do so for the entire site.
If the owner of this webcompany wouldn't have been my partner in business (but apparently with a different agenda) I would have left them long time ago.
ounds like mine is just a matter of time then, no long urls and the sitemap is on there. I'll just have to wait I guess as its visited by googlebot every couple of days anyway.
I have heard, and have no idea if this is true, that how deep google crawls a site depends on pagerank. Any truth to that?
Well, my PR is 3. But I guess when G has indexed all my pages (>10,000) and recognizes all my backlinks (approx 200 but only 12 shown) it could be a 5.