I have a PR4 site, high traffic, over year old, my index page is visited regulary but the other links arent always crawled. The link navigation is fine and a lot have backlinks and even PR, but they arent crawled when the bot goes to the index, infact the bot doesnt seem to deep crawl that much even tho I am pr4. I was gonna add sitemap but I have heard about rankings being lost for 1+ yr old sites before so I am hesistant.
Hello, Try to submit a page in Digg. and you will se if you can get indexed Of course your pages are not using noindex tag, etc etc, right? Best, Jakomo
Set up a Google Webmaster Account and create a "google sitemap". I have been using this concept from the start and I have had NO negatives because of it. To create a "google sitemap", I use http://gsitecrawler.com/ for all of our sites and the sitemap.xml.gz is accepted by Google, Yahoo and MSN. Also, run the home page thru a sitemap simulator to verify that the links are in the correct format to be seen by the SEs. You might also, do minor edits on the pages that you want reindexed. This will change the "last modified" file date and then submit it. This works for me everytime. The use of Google's sitemap concept is really needed and I highly recommend you check out Google About Webmaster. This will solve you problem.
Get backlinks... For me, it seems like the more quality backlinks a site has, the more pages are indexed... and the faster they're indexed...
Hmm there are alternative ways to help your pages be indexed by SEs, you may also build deep links for your pages but it takes a lot of time.
I agree that site map is the way to go and also start putting your site in your DP signature line. It is free and you get a Google visit quite quickly. You could also link the inner pages that are not getting indexed. Here is another good site for creating site maps: http://www.xml-sitemaps.com/
Hi, Submit a sitemap.xml file and add this line to your robots.txt file almost every search engines support the sitemap path in the robots.txt file and they will knows about your site structure and pages. ---------------------------------------------------- sitemap: http://www.yourdomain.com/sitemap.xml ---------------------------------------------------- You can go with deep linking and social bookmarking as well as suppling a urllist.txt file containing your site url's.
hello, where did you hear that site maps might harm your site ranking? I do not believe it is true, except if you are using some spamm methods, which in any case will coma back to you at the end regards
http://forums.digitalpoint.com/showthread.php?t=100844 Not just there, I have read quite few places about how submitting sitemap for a 1+ yr old site has lost them pages and rankings.
I read through the thread's posts and I must say: why not? maybe something went wrong even thou I would not believe it without solid proves or too many coincidences. I will do some research in this area and if I find something interesting, I will post it. regards
The PR doesn't play a factor with getting deep pages crawled. Add a site map. A website is not completely crawled every time a bot visits.
I do agree that high PR plays a role with getting the deep pages crawled. Try promoting your deep pages. A nice idea would be making a place like news or just other topics, etc... and have random links to the deep pages. It might help. Regards
Hi, even thou you said that you have links to your inner pages, still try to have more. If it still does not work - check you inner pages content. Maybe not all of your inner pages get less traffic. Maybe it has something to do with the content it self. I hope I helped Regards