Hi, I am using a xenu link to findout my sites crawlability. Everything seems good, except couple of url links. I was wondering how to get those individual subpages crawled on google, yahoo or bing. Ex : www.example.com is my site Crawled : www.example.com/blog Link not crawled : www.example.com/archieve/excellent How do i get that url crawled ? Thanks
It is important to get good backlinks to the pages that haven't been crawled by search engines.You may also put the internal links on the landing page to get better results.
there are 2 things which needs to be done in this regard. 1- get the internal links to those pages from your home page. 2- get backlinks to those pages.
Creating xml sitemap and submitting it to a webmaster tool also helps to get subpages crawled in SERP's
hi, you can resubmit your sitemap.xml in Google webmaster tool though effect of this will less but then also you should try this. Write good articles having link of inner pages and submit them into reputed sites. You can also submit nice articles or events into social bookmarking sites having link of inner pages of your site. As one said here that make more relevant you interlinking of the site.
* Make sure you have links from websites that are frequently updated, and that slurp is known to like. I speak from experience. One of my content-rich sites has a single link from a good site and is hogging spots in the top five in Yahoo. It took a few months to get there, but it's jammed in there now and not moving. * Make sure you have good original content that is unique to your website (affiliate feeds need not apply) * If your site is ecommerce, make sure that you have enough content on the page for indexing. * Make sure your title and meta tags are all different
There are many ways. 1. Submit an XML site map ( the one which updates yourself) to google webmaster tools account. 2. Build links from better ranked pages to ignored pages with proper Anchor text. 3. Publicize the content on ignored pages using socail bookmarking tools. Try to submit all your pages ( but not all at once , try only 2-3 pages daily, the ignored ones first)