sorry if I'm in the wrong thread. Just want to ask if it is all about program? or.. why google robots restricted this URL? jun-luxury-watches.blogspot.com/search/label/The%20Luxury%20Watch%20Today please help me explain this. Thanks.
I don't really understand your question but I think the link in our post is normally accessible. BTW, Google crawler would not restrict any urls, IMO. Of course, it might don't want to pick up some certain urls. Have a nice day,
I think blogger automatically adds the /search or /label directories to the robots.txt file to avoid duplicate content. If you want these kinds of searches or results pages to also be indexed you should probably go with your own domain where you have more control.
Did you mean the report in Google Webmaster Tools? If so, most of the time you see this does mean that url has been marked as "nofollow" or "noindex" via robots.txt.
Bingo! http://jun-luxury-watches.blogspot.com/robots.txt User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Sitemap: http://jun-luxury-watches.blogspot.com/feeds/posts/default?orderby=updated
why? please tell me, what do I need to become an SE friendly? can you teach me how to become SE friendly?
Log-in to yout blogspot dashboard. Go to Settings > Basic Scroll down to Let search engines find your blog? and change the setting to 'Yes'
no wonder you are confused... with so many different answers from people who have answered but not read (or understood) the thread *sigh* blogspot ALWAYS sets robots txt not to index internal search pages within the blog, otherwise it would be never ending as there are millions of words you could search for within your blog. Your robots txt is NORMAL for a blog spot blog. there is nothing you need to change. Your posts will be index as normal. the only thing not indexed is the results of any internal search page made from the search box on your blog. In you case, most of those pages are from your "tag cloud" and blogspot does not enable those pages to be index by bots ... just the way blogspot works.
Don't worry Pal, it's something usual for Blogger. The answer is simple: Blogger is not a Self-Hosted. It also happened to my Blog, even more than 1 URL restricted by robot.txt, I got 20 URL's restrictions. And everything is back to normal within 4 or 5 days and No Crawl Errors anymore. Next day, it will appears again and back to normal again. It's an Effect of Default robot.txt from Blogger, i.e: User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search You cannot change it. But if You want to make a test, Use following robot txt: User-agent: * Allow: / for your URL: jun-luxury-watches.blogspot.com/search/label/The%20Luxury%20Watch%20Today