My blog is at blogger. It is showing URLs restricted by robots.txt and in the list of pages that is blocked it shows the main site URL Sitemaps are verified. Google stopped indexing my blog. Please suggest.
check if u have problem with meta robots or not. http://forums.digitalpoint.com/showthread.php?t=119920
can anyone tell me when was my blog crawled lastly by google? my site adres is itly.blogspot.com is google crawling my blog?
Hi, There is no robots.txt at itly.blogspot.com. Would it exists, it would be at http://itly.blogspot.com/robots.txt. Jean-Luc
when i visit itly.blogspot.com/robots.txt it shows Does that mean robots will not visit my blog? How to make my blogs accessable to robots?
It was not there yesterday. You just created it ? Anyway, as it is now, it disallows all robots. No "polite" robot will visit you blog. To make your blog accessible to robots, just remove the robots.txt file or replace it by an empty file. Jean-Luc
I added this in the source code of my blog <meta name="robots" content="FOLLOW,INDEX" /> How to remove / replace the robots.txt. Please note that my blog is at blogspot so I can access only the source code of my blog.
Hi, I Have Same Problem Here I was receiving good rankings in google for some keywords but I recently changed my xml template to another new xml template of blogger and ever since I am not being indexed at the google at all, except for some pages all other and New pages are not showing in google at all, even if typed that url or important keywords from that page. Can someone please tell me what wrong I could have done which has resulted in this disaster for my blog. I need someone’s help in this regard urgently. By the way, i use blogger (blogspot) sub domain as my blog site. Thank you. These lines is appearing there in webmaster tool robot.text file. User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Sitemap: http://domain name/feeds/posts/default?orderby=updated How can i set this problem. ???? plz help me. how can i get my position back in google search engine. How can i Solve This Problem . Plz Share Complete Method To Resolve This Problem
If you are using labels for you posts, Blogger by default will restrict those label links. http.../search/label/Out of Place This helps eliminate duplicate content. Unless if there are other links aside from label URLs appearing on the uncrawled list, your blog should be fine. Sometimes it just takes quite a while before Google re-indexes your new content. Happy blogging!
Please tell me why my google webmasters tool is saying me that "URL restricted by robots.txt" hundreds of pages of my site are having such problems according to this google webmaster tool. please help me out in solving it. and if possible then please send me email on thanks a lot..
please tell me if your problem of URL restricted by robots.txt is solved then how can i too solve this problem
for blogger dont use robots.txt file it is useless for it. you need to use meta robots tag for it, it has amazing execution for it.