Hi, I was receiving good rankings in google for some keywords but I recently changed my xml template to another new xml template of blogger and ever since I am not being indexed at the google at all, except for some pages all other and New pages are not showing in google at all, even if typed that url or important keywords from that page. Can someone please tell me what wrong I could have done which has resulted in this disaster for my blog. I need someone’s help in this regard urgently. By the way, i use blogger (blogspot) sub domain as my blog site. Thank you. These lines is appearing there in webmaster tool robot.text file. User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Sitemap: http://domain name/feeds/posts/default?orderby=updated How can i set this problem. ???? plz help me. how can i get my position back in google search engine.
Create a simple text file and rename it to robots.txt In this file you allow the SE crawlers whom you want to allow and then you underneath that you mention the pages that they are to crawl. If you don't want them crawling some directories or pages then you mention them after the disallow.
If you have the below code in your robot.txt file then don't need to remove it. User-agent: Mediapartners-Google Disallow: User-agent: * Disallow: /search Allow: / It also happen with me and I was worried but then I understand that it is just blocking those pages which I mention in "Labels" in my posts. Hope it helps you. Regards, Khurram http://oracledbamaterial.blogspot.com/
Hi, As per the first line of your robots.txt file, it is not mentioned for any other bot other than Mediapartners-Google to take what action. So when googlebot visit your website it see that the crawler which belongs to media patners of google (i.e; News and Blog crawlers) are allowed to crawl your website. The result is no indexing your website by googlebot, which is responsible for crawling and indexing for web search. if you will search your blog in News Search or Blog Search engines of google you can find your blog ranking well. Solution: Just change the First line User-agent: Mediapartners-Google to User-agent: * * is used to direct all the Search engine crawlers like, slerp, msnbot, googlebot and other bots of blog, news etc. Regards zabalex
Still I am In Problem Need Authentic Source Of Information About Blogger Robot.txt and Restricted by Robot Txt URL.