How to edit robots.txt in blogspot blog

In recent times many of my blogspot blogs are de-indexed from google. From google webmaster tools i learnt that

urls restricted robots.txt[148]

According to google robots.txt had restricted access to 148 urls in my blog. Then i used their robots.txt analysis from their tools section.

it showed the text of my robots.txt as follows

"
User-agent: *
Disallow: /search
Sitemap: http://self-development-meditation.blogspot.com/feeds/posts/default?orderby=updated
"

It clearly shows that term "disallow" is used. This is the problem most of my blogspot blogs in recent times. I am not sure whether you face a similar problem.

Please help me in this regard. How can i edit that robot.txt file.

advanced thanks
rajanmr

 

You cant change the robots.txt file in Blogger unless you host your own blog in your server.

Disallow: /search --- Is alright. Its just not going to index the search results pages which are duplicate by nature.

So the current robots.txt @ blogger is just fine...but ofcourse its not perfect. You cant modify it the way you like.

 

if i were , i remove my sitemap url from my robots.txt and submit my url directly from my webmaster tools panel

 

Why would you do that?
And does it really matters to submit feed or url as a sitemap?
As per BlindCat, the current Robots.txt of Rajan's blog is fine, but then what about those 148 urls showing as restricted.

 

You cannot upload the robots.txt file, but you can use the robots meta tag to control the crawling of bots on particular files.

 

you can't change the robots.txt in blogger...try editing your blog header for indexing the other pages...don't use labels..use texts and link your posts on sidebar

 

Thank for your suggestion

 

google is indexing my site like this

Hi-Quality desktop wallpapers
Archive. ▼ 2008 (47). ▼ August (47). ▼ Aug 31 (14). Reptiles 2 · Paris at Night · Charming Girls · Perfect Bedrooms · Designer Bathroom · Home Decoration ...
colordesktop.blogspot.com/ - 113k - Cached - Similar pages

but there are other texts to show but google is not showing that.

what should i do?

thanks in advance

 

Could someone explain better this issue ?
I have "categories" in my blog, each one is actually a label, I can't figure out another way of grouping together related articles.

 

is it a private domain "www.(*"(*£(*".com or )"£$").blogspot.com , i could re-code this for you if you PM me, "for free"

 

Blog I am talking about is in my signature

 

hi
i dont know good but you must make it archiving

 

i have the same problem. since robots.txt blocks crawling urls, my google traffic is fluctuating highly. some time it is 150 per day and some time it is 10-20. this is really annoying!! any expert help me please!

 

add this meta tag

<meta content='noindex,follow' name='Labels'/> for block your label or
<meta content='noindex,follow' name='Archive'/> for block archieve

 

i have nearly the same problem. someone know why google wouldnt want to index my web? i have been waiting more than a month

 

Is there not really any why to change blogger robot.txt file because there are more than hundreds of bots to follow and in blogger we have only one which is media partner.

Is media partner means all the bots should follow the website or it's only google search or it includes all search engines.

 

Thanks You :

 

Why did you said me thank you, I haven't asked a question, I need answer for the question.

But you welcome..and I have searched many place to change robot.txt file but there is not way to change, only one thing to do is move to wordpress and buy your own domain and host some where than you can change robot.txt file.

I hope this will help.

 

hey, can you place meta tags in blogger to exclude a directory from google? like Disallow: /2010/01/ ?? how can you do it?

 

Hi,

Could you please explain it in brief?