What are these dam Robots up to?

Discussion in 'robots.txt' started by alanbutt, Oct 31, 2008.

  1. #1
    Hi from South Africa,
    When I went on to Google Webmaster Tools I did an analysis of the Robots.txt. It said 15 of my blog pages were blocked. The following is the report.

    User-agent: Mediapartners-Google
    Disallow:

    User-agent: *
    Disallow: /search
    Noindex: /feedReaderJson

    Sitemap: http://alcoholism-alifesentence.blogspot.com/feeds/posts/default?orderby=updated
    Should I worry and should I get rid of them and more importent, how? Help.
    I use Blogger.
    Cheers
    alanbutt
     
    alanbutt, Oct 31, 2008 IP