Some posts Restricted by robots.txt in Google webmaster tool

Discussion in 'robots.txt' started by dkv, Mar 5, 2011.

0
  1. #1
    Hello

    According Google web master tool my blogs's Some posts Restricted by robots.txt and these posts are out of Google cache.. and also counting as error in sitemap these posts. i could not find where is problem
    I already checked these posts there is not such meta tags that blocks the crawling the google

    Robots txt file

    User-agent: *
    Allow: /

    Let me suggest where is problem

    Dkv
     
    dkv, Mar 5, 2011 IP
  2. carleisenstein

    carleisenstein Peon

    Messages:
    253
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Have you checked the HTML code of your pages? Do they have a <meta name='robots' content='noindex'> type line in them? If so, that might be your problem.
     
    carleisenstein, Mar 5, 2011 IP
  3. dkv

    dkv Member

    Messages:
    350
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    28
    #3
    there is not such meta tags , that i already checked there
     
    dkv, Mar 6, 2011 IP
  4. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #4
    If the above mentioned points are correct then there is something wrong with your website and no once can diagnose the problem till he is able to review your webiste.
     
    manish.chauhan, May 4, 2011 IP