need some help

Discussion in 'Google' started by liveit66, Aug 23, 2011.

0
  1. #1
    google is indexing my tags and category and feeds..how can i block them using robots.txt

    i already have this in my robots.txt

    Disallow: /category/*/*
    Disallow: */trackback
    Disallow: */feed
    Disallow: */comments
    Disallow: /*?*
    Disallow: /*?
    Disallow: /tag/*/*
    Disallow: /tag/
    Disallow: /category/
     
    liveit66, Aug 23, 2011 IP
  2. freespace

    freespace Well-Known Member

    Messages:
    718
    Likes Received:
    15
    Best Answers:
    1
    Trophy Points:
    140
    #2
    Request for them to be removed from webmaster tools. You can also put a noindex and nofollow on those pages in the head section.
     
    freespace, Aug 23, 2011 IP
  3. danielwood

    danielwood Member

    Messages:
    115
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    28
    #3
    it may sound silly but still i would like to confirm, have you added user-agent in your robots.txt file? As without specifying user-agent it would not be of any use.
     
    danielwood, Aug 24, 2011 IP