1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Robots.txt issue pages indexing

Discussion in 'Search Engine Optimization' started by arunch2007, Dec 7, 2013.

  1. #1
    I dont want to index some of dynamic pages and i blocked them through robots.txt file
    i.e.
    User-agent: *
    Disallow:
    User-agent: *
    Disallow: /search?sq*/

    i want to block site search pages but they are indexing on google search. What wrong i am doing
    please guide
    arunch2007, Dec 7, 2013 IP
  2. Ricky Martins

    Ricky Martins Member

    Messages:
    81
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    28
    #2
    This is a better solution for completely blocking the index of a dynamic pages is to use a robots noindex on a per page bases.
    <meta name="robots" content="noindex">the page is not indexed, but links may be followed
    <meta name="robots" content="noindex,nofollow"> the page is not indexed & the links are not followed

    Allow indexing of everything
    User-agent: *
    Allow: /

    Disallow indexing of everything
    User-agent: *
    Disallow: /
    Ricky Martins, Dec 8, 2013 IP
  3. arunch2007

    arunch2007 Member

    Messages:
    214
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    46
    #3
    Thanks for reply Ricky Martins i already used meta robots on each page but still pages are indexing.
    arunch2007, Dec 8, 2013 IP