Code regarding the indexing of search engine

Discussion in 'Programming' started by Hersheys, Feb 24, 2011.

  1. #1
    Last edited: Feb 24, 2011
    Hersheys, Feb 24, 2011 IP
  2. AstarothSolutions

    AstarothSolutions Peon

    Messages:
    2,680
    Likes Received:
    77
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Simply put it in your Robot.txt file - google has many pages explaining how to write the file.
     
    AstarothSolutions, Feb 24, 2011 IP
  3. DP Most

    DP Most Well-Known Member

    Messages:
    478
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    108
    #3
    Yes agree with AstarothSolutions
     
    DP Most, Feb 25, 2011 IP
  4. longcall911

    longcall911 Peon

    Messages:
    1,672
    Likes Received:
    87
    Best Answers:
    0
    Trophy Points:
    0
    #4
    The only way to do what you describe is to exclude each page in the root folder, page by page. A folder and all below it is either allowed, or not. You can't disallow a folder and then allow one of its sub-folders.

    Better yet, remove the duplicate content. If you have moved it from the root to a subfolder, use a 301 redirect on each page to the new page in the subfolder.
     
    longcall911, Feb 27, 2011 IP
  5. ACME Squares

    ACME Squares Peon

    Messages:
    98
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #5
    You might want to consider rel="canonical" too.
     
    ACME Squares, Mar 4, 2011 IP