Finding duplicate content on your website?

Discussion in 'Search Engine Optimization' started by bob25, Apr 28, 2009.

0
  1. #1
    I'm using Wordpress to build my sites, is there a way to find pages that are duplicates? Is there a way to avoid duplicating pages? I think I read somewhere once that it was duplicated with tags, archives, posts page or something.

    Thanks
     
    bob25, Apr 28, 2009 IP
  2. denharsh

    denharsh Peon

    Messages:
    167
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Bob
    You can use robots.txt to avoid duplication or use robots meta plugin.
    The major part which create duplication are
    Category
    tags
    RSS

    you can see an example of robots.txt file here

    http://www.shoutmeloud.com/robots.txt
     
    denharsh, Apr 28, 2009 IP
  3. bob25

    bob25 Well-Known Member

    Messages:
    1,519
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    128
    #3
    That's it, that's all there is to it :eek:

    Thanks
     
    bob25, Apr 28, 2009 IP