google indexing many pages incorrectly

Discussion in 'robots.txt' started by evolving, Aug 30, 2006.

  1. #1
    i'm having a problem with the indexing process
    i have some addon domains that are having pages indexed twice
    once : [nourl]www.addon.com/page1.html[/nourl] (or php)
    the second as: ip /~username/addonfile(name of addondomain)/page1.html (or php)
    the problem is that they consider them duplicate content
    and that the second do not show exactly all the layout it should

    any solution ?
     
    evolving, Aug 30, 2006 IP
  2. hans

    hans Well-Known Member

    Messages:
    2,923
    Likes Received:
    126
    Best Answers:
    1
    Trophy Points:
    173
    #2
    make sure each unique content page has ONE single URL only
    or
    exclude the other half of pages with dupplicate content by robots.txt
     
    hans, Aug 30, 2006 IP
  3. Jean-Luc

    Jean-Luc Peon

    Messages:
    601
    Likes Received:
    30
    Best Answers:
    0
    Trophy Points:
    0
    #3
    There is a better easier solution if you are an Apache user. Create a .htaccess file, like this :
    Options +FollowSymlinks
    RewriteEngine on
    RewriteRule ^\~username\/(.*)   http://www.addon.com/$1  [QSA,L,R=301]
    Code (markup):
    Jean-Luc
     
    Jean-Luc, Aug 30, 2006 IP