should i change this and my robots.txt and how?

Discussion in 'robots.txt' started by scuba5794, Sep 6, 2007.

  1. #1
    i have a new blog and i noticed that google indexed this version of the site

    example.com

    however i am not sure if i will get penalized for duplicate content because it might also index

    www.example.com

    should i worry about being penalized for duplicate content and if so can i fix this in my robots.txt file and how do i fix it in the robots.txt file?
     
    scuba5794, Sep 6, 2007 IP
  2. ace.tuku

    ace.tuku Peon

    Messages:
    773
    Likes Received:
    16
    Best Answers:
    0
    Trophy Points:
    0
    #2
    please clarify >>> You own example.com and not www(dot)example(dot)com BUT the content on Both sites are same ???
     
    ace.tuku, Sep 8, 2007 IP
  3. bylla

    bylla Peon

    Messages:
    205
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #3
    When it comes to content hosted on www.example.com and just example.com I don't think google or any search engine will penalize you for duplicate content. If you instead use another domain like sample.com with the exact same content as example.com you may get penalized.

    /Andreas
     
    bylla, Sep 9, 2007 IP
  4. scuba5794

    scuba5794 Active Member

    Messages:
    725
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    73
    #4
    thanks for your input bylla i would hope so but just in case i did a htaccess file change that automatically redirects to the (www) version of the site using a 301 redirect
     
    scuba5794, Sep 9, 2007 IP
  5. seoworld

    seoworld Active Member

    Messages:
    471
    Likes Received:
    20
    Best Answers:
    0
    Trophy Points:
    58
    #5
    You did the right thing, having a 301 redirect is better then a 302 redirect.
    As a side note the same thing applies for
    www(dot)example.com/index.php and just
    www(dot)example.com/
    without the index.php

    I had this with a site of mine and when I checked in google for
    site:www(dot)example.com the home page was comming up only (only the index.php page came up) if I clicked on omitted results. After the google dance I noticed that it was droped completely from googles index (both the home page and the index.php). So I did the same thing that scuba5794 did and I made a 301 redirect on the index.php and a week or so later my home page is coming up in googles index.

    I cant believe that it was just a fluke.

    You should always make 301 redirects on www and non www pages and for index.php and non index.php pages.
     
    seoworld, Sep 11, 2007 IP