Robots file duplication?

Discussion in 'robots.txt' started by TourIrl, Oct 11, 2009.

  1. #1
    Hi

    I have both the www and non www versions of my site in Google webmaster tools.

    I am using a 301 to redirect non www to www version.

    I have recently (a day ago) updated my robots file and noticed errors with the disallow commands.....I then noticed that if I go into the non www version of the site in webmaster tools it is still showing the OLD robots file.....

    I think this is causing the issues.

    Sounds confusing I know but hard to explain the situation.

    Any help or advice much appreciated!
     
    TourIrl, Oct 11, 2009 IP
  2. Dan Schulz

    Dan Schulz Peon

    Messages:
    6,032
    Likes Received:
    436
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Let me guess... you're using a content management system such as WordPress that automatically generates a robots.txt file, right? (If not, your server sucks.)
     
    Dan Schulz, Oct 11, 2009 IP
  3. TourIrl

    TourIrl Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Not at all - robots file created manually and is perfectly clean and structured to syntax.

    I dont think the issue is server related. What did you have in mind that would be causing problems like this?
     
    TourIrl, Oct 11, 2009 IP
  4. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #4
    Can you PM me your website so that I can diagnose the problem.
     
    manish.chauhan, Oct 28, 2009 IP