Should i block my custom 404 page with robots.txt file?

Discussion in 'robots.txt' started by lateuk, May 27, 2008.

  1. #1
    I have a custom 404 page that people are directed to (using the .htacces file command "ErrorDocument 404 /404.php") should i include this file in my robots.txt file so it does not end up listed in the search engines if a page is moved?

    Thanks
     
    lateuk, May 27, 2008 IP
  2. lateuk

    lateuk Active Member

    Messages:
    317
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    58
    #2
    Anyone help?
     
    lateuk, May 28, 2008 IP
  3. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #3
    Yes you can add this page to your robots.txt....:)
     
    manish.chauhan, May 30, 2008 IP
  4. lateuk

    lateuk Active Member

    Messages:
    317
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    58
    #4
    Will do thanks.
     
    lateuk, May 30, 2008 IP
  5. multi-task

    multi-task Peon

    Messages:
    38
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yeah I did the same thing for some custom pages I created similar to your scenario. We actually had two different pages getting indexed and squashed them both.
    -MT
     
    multi-task, Apr 13, 2011 IP
  6. christina258

    christina258 Peon

    Messages:
    6
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #6
    Just upload your Custom Page with All other pages. NO need to block or add it to Robot.txt.
     
    christina258, Apr 14, 2011 IP