Why are proxy pages indexed by search engines like google?

Discussion in 'General Business' started by yyyk9, Aug 22, 2007.

  1. #1
    yyyk9, Aug 22, 2007 IP
  2. FlashPixels.co.uk

    FlashPixels.co.uk Peon

    Messages:
    431
    Likes Received:
    14
    Best Answers:
    0
    Trophy Points:
    0
    #2
    It's weird isnt it? Even though presumably there indexing pages that have already been indexed but with a different URL?
     
    FlashPixels.co.uk, Aug 22, 2007 IP
  3. Scriptona

    Scriptona Notable Member

    Messages:
    4,957
    Likes Received:
    265
    Best Answers:
    0
    Trophy Points:
    280
    #3
    Because Google bot uses your proxy to index external pages

    I think you can limit that by robots.txt file

    but it's not harmful if it doesn't consume much bandwidth (you can check that from AWstats
     
    Scriptona, Aug 22, 2007 IP