How to stop search engines from indexing proxified pages

Discussion in 'robots.txt' started by Pompay, Sep 29, 2008.

  1. #1
    I have several php proxy 0.5 websites and when googling I see that my proxified pages are also being indexed. How can I stop this ?

    I need a robots.txt code to deny access to the search engines to the proxified pages, index.php

    Pompay.
     
    Pompay, Sep 29, 2008 IP
  2. dcristo

    dcristo Illustrious Member

    Messages:
    19,776
    Likes Received:
    1,200
    Best Answers:
    7
    Trophy Points:
    470
    Articles:
    7
    #2
    Yep, you use robots.txt to block google bot accessing specific pages or folders.
     
    dcristo, Sep 29, 2008 IP
  3. izzatz13

    izzatz13 Active Member

    Messages:
    541
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    60
    #3
    put this

    User-agent: *
    Disallow: /index.php?q*
     
    izzatz13, Sep 29, 2008 IP
  4. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #4
    Use this code:

    User-agent: *
    Disallow: /browse.php
     
    manish.chauhan, Jan 22, 2009 IP
  5. ggmittal

    ggmittal Guest

    Messages:
    27
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #5
    can you tell the alias of the proxified URLs
     
    ggmittal, Feb 24, 2009 IP
  6. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #6
    It simply refers to the pages that generate while browsing website in proxy..:)
     
    manish.chauhan, Mar 4, 2009 IP
  7. buldozerceto

    buldozerceto Active Member

    Messages:
    1,137
    Likes Received:
    43
    Best Answers:
    0
    Trophy Points:
    88
    #7
    User-agent: *
    Disallow: /index.php?q=
     
    buldozerceto, Mar 5, 2009 IP
  8. ggmittal

    ggmittal Guest

    Messages:
    27
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    ggmittal, Mar 5, 2009 IP