Help on Robots.txt Please.. even google groups couldt help :-(

Discussion in 'robots.txt' started by abcde, Apr 4, 2007.

0
  1. #1
    Hi there,

    ive posted this questin already in a google group but nobody could help or give a accurate infomation..

    My Problem:

    If got a site on which I want to block the user sites and they look like this

    http: // de . domain .com / index.php/User: XXXX
    and
    http: // de . domain .com / index.php/User: YYY
    ...
    .

    Do I have to block these sites with:

    Disallow: /index.php/User

    or

    Disallow: /index.php/User:

    or

    Disallow: /index.php/User:*

    Ive really got no Idea....

    The big problem ist I dont want to find it out by trying because Im afraid the robots will not index anything thats after the index.php/

    Thanks in advance and sorry for my bad English.
     
    abcde, Apr 4, 2007 IP
  2. abcde

    abcde Well-Known Member

    Messages:
    151
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    108
    #2
    Got it now..

    Disallow: /index.php/User

    thers no difference between /blabla/user oder /index.php/user
     
    abcde, Apr 4, 2007 IP