Limiting search engines listing to main page

Discussion in 'robots.txt' started by stephensaid, Nov 24, 2006.

  1. #1
    Hi All,

    This is my first post here and I beleive I can acheive what I want with robot.txt

    I have a site like www.example.com and each and every user uses www.example.com/userid or example www.example.com/123456

    Now I want search engines to list www.example.com BUT NOT www.example.com/userid.

    Can this be done? An id is automatically generated from a text file when the user enters www.example.com and that is what I want to happen when user come from search engines.

    Kind regards
    Stephen
     
    stephensaid, Nov 24, 2006 IP
  2. lbalance

    lbalance Peon

    Messages:
    381
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #2
    in the robots.txt, list all accounts:
    
    User-agent: *
    Disallow: /12345/
    Disallow: /67890/
    
    Code (markup):
     
    lbalance, Nov 24, 2006 IP
  3. stephensaid

    stephensaid Peon

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Users are dynamic. Actually they are not users but sponsors. So they are all the time being increased. We do not issue the sponsor id but the official site does this. So basically I want to eliminate all. I sinply want the search engine to pick www.example.com

    Don't know if this can be done but we do need it badly.
    Stephen
     
    stephensaid, Nov 24, 2006 IP
  4. stephensaid

    stephensaid Peon

    Messages:
    3
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Any idea how the above can be solved please.
    Thanks Stephen
     
    stephensaid, Nov 25, 2006 IP