Robots.txt Dynamic Page

Discussion in 'Google' started by kbrkal, Sep 27, 2010.

  1. #1
    I am looking to not allow any search engines to go to the following URLS:

    game-supplies.php?psp_product=asfasfsdfsdf

    I want them to go to game-supplies.php and index just that page but not the dynamic one

    I updated the robots.txt with the following:

    Disallow: /game-supplies.php*?psp_product=Is that right?
     
    kbrkal, Sep 27, 2010 IP
  2. DoDo Me

    DoDo Me Peon

    Messages:
    2,257
    Likes Received:
    27
    Best Answers:
    0
    Trophy Points:
    0
    #2
    Disallow: /game-supplies.php?psp_product=

    (please note, it's not standard and some search engine may not understand. For as for as I know, Google understand. You can try at google webmaster tool/
     
    DoDo Me, Sep 27, 2010 IP
  3. kbrkal

    kbrkal Peon

    Messages:
    23
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Great, I will update the robots.txt file and see how it goes. Thanks
     
    kbrkal, Sep 27, 2010 IP
  4. mario212

    mario212 Peon

    Messages:
    107
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    try this:

    Disallow: /game-supplies.php*
    Allow: /game-supplies.php

    Check in Webmaster Tools to not block other pages.
     
    mario212, Sep 27, 2010 IP
  5. johnclouseau

    johnclouseau Peon

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Disallow: /pagename with extension*
    Allow: /pagename with extension

    Also check in GWT once.
     
    johnclouseau, Sep 27, 2010 IP