what does this robot.txt commands means.

Discussion in 'Search Engine Optimization' started by nitinhindustani, Feb 18, 2009.

0
  1. #1
    User-agent: Mediapartners-Google
    Disallow:

    User-agent: *
    Disallow: /search

    do i need to change it.
     
    nitinhindustani, Feb 18, 2009 IP
  2. ekajanabee4u

    ekajanabee4u Peon

    Messages:
    146
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    User agent: * means for all search engine.
    disallow: /search means not index all pages which are contain in search directory

    for more detail view google guideline
     
    ekajanabee4u, Feb 18, 2009 IP
  3. contentboss

    contentboss Peon

    Messages:
    3,241
    Likes Received:
    54
    Best Answers:
    0
    Trophy Points:
    0
    #3
    that's right. No bots are allowed in the /search directory, which includes all files and any sub folders too. The first 2 lines are pointless.
     
    contentboss, Feb 18, 2009 IP
  4. jitendraag

    jitendraag Notable Member

    Messages:
    3,982
    Likes Received:
    324
    Best Answers:
    1
    Trophy Points:
    270
    #4
    The first two lines are redundant. The last two lines will tell bots not to index pages starting with /search.
     
    jitendraag, Feb 18, 2009 IP
  5. megastore

    megastore Banned

    Messages:
    87
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    No bots will have the courage to enter your pages that start with /search I bet
     
    megastore, Feb 18, 2009 IP