robots.txt help

Discussion in 'robots.txt' started by vnpatra2, May 6, 2011.

  1. #1
    hello world !!
    i got a directory in my site called course foods (space b/w the words)
    now i cant modify or delete the space as it will take too long for the files associated to it to get updated.
    So how can i write robots.txt for that directory ?

    i mean

    Disallow:/course foods/
    or
    Disallow:/course%20foods/
     
    vnpatra2, May 6, 2011 IP
  2. weknowonlinemarketing

    weknowonlinemarketing Peon

    Messages:
    681
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    If your directory's name if "course foods" than I think Disallow:/course food/ is okay.
     
    weknowonlinemarketing, May 10, 2011 IP
  3. egreenr2

    egreenr2 Peon

    Messages:
    19
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I think %20 character will be better option to replace the white space ?
     
    egreenr2, May 12, 2011 IP
  4. egreenr2

    egreenr2 Peon

    Messages:
    19
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    you try with both the command you wrote.....i think white space may be approved
     
    egreenr2, May 12, 2011 IP
  5. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #5
    Disallow:/course foods/ would work fine. Crawlers can easily identify the space in between.
     
    manish.chauhan, May 18, 2011 IP