Social Buttons
  1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

robots.txt help

Discussion in 'robots.txt' started by vnpatra2, May 6, 2011.

0
  1. #1
    hello world !!
    i got a directory in my site called course foods (space b/w the words)
    now i cant modify or delete the space as it will take too long for the files associated to it to get updated.
    So how can i write robots.txt for that directory ?

    i mean

    Disallow:/course foods/
    or
    Disallow:/course%20foods/
    SEMrush
     
    vnpatra2, May 6, 2011 IP
    SEMrush
  2. weknowonlinemarketing

    weknowonlinemarketing Peon

    Messages:
    681
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #2
    If your directory's name if "course foods" than I think Disallow:/course food/ is okay.
     
    weknowonlinemarketing, May 10, 2011 IP
  3. egreenr2

    egreenr2 Peon

    Messages:
    19
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    I think %20 character will be better option to replace the white space ?
     
    egreenr2, May 12, 2011 IP
  4. egreenr2

    egreenr2 Peon

    Messages:
    19
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    you try with both the command you wrote.....i think white space may be approved
     
    egreenr2, May 12, 2011 IP
  5. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,684
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #5
    Disallow:/course foods/ would work fine. Crawlers can easily identify the space in between.
     
    manish.chauhan, May 18, 2011 IP