1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Is there a robots.txt interpreter for those of us who are newbies?

Discussion in 'robots.txt' started by Melissa2007, Apr 29, 2019.

  1. #1
    Here's my robots.txt file. Is it at least benign, and not harming my site?
    SEMrush
    User-agent: *
    Disallow: /test/
    Disallow: /JPG/
    Disallow: /PHOT/
    Disallow: /VID/

    Those disallows, are MEANT to keep search engines from indexing those subdirectories in my domain, so they don't index spurious side stuff that I'm just storing in them.

    Is it correct syntax?
     
    Melissa2007, Apr 29, 2019 IP
    SEMrush
  2. qwikad.com

    qwikad.com Illustrious Member Affiliate Manager

    Messages:
    6,410
    Likes Received:
    1,369
    Best Answers:
    24
    Trophy Points:
    400
    #2
    Looks good to me.
     
    qwikad.com, Apr 30, 2019 IP
  3. Melissa2007

    Melissa2007 Active Member

    Messages:
    21
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    86
    #3
    Thanks!
     
    Melissa2007, Apr 30, 2019 IP