1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Robots.txt not working for wordpress.

Discussion in 'robots.txt' started by fadetoblack22, Jul 8, 2010.

  1. #1
    I have this robots.txt file in my site root directory, but it's not working properly.

    User-agent: *
    Disallow: /wp/wp-admin/
    Disallow: /wp/wp-content/
    Disallow: /wp/wp-includes/
    
    Code (markup):
    I put a request in webmaster tools to remove the wordpress /wp-content/plugins/ folder because it has been indexed, but I got this message:

    "our request has been denied because the webmaster of the site hasn't applied the appropriate robots.txt file or meta tags to block us from indexing or archiving this page"

    This means that the robots.txt isn't working. Can someone help me out with it please.
     
    fadetoblack22, Jul 8, 2010 IP
  2. xaer8

    xaer8 Active Member

    Messages:
    73
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    63
    #2
    I believe that is not the correct path. maybe u should use something like this:

    User-agent: *
    Disallow: /cgi-bin
    Disallow: /wp-content/
    Disallow: /wp-includes/
    Disallow: /trackback/
    Disallow: /wp-admin/
    Disallow: /wget/
    Disallow: /httpd/
    Disallow: /i/
    Disallow: /f/
    Disallow: /t/
    Disallow: /c/
    Disallow: /j/
    Disallow: /*?
    Disallow: /*.js$
    Disallow: /*.inc$
    Disallow: /*.css$
    Disallow: */trackback/
    Disallow: /pages/

    Unless your website is in subdomain of wp.

    Not sure, just my thoughts.
     
    xaer8, Jul 8, 2010 IP
    fadetoblack22 and petr_ind like this.
  3. petr_ind

    petr_ind Notable Member

    Messages:
    1,680
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    210
    Articles:
    6
    #3
    Wow, cool.
    I think it's right, because the path is correct.
    thank you, i will implement it
     
    petr_ind, Jul 8, 2010 IP
  4. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #4
    what is your blog url?
     
    manish.chauhan, Jul 8, 2010 IP
  5. fadetoblack22

    fadetoblack22 Well-Known Member

    Messages:
    2,399
    Likes Received:
    62
    Best Answers:
    0
    Trophy Points:
    160
    #5
    Yes, my site is a subfolder and the robots.txt is in the root.
     
    fadetoblack22, Jul 9, 2010 IP
  6. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #6
    Hope your issue has been resolved now :)
     
    manish.chauhan, Jul 9, 2010 IP
    fadetoblack22 likes this.
  7. fadetoblack22

    fadetoblack22 Well-Known Member

    Messages:
    2,399
    Likes Received:
    62
    Best Answers:
    0
    Trophy Points:
    160
    #7
    I will find out tomorrow when google sees my request to remove my plugins folder from the index.
     
    fadetoblack22, Jul 9, 2010 IP