Hello guys, I need some help here... I have a wordpress site with a robots.txt file that has the following content: User-agent: * Sitemap: https://domain.com/sitemap.xml Disallow: /go/ Disallow: /temp/ Disallow: /reviews/* Disallow: /out/* Code (markup): And I have a blog with this URL: https://domain.com/blog Code (markup): And all articles of the blog uses this URL: https://domain.com/news/title-here Code (markup): What I need is to disallow only the url: https://domain.com/news/ Code (markup): I have tried this: Disallow: /news/ Code (markup): and this: Disallow: /news Code (markup): But disallows all my blog articles... Is there anything I can do to disallow only the /news/ and not the /news/* ? Unfortunately I think is not possible in wordpress /blog for root and /blog/* for articles :/ Help... Thanks!!
This will disallow the link: Disallow: /news /news/ means the whole folder, while keep in mind you cannot check instantly, you will need to wait untill the google index again.
Hello, Thank you for helping me, but I already tried that and didn't worked. Please take a look to this screenshot: Any more ideas?