I uploaded my robots.txt file into my server and sitemap.xml also. When I check one of my sites through google robots.txt checker i receive result which is visible on my attached picture. Is this good result or I need to do some changes? Please help me with this. I am a newbie on this mater.
What is the URL to the robots.txt file? It appears to be setup correctly but you are blocking a directory and any files and sub-directories that reside in it.
This is my robots.txt file: sitemap: http://www.scoopcelebrity.com/sitemap.xml User-agent: * Disallow: /cgi-bin/ Disallow: /go/ Disallow: /wp-admin/ Disallow: /wp-includes/ Disallow: /author/ Disallow: /page/ Disallow: /category/ Disallow: /wp-images/ Disallow: /images/ Disallow: /backup/ Disallow: /banners/ Disallow: /archives/ Disallow: /trackback/ Disallow: /feed/ User-agent: Googlebot-Image Allow: /wp-content/uploads/ User-agent: Mediapartners-Google Allow: / User-agent: duggmirror Disallow: /