Hello, Does capitalization matter in robots meta tag? Should I use: <meta name="GOOGLEBOT" content="index,follow">, <meta name="Googlebot" content="index,follow">, <meta name="googlebot" content="index,follow"> or any? I know that in robots.txt I should use Googlebot, but how about meta tags?
There is reallly no need to allow the robots either in the meta tags or the robots.txt The bots will automatically be allowed without the use of such meta tags. The only time you need to use the robots.txt for this is when you want to dissallow a certain bot, directory, or url
Most bots do not care about robots.txt or meta tags anyways, but if you use "robots" google will know what you mean. <meta name="robots" content="INDEX, FOLLOW">
i allways prefer robots.txt file to prevent pages that idont want . it's easier .i suggest you to use it