I have been checking a lot of blogs recently and seen the meta tag value for Robots like this: <meta name="Robots" content="All" /> Code (markup): I'm wondering how does this affect crawlers? Is this the same as placing every link on the page as DoFollow?
It is an outdated meta tags. It was used to tell Googlebots to crawl on contents but not useful for now. Many of website has been crawled without put this tag in use. You can read further on this discussion - <meta name="robots" content="ALL">
Oh okay yeah that link was informative. Then what is the meta tag for setting all links on the page to DoFollow? Are they set to DoFollow by default without any meta tag settings?
Naw, it means nothing. Nothing at all - it's a nonsense. Robots are made to follow, index and archive pages and the ONLY meaningful clauses in the meta tags section are those that restrict them.
When you do not add any robot file to your web server, that means all types of bots and search engines crawlers are allowed to crawl all sections and folders of your website. This is recommended in most cases because naturally a lot of webmasters like to find most of their pages indexed on the net.
it means u allow all the search engine to crawl your site, but this is old one no one use this code in meta tag.