If i don't want to crawl any directory from my home page.How can i do this?? i think any code i have to write in my home page. What is the code???
you can add this meta tag to your homepage html file, place on the header section <meta name="robot" content="noindex,follow" /> or add a robots.txt file, containing # Google Bot User-agent: * Disallow: /