I can't figure out how to do this. I want to use a robots.txt file to let the search engines index ONLY the front page, and no other pages. I built a directory for my client, a geographic directory of self storage businesses. There are like 8000 categories, and no content yet. I want to get the front page indexed without indexing 7999 empty pages.
To avoid index you need to add this meta tag <meta name="googlebot" content="noindex, nofollow, noarchive" /> Please understand you need to add this tag in those pages, which you don't want to index