I plan on creating a personal site. I do not want the site the site one any search engine. how do i accomplish this ... or is this impossible thanks
it will disallow all search engine spiders who are following robots.txt file (most legit search engines do)
You can also put this in the head of your page(s): <meta name="robots" content="noindex, nofollow" />
Best to use the noindex meta tag on all your pages. Google may not obey the robots.txt file and include your pages (without descriptions) in their search engine.
Oh yea.. that's a great approach! NOT. Unfortunately, this solution won't keep Yahoo!, Bing, and others from indexing the site. The best ways to prevent this from happening is: 1) Use the robots.txt that a previous poster suggested: (in which there can be cases where your URL still shows up in the SERPs) 2) Add <meta name="robots" content="noindex"> elements to ALL pages on your site (pain in arse since have to remember to do so every time you add a page) or 3) Password protect your site (either by adding a login screen or setting a password at the folder level on your server) and ONLY give the password to those you want to have access. Crawlers are NOT going to be able to login. The first two approaches will likely be ignored by any "bad bots" and can still result in your pages getting indexed in by some obsure, bad crawlers. The last approach will insure ALL crawlers (good AND bad) are unable to crawl and index your pages.
also there are many people who try to get traffic from search engines and do not. The above is good advice but also if you do nothing the chances of your site getting into all the search engines is very low