Would appreciate if someone can show us example of robots.txt that will prevent search engines like Google from crawling and indexing a page or folder. So that the page will not show up on search engine results. Thanks
Something like this: User-agent: * Disallow: /folder_name/ Disallow: /filename.php Code (markup): be very careful with previously mentioned example as that one may block EVERYTHING on your site, for ALL search engines: User-agent: * Disallow: / Code (markup): Cheers.