http://www.techfreakdevelopers.com/WebsitesPortfolio.html this my portfolio webpage. how can i disallow other link in my website.?? plz suggest me any trick to disallow another link on my site...
you need to create robots.txt file in your root folder. create the file and post below code into it. User-agent: * Allow: / Disallow: here you need to add your disallow url
He's right. You should create a robots.txt file. However, you should put User-Agent: Googlebot Disallow: /folder2/ for disallowing a folder OR User-Agent: Googlebot Disallow: /private_file.html to block a page or User-Agent: Googlebot Disallow: / to block the entire site. Save it as robots.txt and put it on your root directory in your cpanel. Hope that helps.
thanks dude for sharing about webmaster tool information. Really i am searching for something like that...
Use "Create robot.txt" in Google webmaster account It have all options for u Or you can use .htaccess
Create robot.txt file and add it your root directory to disallow Google from crawling that particular web page.
You have to write a small code on robot.txt file and upload that file to your root folder. The code is User-agent: google Bot Disallow: http://www.techfreakdevelopers.com/WebsitesPortfolio.html But if you want to disallow all bots to crawl then the code will be User-agent: * Disallow: http://www.techfreakdevelopers.com/WebsitesPortfolio.html
Create robots.txt and include User-agent: google Bot Disallow: page url or folder and then upload this file at root level.