Help About Robots.txt

Discussion in 'Search Engine Optimization' started by Allen George, Nov 6, 2009.

  1. #1
    How can i stop to search engine to crawl my site.

    How to use robots.txt
     
    Allen George, Nov 6, 2009 IP
  2. dipali

    dipali Peon

    Messages:
    450
    Likes Received:
    9
    Best Answers:
    0
    Trophy Points:
    0
    #2
    use below text to stop from crawling of your website. just put below code in text file and give name as robots.txt and upload it on server thats it. google webmaster tool is also provides creation of robots.txt

    User-agent: *
    Disallow: /
     
    dipali, Nov 6, 2009 IP