How do I use a Robots file or do you have an example of one?

Discussion in 'Search Engine Optimization' started by kakasab, May 10, 2009.

0
  1. #1
    Im running a website with blog, and i dont need to list other directories in google search, can anyone help me to set robots.txt
     
    kakasab, May 10, 2009 IP
  2. chirag432

    chirag432 Peon

    Messages:
    76
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #2
    hi friend
    i always use robots.txt file in web site but not any time in blog .
     
    chirag432, May 11, 2009 IP
  3. faiz.khan

    faiz.khan Active Member

    Messages:
    46
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    76
    #3
    Could you explain your question bit more so that guys like us can help you in better way.


    Thanks
    Faiz
     
    faiz.khan, May 11, 2009 IP
  4. stevejeff

    stevejeff Peon

    Messages:
    187
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #4
    Robots.txt is a text file that is used to control spiders that visit your website. This file grants access to certain folders, file types, and specific files depending on the robot accessing the site.

    The "/robots.txt" file is a text file, with one or more records. Usually contains a single record looking like this:
    for more info you can visit: robotstxt.org
     
    stevejeff, May 11, 2009 IP
  5. advansys

    advansys Guest

    Messages:
    50
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    you can get more info on robots in google webmastertools.
     
    advansys, May 11, 2009 IP