What is Robot

Discussion in 'Search Engine Optimization' started by ayushi infotech, Nov 25, 2010.

  1. Deecoup

    Deecoup Greenhorn

    Messages:
    43
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #21
    Robot is the spider of Google.
     
    Deecoup, Dec 16, 2010 IP
  2. jassicacute

    jassicacute Peon

    Messages:
    114
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #22
    ya u r right.. there is no term robot its robot .txt file which tell spider wht to crawl and wht not..........
     
    jassicacute, Dec 16, 2010 IP
  3. Cyras John

    Cyras John Peon

    Messages:
    46
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #23
    Robots.txt are spiders collecting the data from websites...
     
    Cyras John, Dec 16, 2010 IP
  4. p4pratikbehera

    p4pratikbehera Active Member

    Messages:
    135
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    51
    #24
    Absolutely
     
    p4pratikbehera, Dec 16, 2010 IP
  5. joybrown

    joybrown Peon

    Messages:
    183
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #25
    Robots.txt is a text (not html) file.Robot is the spider who come to all website to collect the data for searches.You can get detailed explanation of robot.txt at http://www.robotstxt.org/robotstxt.html.
     
    joybrown, Dec 16, 2010 IP
  6. jassicacute

    jassicacute Peon

    Messages:
    114
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #26
    the actual term is robot.txt file which tells the spider which page to be crawled and which not????????
     
    jassicacute, Dec 17, 2010 IP