1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

What is a Robot???

Discussion in 'robots.txt' started by eathosting.com, Dec 1, 2007.

  1. #1
    I am trying to figure out what exactly a robot is and how it would benefit my site???
     
    eathosting.com, Dec 1, 2007 IP
  2. ajsa52

    ajsa52 Well-Known Member

    Messages:
    3,426
    Likes Received:
    125
    Best Answers:
    0
    Trophy Points:
    160
    #2
    Web site owners use the /robots.txt file to give instructions about their site to web robots.
    Web Robots (also known as Web Wanderers, Crawlers, or Spiders), are programs that traverse the Web automatically. Search engines such as Google use them to index the web content, spammer use them to scan for email addresses, and they have many other uses.

    Look at these page for additional info:
    http://www.robotstxt.org/
    http://en.wikipedia.org/wiki/Robots.txt
     
    ajsa52, Dec 2, 2007 IP
    timsdd and MarRome like this.
  3. jmorti

    jmorti Member

    Messages:
    28
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #3
    Do some searches for explanations. That always seems to be the best and fastest way to learn new things on the internet for me.
     
    jmorti, Dec 3, 2007 IP
  4. anantk

    anantk Active Member

    Messages:
    121
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    53
    #4
    hey, what's google for ?
     
    anantk, Dec 4, 2007 IP
  5. SSANZ

    SSANZ Peon

    Messages:
    861
    Likes Received:
    10
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Would that be a serious question?
     
    SSANZ, Dec 9, 2007 IP
  6. mg_

    mg_ Peon

    Messages:
    438
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #6
    on the robotstxt.org site you will find all the answers
     
    mg_, Dec 9, 2007 IP
  7. eathosting.com

    eathosting.com Peon

    Messages:
    82
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    ok thanks guys that helps alot.
     
    eathosting.com, Dec 12, 2007 IP
  8. gab1982

    gab1982 Peon

    Messages:
    30
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    0
    #8
    I was going to ask the same thing, isn't there some benefits and disadvantages in regards to SEO and robots?
     
    gab1982, Dec 20, 2007 IP