1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Advantages of robots.txt

Discussion in 'robots.txt' started by HomeRun, Feb 24, 2008.

0
Page 2 of 2
  1. initzero

    initzero Active Member

    Messages:
    86
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    70
    #21
    hi all, only google use the robot.txt ?
     
    initzero, Oct 30, 2012 IP
  2. Deepak_Kotian

    Deepak_Kotian Member

    Messages:
    164
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #22
    Good facts about robot.txt file. I want to know more about robot file. where will i get to learn the codes..?
     
    Deepak_Kotian, Nov 1, 2012 IP
  3. selectaupairs

    selectaupairs Greenhorn

    Messages:
    59
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    8
    #23
    Robot.txt is the very beautiful concept .

    Advantages of robot.txt is using this we Prevent to consider page in our web site by google

    LIke admin page.

    If admin page consider by google and index in that .Hacker easily find our control panel and hack our site .

    This is the main advantage of Robot.txt.
     
    selectaupairs, Nov 6, 2012 IP
  4. JennaIshley

    JennaIshley Peon

    Messages:
    22
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    1
    #24
    In simple words robots.txt file is used to tell search engines ( or bots, or robots) what they can access on the website and limiting the access to our private data.
     
    JennaIshley, Nov 6, 2012 IP
  5. cjlopez

    cjlopez Member

    Messages:
    51
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    43
    #25
    Exactly, you don't want certain parts of your website to be indexed into search engines for the whole world to see so you restrict them by using robots.txt
     
    cjlopez, Dec 3, 2012 IP
  6. johnaustin9

    johnaustin9 Member

    Messages:
    104
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #26
    Private and personal part of site can be restricated so that google crawler cannot access those pages of the site.
     
    johnaustin9, Dec 5, 2012 IP
  7. agitetech

    agitetech Peon

    Messages:
    122
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #27
    Robots.txt file controls the crawlers to view contents of your website...so that if you want to hide some of the contents from and don't want it to be indexed it is done by the use of robots.txt file...
     
    agitetech, Dec 27, 2012 IP
Page 2 of 2