Tell me what should be the code of robots.txt

Discussion in 'Search Engine Optimization' started by bmdkumar, Dec 9, 2012.

0
  1. #1
    Tell me what should be the code of robots.txt, if we want except google, no other robots should crawl the our site.
    pls tell me. i am confused

    thanks
     
    bmdkumar, Dec 9, 2012 IP
  2. andersonsjohn

    andersonsjohn Banned

    Messages:
    653
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #2
    No idea about this can anyone pls suggest the answers...
     
    andersonsjohn, Dec 9, 2012 IP
  3. TM-aslad

    TM-aslad Greenhorn

    Messages:
    40
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    6
    #3
    We can exclude all robots accept Google with following code:

    User-agent: Google-bot Allow: / User-agent: * Disallow: /
     
    TM-aslad, Dec 10, 2012 IP
  4. aloksharma87

    aloksharma87 Greenhorn

    Messages:
    8
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #4
    if u want to disallow every thing, then

    User-agent: * Disallow: /
    if disallow any specific folder, then
    User-agent: *
    Disallow: /temp/
     
    aloksharma87, Dec 10, 2012 IP
  5. nptifitness

    nptifitness Peon

    Messages:
    239
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yes this is the right answer...

    Thanks for giving the best answers.
     
    nptifitness, Dec 10, 2012 IP
  6. bmdkumar

    bmdkumar Member

    Messages:
    27
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    31
    #6
    thank you so much for give me so much informative information.
     
    bmdkumar, Dec 14, 2012 IP