1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Tell me what should be the code of robots.txt

Discussion in 'Search Engine Optimization' started by bmdkumar, Dec 9, 2012.

0
  1. #1
    Tell me what should be the code of robots.txt, if we want except google, no other robots should crawl the our site.
    pls tell me. i am confused

    thanks
     
    bmdkumar, Dec 9, 2012 IP
  2. andersonsjohn

    andersonsjohn Banned

    Messages:
    653
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #2
    No idea about this can anyone pls suggest the answers...
     
    andersonsjohn, Dec 9, 2012 IP
  3. TM-aslad

    TM-aslad Greenhorn

    Messages:
    40
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    6
    #3
    We can exclude all robots accept Google with following code:

    User-agent: Google-bot Allow: / User-agent: * Disallow: /
     
    TM-aslad, Dec 10, 2012 IP
  4. aloksharma87

    aloksharma87 Greenhorn

    Messages:
    8
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #4
    if u want to disallow every thing, then

    User-agent: * Disallow: /
    if disallow any specific folder, then
    User-agent: *
    Disallow: /temp/
     
    aloksharma87, Dec 10, 2012 IP
  5. nptifitness

    nptifitness Peon

    Messages:
    239
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yes this is the right answer...

    Thanks for giving the best answers.
     
    nptifitness, Dec 10, 2012 IP
  6. bmdkumar

    bmdkumar Member

    Messages:
    27
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    31
    #6
    thank you so much for give me so much informative information.
     
    bmdkumar, Dec 14, 2012 IP