Robots.txt - User-agent: * Disallow:

Discussion in 'Search Engine Optimization' started by Globaleyeglasses, Aug 22, 2010.

0
  1. #1
    Hi,

    Please explain this one

    User-agent: *
    Disallow:


    Thanks
     
    Globaleyeglasses, Aug 22, 2010 IP
  2. Alan Smith

    Alan Smith Active Member

    Messages:
    1,263
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    78
    #2
    The "User-agent: *" means this section applies to all robots. The "Disallow:" tells the robot that it should not visit any pages on the site.
     
    Alan Smith, Sep 7, 2010 IP
  3. MervinKoops

    MervinKoops Member

    Messages:
    405
    Likes Received:
    6
    Best Answers:
    0
    Trophy Points:
    45
    #3
    Actually, since the disallow: is blank it means that it isn't disabling anything - Bots can access all pages of the site.
     
    MervinKoops, Sep 7, 2010 IP
  4. sydzapp

    sydzapp Well-Known Member

    Messages:
    703
    Likes Received:
    12
    Best Answers:
    0
    Trophy Points:
    100
    #4
    In one sentence. Your Robots.txt file urges all the search engine bots to skip/unindex/ignore no pages.
     
    sydzapp, Sep 7, 2010 IP
  5. Globaleyeglasses

    Globaleyeglasses Peon

    Messages:
    132
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Thank to All... I was also supposing the same but Just confirming.

    Thanks
     
    Globaleyeglasses, Sep 7, 2010 IP