Robots.txt content

Discussion in 'robots.txt' started by Soraya Marques, May 1, 2010.

0
  1. #1
    What i have to submit to robots.txt to accept all connections to my blog?


    Kiss ;)
     
    Soraya Marques, May 1, 2010 IP
  2. acidartworks

    acidartworks Member

    Messages:
    111
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    26
    #2
    i think it was
    allow robots
     
    acidartworks, May 1, 2010 IP
  3. Soraya Marques

    Soraya Marques Peon

    Messages:
    64
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Hi have this way:
    User-Agent: *
Allow: /
    Code (markup):
    After reading a wiki about robots i think is this way to allow all connections.

    Kiss ;)
     
    Soraya Marques, May 2, 2010 IP
  4. iloveindia

    iloveindia Peon

    Messages:
    17
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #4
    By default, all links and images will be crawled and indexed automatically. There is no need to type in Allow command. And you can have your xml sitemap shown to all search engines through robots.txt.

    Just type the following in robots.txt

    User-Agent: *
    Disallow:

    Sitemap: www dot your-domain dot com/sitemap.xml
     
    iloveindia, May 3, 2010 IP