Help regarding Robot.txt

Discussion in 'robots.txt' started by sam2220, Mar 19, 2013.

0
  1. #1
    Could we use site map URL in robot.txt file as given below ?
    Is it beneficial or not ?


    User-Agent: *
    Disallow:
    sitemap: www[.]abc[.]com/sitemap.xml
     
    sam2220, Mar 19, 2013 IP
  2. humtuma

    humtuma Notable Member

    Messages:
    1,225
    Likes Received:
    24
    Best Answers:
    3
    Trophy Points:
    250
    #2
    Yes,you can use sitemap in robots.txt It is good.
     
    humtuma, Mar 20, 2013 IP
  3. sam2220

    sam2220 Greenhorn

    Messages:
    9
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    13
    #3
    Thanks for your reply..
     
    sam2220, Mar 21, 2013 IP
  4. topcoder

    topcoder Well-Known Member

    Messages:
    125
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    138
    #4
    You can list out multiple sitemaps as well, I believe each sitemap has a limit of 50,000 entries.
     
    topcoder, May 14, 2013 IP