can We keep Mutiple Sitemap xmls in Robots.txt??

Discussion in 'Search Engine Optimization' started by rakseo, Jul 20, 2009.

0
  1. #1
    Hi,

    I had More Than 1 Lakh Urls, Created Multiple Sitemap Xml, first Sitemap xml is working Well, 2nd once Not working Properly, can I Keep sitemap xmls in Robots.txt? Please Help me..


    thanks regards
    Rakseo
     
    rakseo, Jul 20, 2009 IP
  2. bobchrist

    bobchrist Active Member

    Messages:
    4,102
    Likes Received:
    95
    Best Answers:
    0
    Trophy Points:
    88
    #2
    Probably you will need a structured sitemap.
     
    bobchrist, Jul 20, 2009 IP
  3. geoiss2004

    geoiss2004 Guest

    Messages:
    1,454
    Likes Received:
    32
    Best Answers:
    0
    Trophy Points:
    0
    #3
    XML sitemaps have nothing to do with Robots.txt.

    And yes, you can have multiple sitemaps. Administrate them in Google Webmaster Tools.
     
    geoiss2004, Jul 20, 2009 IP
  4. webrecsol

    webrecsol Peon

    Messages:
    448
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    hello first a fell if you want make a big sitemap.xml then you will create self and second robots.txt file not use anywhere in sitemap.xml.. but be careful create..
     
    webrecsol, Jul 20, 2009 IP
  5. Canonical

    Canonical Well-Known Member

    Messages:
    2,223
    Likes Received:
    141
    Best Answers:
    0
    Trophy Points:
    110
    #5
    XML sitemaps DO have something to do w/ robots.txt. Unless you want to manually admininster them w/ every search engine on the planet, it's good practice to include a sitemap: directive in your robots.txt pointing to the sitemap.xml (or sitemap index file if you have multiple sitemap.xml files) on your server. This way ALL search engines know where to find your map without having to manually administer it through interfaces like Google WMT at each and every search engine.

    And to answer the OPs question...

    1) create a sitemap index file
    2) use the sitemap: directive in your robots.txt to point to your sitemap index file and the engines will follow the sitemap index file to discover your remaining sitemap.xmls
     
    Canonical, Jul 20, 2009 IP
  6. Rituja

    Rituja Peon

    Messages:
    539
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #6
    I think creat more new webmaster A/C's then creat Xml site map and submit it.
     
    Rituja, Jul 20, 2009 IP
  7. Canonical

    Canonical Well-Known Member

    Messages:
    2,223
    Likes Received:
    141
    Best Answers:
    0
    Trophy Points:
    110
    #7
    The only reason you should need multiple sitemap.xml files is if you have more than 50,000 URLs that you want to submit. If so then create an index sitemap file that lists all of the individual sitemap files. No need for multiple webmaster accounts.

    If you don't want to deal w/ an index sitemap xml then you can include multple sitemap: directives in your robots.txt pointing to the individual sitemap.xml files.
     
    Canonical, Jul 20, 2009 IP