1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Autodiscovery of Sitemaps Using robots.txt

Discussion in 'robots.txt' started by vishwa, Apr 19, 2007.

0
  1. #1
    Major search engines like Google, Yahoo, MSN and Ask.com will now check your robots.txt file for a link to a sitemaps file, then get the file from that location. This is a big plus because all the major search engines regularly check robots.txt files as part of their ordinary crawling.

    To add the location, just put a line like this anywhere in your robots.txt file:

    Sitemap: LOCATION-OF-SITEMAPS-FILE
    Replace the LOCATION-OF-SITEMAPS-FILE with the actual location. For example, if www.jumphigherglobal.com has a sitemap file called sitemap.xml in top level, the reference would be like this:

    Sitemap: http://www.jumphigherglobal.com/sitemap.xml

    Have more than one sitemaps file? Ideally, you'd create a special "sitemaps index" file that links to all of them, then put a link to the sitemaps index file in your robots.txt file. If that sounds like too much work, you can have more than one sitemaps URL listed in the robots.txt file.
     
    vishwa, Apr 19, 2007 IP
  2. trichnosis

    trichnosis Prominent Member

    Messages:
    13,785
    Likes Received:
    333
    Best Answers:
    0
    Trophy Points:
    300
    #2
    trichnosis, May 12, 2007 IP
  3. kirby009

    kirby009 Peon

    Messages:
    608
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    0
    #3
    how long have they been doing this.?
     
    kirby009, Jun 12, 2007 IP
  4. danieloffice

    danieloffice Peon

    Messages:
    472
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #4
    So, I do not need to submit my sitemap file to Google, and just use the robot.txt method??????

    please comment
    thanks
     
    danieloffice, Jul 9, 2007 IP
  5. vishwa

    vishwa Peon

    Messages:
    60
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #5
    Yeah absolutely, there is no need to submit your sitemap file to Google now. Google will automatically discover it using ur robots.txt
     
    vishwa, Jul 12, 2007 IP
  6. bitsy

    bitsy Active Member

    Messages:
    203
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    60
    #6
    I get so confused with site maps.
     
    bitsy, Jul 12, 2007 IP
  7. Madmurphy

    Madmurphy Active Member

    Messages:
    341
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    53
    #7
    This is new to me so I will give it a try.
     
    Madmurphy, Jul 16, 2007 IP
  8. danieloffice

    danieloffice Peon

    Messages:
    472
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #8
    how to check if Google really reading my sitemap through robots.txt?
     
    danieloffice, Jul 16, 2007 IP