1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

How does the crawler track sitemap?

Discussion in 'Google Sitemaps' started by makingmove, Oct 27, 2015.

  1. #1
    How does the crawler track sitemap for rankings on google search engine?
    SEMrush
     
    makingmove, Oct 27, 2015 IP
    SEMrush
  2. sem-profiteer

    sem-profiteer Active Member

    Messages:
    257
    Likes Received:
    2
    Best Answers:
    0
    Trophy Points:
    75
    #2
    I'm not entirely sure what your asking, but I think this is the answer:
    Place this in your robots.txt file:
    Sitemap: http://www.example.com/sitemap.xml
     
    sem-profiteer, Oct 28, 2015 IP
  3. makingmove

    makingmove Greenhorn

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #3
    I wanted to ask the usefulness of inclusion of sitemap in the website. It adds up another page and therefore expenditure.
    Does the crawler place equal importance to the sitemaps as to the other pages?
     
    makingmove, Oct 29, 2015 IP
  4. rsrikanth05

    rsrikanth05 Well-Known Member

    Messages:
    1,364
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    140
    #4
    The sitemap is literally a map for the crawler. The crawler picks up your sitemap, and finds all other indexable pages on the domain.
    I don't understand what you mean by another page therefore expenditure. Depending on what CMS you use Sitemaps are super easy to generate. If you don't have a CMS, get a free Attracta plan, that'll generate a nice sitemap for you that is hosted on their servers instead.
     
    rsrikanth05, Oct 29, 2015 IP
  5. dcristo

    dcristo Illustrious Member

    Messages:
    19,676
    Likes Received:
    1,167
    Best Answers:
    7
    Trophy Points:
    470
    Articles:
    7
    #5
    Submit the XML sitemap in Google Webmaster Tools. You don't need to link to it on your website. Is that what you're asking?
     
    dcristo, Oct 29, 2015 IP
  6. rsrikanth05

    rsrikanth05 Well-Known Member

    Messages:
    1,364
    Likes Received:
    26
    Best Answers:
    0
    Trophy Points:
    140
    #6
    You don't need to have a link to an xml sitemap anywhere. It makes no sense. Having it in the Robots file tells crawlers where to look for it since the robots file is the first thing they look at when crawling a domain.
     
    rsrikanth05, Oct 29, 2015 IP
  7. makingmove

    makingmove Greenhorn

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #7
    Thank you.. will give it a shot
     
    makingmove, Oct 31, 2015 IP
  8. makingmove

    makingmove Greenhorn

    Messages:
    5
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #8
    Ok.. great. thank you
     
    makingmove, Oct 31, 2015 IP