Is it necessary to specify sitemap.xml in robots.txt file

Discussion in 'robots.txt' started by cathandrew, Feb 25, 2014.

0
  1. #1
    I'm in dilemma about how to add this sitemap.xml url in robots.txt file. Is it necessary?
     

    Attached Files:

    Solved! View solution.
    cathandrew, Feb 25, 2014 IP
  2. #2
    Yes, it is necessary because it helps bot to understand which part to crawl and what is blocked.
     
    Ehteshamshaikh, Feb 27, 2014 IP