what is sitemap & robot.txt

Discussion in 'Search Engine Optimization' started by sahil rajpput, Mar 13, 2015.

?

what is sitemap & robot.txt

Poll closed Mar 20, 2015.

  1. seo

    1 vote(s)
    50.0%

  2. sitemap

    1 vote(s)
    50.0%

  3. robot.txt

    1 vote(s)
    50.0%
Multiple votes are allowed.
0
  1. #1
    i want to create my website sitemap please help me any ..

    1. what is sitemap
    2.what is robo.txt
     
    sahil rajpput, Mar 13, 2015 IP
  2. JoeLumbergh

    JoeLumbergh Member

    Messages:
    40
    Likes Received:
    5
    Best Answers:
    1
    Trophy Points:
    45
    #2
    sitemap is an XML (structured data) file that tells google what pages are on your website to help google index and structure your page right.
    I suggest you install YOAST SEO Plugin (or some other sitemap plugin) in case you use wordpress for your site. In google webmaster tools (you should use webmastertools!) you can submit your site map, and google will tell you if there were any errors. Its really easy.

    Robots.txt is a file that is on every webhost, you can use it to set access restrictions. For example you could ban some sites, or users (like crawlers from semalt, mejasticseo, ahrefs etc.) from accessing your site or specific pages of your site.
    Generally, you dont need to change robots.txt, if you want to restrict access to your website, you should read more about robots.txt. If you dont want to restrict anything, you can leave it as it is.

    hope that helps
     
    JoeLumbergh, Mar 13, 2015 IP
  3. sahil rajpput

    sahil rajpput Member

    Messages:
    65
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #3
    Thank you Mr. joel umbergh i will try ..
     
    sahil rajpput, Mar 13, 2015 IP
  4. Kushal Shah

    Kushal Shah Active Member

    Messages:
    123
    Likes Received:
    4
    Best Answers:
    0
    Trophy Points:
    55
    #4
    Are you with wordpress?
     
    Kushal Shah, Mar 13, 2015 IP
  5. sahil rajpput

    sahil rajpput Member

    Messages:
    65
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #5
    NO custom
     
    sahil rajpput, Mar 16, 2015 IP
  6. deepakrajput

    deepakrajput Member

    Messages:
    234
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    46
    #6
    We create Sitemap to tell about all website pages to search engine. While Robots is set of instruction for spiders.
     
    deepakrajput, Mar 16, 2015 IP
  7. AndresNeil

    AndresNeil Greenhorn

    Messages:
    21
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #7
    Sitemap is a list of pages that is access by the user. Google will index that page then the ranking result will come. Robots.txt is tag which is used inside the body which prevent the page for crawling or indexing.
     
    AndresNeil, Mar 19, 2015 IP
  8. sukritinfotech

    sukritinfotech Greenhorn

    Messages:
    43
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    16
    #8
    Sitemaps help ensure your site is fully indexed by feeding your content to search engines. XML sitemap is standard.
    Robots is set of instruction for spiders.
     
    sukritinfotech, Mar 19, 2015 IP
  9. cnjai20

    cnjai20 Well-Known Member

    Messages:
    179
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    103
    #9
    Can we add the same url in XML and as well as in Video XML sitemap to index ?
     
    cnjai20, Mar 20, 2015 IP
  10. trajecto123

    trajecto123 Greenhorn

    Messages:
    4
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #10
    HTML SITEMAP
    Basically There are two type of site map.
    html site map and xml site map.
    Basic difference is html sitemap is for users and xml sitemaps is for search engines.

    ROBOTS.TXT
    Robots.txt means content noindex and nofollow by Google.

    By:http://trajectoryeducation.com/courses/iit-jam-coaching/
     
    trajecto123, Mar 20, 2015 IP
  11. patco

    patco Well-Known Member

    Messages:
    2,035
    Likes Received:
    47
    Best Answers:
    17
    Trophy Points:
    100
    #11
    1. Something you need for better indexing. Check Google next time.
    2. It's robots.txt, not robo.txt or robot.txt

    I am really curious why don't you first write those words in Google or any other SE before starting new thread asking such questions...
     
    patco, Mar 20, 2015 IP
  12. arena leo

    arena leo Greenhorn

    Messages:
    16
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    21
    #12
    A Robot.txt is a text file in a simple format which gives information to the web robots or spiders or crawler about which part of your website they are and aren't allow to visit.
    A Sitemap is used to give robot a list of pages that it is welcome to visit.
    They are of two types:
    1. Xml format
    2. Html format
     
    arena leo, Mar 21, 2015 IP
  13. sahil rajpput

    sahil rajpput Member

    Messages:
    65
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    36
    #13
    How to view the sitemap of a website if there is no such option in that website ?
     
    sahil rajpput, Mar 24, 2015 IP