noob here trying to learn about sitemaps and robots

Discussion in 'Google Sitemaps' started by shodka8, Jun 6, 2007.

  1. #1
    Can someone explain what a sitemap file and robot.txt is, does it help to get you listed on search egnines?

    Could i get more traffic to richassholes.com or xtc4u.net by eddint those files?
     
    shodka8, Jun 6, 2007 IP
  2. cormac

    cormac Peon

    Messages:
    3,662
    Likes Received:
    222
    Best Answers:
    0
    Trophy Points:
    0
    #2
    The sitemap is an accessibility feature for your visitors and robots.

    For the visitors it provides a list of your inner pages split into categories, making it easier in finding something specific.

    Robots can have problems crawling pages deep in a site so using a sitemap allows them to reach those pages.

    Run a search on Google for sitemap and look through the sitemaps that come up in the results. Gives you an idea on how it should be structured.
     
    cormac, Jun 7, 2007 IP
  3. coolguy27

    coolguy27 Banned

    Messages:
    485
    Likes Received:
    11
    Best Answers:
    0
    Trophy Points:
    0
    #3
    Robots.txt is a file which well behaved spiders read to determine which parts of a website they may visit.

    A site map (or sitemap) is a web page that lists the pages on a web site, typically organized in hierarchical fashion. This helps visitors and search engine bots find pages on the site.

    Using sitemaps has many benefits, not only easier navigation and better
    visibility by search engines. Sitemaps offer the opportunity to inform search engines immediately about any changes on your site. Of course, you cannot expect that search engines will rush right away to index your changed pages but certainly the changes will be indexed faster, compared to when you don't have a sitemap....:D
     
    coolguy27, Jun 8, 2007 IP
  4. shodka8

    shodka8 Active Member

    Messages:
    166
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    53
    #4
    ahh ic good advice, so how can i got about creating a sitemap
     
    shodka8, Jun 8, 2007 IP
  5. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #5
    Just to add, you can now also have your robots.txt point to xml sitemap. All search engines can read robots.txt and those that support the xml sitemaps protocol can discover your xml sitemaps through robots.txt
     
    websitetools, Jun 11, 2007 IP