Small Problem -- New To Sitemaps

Discussion in 'Google Sitemaps' started by arvind_srivastava, Mar 6, 2009.

  1. #1
    Hi DPers,

    I have some pages on my website that I dont want google to index.

    I shouldn't mention these urls in the sitemap at all or should I mention these urls in the sitemap and block access to these urls via the robots.txt file?

    What would be a better solution for my site?



    Thanks
    Al
     
    arvind_srivastava, Mar 6, 2009 IP
  2. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #2
    Just block these urls in Robots.txt file and don't add those urls in your sitemap..:)
     
    manish.chauhan, Mar 7, 2009 IP
  3. zitoitala

    zitoitala Peon

    Messages:
    106
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #3
    would it not be more efficient to add a few instructions via the .htaccess file?
     
    zitoitala, Mar 8, 2009 IP
  4. manish.chauhan

    manish.chauhan Well-Known Member

    Messages:
    1,682
    Likes Received:
    35
    Best Answers:
    0
    Trophy Points:
    110
    #4
    Could you please let me know how??
     
    manish.chauhan, Mar 8, 2009 IP
  5. alana13

    alana13 Well-Known Member

    Messages:
    331
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    105
    #5
    use robots.txt to block these pages while you can add these pages at your site map.
     
    alana13, Mar 13, 2009 IP
  6. arvind_srivastava

    arvind_srivastava Well-Known Member

    Messages:
    1,229
    Likes Received:
    153
    Best Answers:
    0
    Trophy Points:
    130
    #6
    Won't that be hiding information from google? Isn't it a better idea to add the pages in the sitemapand block it via robot.txt altogether? :cool:


    Al
     
    arvind_srivastava, Mar 13, 2009 IP
  7. shniager

    shniager Peon

    Messages:
    21
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #7
    Don't mention them in your sitemap. But even if you mention, you can restrict them in robots.txt. It has higher priority. You can restrict a single page Disallow: /links.html or a directory Disallow: /admin/
     
    shniager, Mar 14, 2009 IP