Hi Experts I made a google xml sitemap and uploaded it.. But when client saw he said my website is having more then 1000 urls where is the others but unfortunately google sitemap map add only 500 urls... So he said make a script like google to add all the links. we did.. but that script was picking database and admin links/information .. I mean all the server info which we dont want users/crawler to see or index. We just only wants links to be on the sitemap.. Now can any of expert put the shade of light in it as i am unable to answer anything to the client... Is there is any tool who add more then 2000 urls as its an dynamic website One more thing i suggested him to go for robots.txt file to disalow private section but again here comes a problem because sitemap will index by google and any visitor can access it and can see the private section info Guys help me out asap.. I just have one more day to answer.