hello techendeavour, i would highly recommend that you should have a sitemap and a robot.txt in your website. sitemap - it helps the search engines to index the pages properly in their database that the website contains. robot.txt - this is used to tell the search engine robots which directories it should index and which to avoid which you have in your server. after you have created bot the stuff for your website it's advisable that you submit your websites in google webmaster tool and bing webmaster tool. this will help you to get your website indexed faster by the search engines. i hope that i have managed to answer your question and remove your doubt .