Hello, sorry for being a noob, but I've seen the file "Robots.txt" on every website submission site I go to. My question is, what is this? I submitted my URL to Google, but have not seen it popped up yet, I'm wondering if it is because I don't have a robots.txt uploaded to my website. Thanks for your help.
No! Robots.txt are like instruction for search engine robots. If you want robots to avoid crawling your whole or pages of your site, you can make a robots.txt with an instruction that disallow them to crawl the pages (Mostly this is use to save bandwith). In default robots.txt allows all bots to crawl your whole website, so even if you dont put any robots.txt file it will be index. Basoone