Yesterday google web master tools was asking me to verify my site , it has been fine for over 5 years. The file was intact on my server, so i added a meta tag, now ok, but it appears the google bot is no longer visiting, meta tags and robots txt all allow this. Never had an issue until yesterday. All i have added is the <META NAME="ROBOTS" CONTENT="NOODP"> <META NAME="ROBOTS" CONTENT="NOYDIR"> tags, can this cause this problem Some pages have not been indexed for a month even though in my site map and linked from main page