here is my robots site i want google index all pages mention in my site map is it ok? actually this robot automatically created
i try my best remove robots file but it is not deleting :-s actually the sitemap generated plugin atomatically creat my virtual robot
i dont know how to delete :-s actually i searched every where but not found.. it is a virtual robots file made by site map plugin (Wordpress)
User-agent: * Disallow: Sitemap: http://www.mywebsite.com/sitemap.xml.gz i have like this and all my files are indexed and this is created by the plugin as you said you cannot find the file inside WWW if you want to change it just create a robots.txt file and upload in www folder