Just curious, Google writes about using robots for websites using CMSystems (Wordpress, Joomla, Drupal), however I am not sure if they are writing about THEIR ROBOTS or if the owner of a CMS site is supposed to acquire one. How is it best to get good SEO results on CMS sites if the spiders read HTML?
I like Wordpress. I begin change permalink and add robots.txt After i have post articles (with on-page SEO) --> Link Building
The best way to optimize CMS sites such as Wordpress is through the many plug ins they offer. A good plugin is SEOpressor
they are writing about their robots. if you have good seo and a good sitemap which you have submitted to the major search engines then the spiders will be crawling your site and you will be fine