hello friends, I have joomla site and does the give some problem of Indexing then what should u do. The problem is when the robots.txt file is left default like this User-agent: * Disallow: /administrator/ Disallow: /cache/ Disallow: /components/ Disallow: /images/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /libraries/ Disallow: /media/ Disallow: /modules/ Disallow: /plugins/ Disallow: /templates/ Disallow: /tmp/ then site is not indexed. but when i change the robots file to this User-agent: * Disallow: /administrator/ Disallow: /cache/ Disallow: /components/ Disallow: /images/ Disallow: /includes/ Disallow: /installation/ Disallow: /language/ Disallow: /libraries/ Disallow: /media/ Disallow: /modules/ Disallow: /plugins/ Disallow: /templates/ Disallow: /tmp/ Disallow: /xmlrpc/ Allow:/ then only the first page is indexed all the other pages are not ! why could this happen ? can someone with me tell that what is the process of index... Thanks in advance...
Let it like default. bcz these are internal directories to manage site and admin area. these nothing do with your main site. only stop bots to index admin side etc... submit sitemap.xml best source is: http://www.xml-sitemaps.com/
No problem of the default robots.txt, maybe your index happened to be indexed after your changement. But according to my experience, joomla is waker in SEO, wordpress is better, so I've converted my ste from joomla to wordpress, and after my migration, my traffic increases day by day, but before this migration, I've been in sanbox. I've shared how to convert joomla to wordpress here.