Okay so the content that I want people to see is in a nice form like this: http://www.lawltech.com/content/view/86/80/ http://www.lawltech.com/content/view/17/42/ http://www.lawltech.com/content/view/15/42/ etc... Now I am using Joomla, so it automatically makes up all kinds of other crazy URLs to insert variables. I don't want variable pages to show up in the SERPs. I just want the main content pages. I noticed that when it inserts variable and stuff the URLs look like this: http://www.lawltech.com/index.php?option=com_frontpage&limit=10&limitstart=20&Itemid=1&fontstyle=f-smaller http://www.lawltech.com/index.php?option=com_content&task=view&id=71&Itemid=73&fontstyle=f-smaller http://www.lawltech.com/index.php?option=com_content&task=view&id=51&Itemid=1&fontstyle=f-default etc... See how each one of these URLs starts with /index.php? So I was thinking since every page I don't want them to see starts with /index.php I could just block out anything that begins with /index.php. Now how would I do that? I was just going to add this to my robots.txt: User-agent: * Disallow: /index.php* Would that work... or am I dumb?
I haven't used OpenSEF, but I did use ARTIO JoomSEF. I think they are pretty cool components but JoomSEF kind of traumatized me. When I enabled it I ended up with a bunch of duplicate content in the SERPs and all kinds of crazy stuff happened and my SE traffic disappeared and yeh... it was not very pretty. I would just like to stay away from URL re-writing components...