I did a spider test using a few tools and when I do have them crawl, I get foreign letters, and symbols, including no Meta, Title or Description found. http://www.webconfs.com/search-engine-spider-simulator.php I tested a few other sites to see if it was just a script mess up, but it wasn't, their sites came up with category links and meta information. Is there something I missing to make my site SEO friendly? or is the script a little buggy
I don't know, mine came back dead on, maybe a little light on a few things, but definitely the immediate content and links
I guess your script is buggy. Probably is not working OK with all encodings: UTF-8, ISO-8859, UTF-16, etc.
Most of those things are for entertainment purposes. They are cool to play around with, but they really hold no real value. If they were all dependable, Leapfish Appraisals would have made me a millionaire by now.
What is the work around for this? I replaced the headers meta with the correct format with charset=ISO-8859-1. Anything else besides the script? The loading is a lot faster as I decreased the kb's in the files and took out a few images as well for faster speed on those with a lower connection. Thanks again guys.
Resolved by adding <meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /> and Turning the Compression off in the admin page. Provided by proprod & Dawzz from PHPLD Community