I saw 100s of spider simulators on web and all showing different results. Can someone, please help me the most useful and authentic simulator that clearly depicts what and how does the spider read my website pages ?
I am sure that they don't load css styles sheets, so look at your website without the styles sheet and that should give you a starting point. Feel free to correct me if I'm wrong. Not sure what happens to images, I guess they aren't shown either, just the tags. Web-Master
Your site - CSS and - Javascript I guess that's all there is to it. The Spider see's everything else as you'd see in View Source unless its compiled by JS.