Hi, Is there anyway we can check if a site is crawlable, specially by google? I am looking for a site that has a tool to crawl & see the results of a site. I would call this a simulator for google bot.
Thanks but thats not exactly what i was looking for. I need to know a list of pages that could be indexed by google when the bot crawls the site. Anyone ?