I put up a screen shot... can someone help me with the meaning of this...all i see is disallow this and disallow that....to me that dont seem good. I have 3 other domains that I verified that I am the owner and have crawl errors also..but I will start with this one... some please help me or tell me where i can find the answer to what this means
This is the content of your robots.txt file.. not a crawl error. The first line represents the spider/crawlers (in this case, *, which means all search engine spiders) Second Line is a reference of your sitemap location. Remaining lines blocks/disallow all (*) spiders to crawl and index the content of those sub-folders and all of their contents.
but these results...are they bad...good??? I got another site and just looked at the errors..gonna post a screen shot of that soon...but its said something like the robot is blocked from my post???? the robot must not be able to crawl my post..which im sure is bad...ill check the blogger settings ...but these rusults up to...is that bad??? or do i not have to worry
The stupid thing is google not rechecked all robots.txt files from 6and7june until now i updated my file from over a week and still not checked i think you have this problem too
This is not an error since the status was 200 but some line stated about block accessing specific folder on your website.
yea i really dont understand this google robot stuff..i mean I do...of how it crawls your site and everything...but the tool of verifying your site then you can check stats on it..and i check crawl errors but reading it makes no sense at all...well this screen shot is nothing..but when I get a chance I will post screen shots of the errors im really worried about...this should be more interesting