What is the "+ 1"? I'm seeing this in my awstats file: Inktomi Slurp 3304+1 12.86 MB 30 Mar 2005 - 02:15 AskJeeves 4+2 27.56 KB 30 Mar 2005 - 02:39 ... Nevermind. I found my own answer. Posted here in case anyone else is curious. I had just uploaded a robots.txt file.
Well I need to know what is the number before + sign. I understand that +6 means googlebot sucessfully read 6 times my robots.txt file but what does 184+6 means in the front of googlebot. 184 ???? Further these number change daily & they are different for each Googlebot 184+6 MSNbot 292+26, Inktomi 6+4 I wonder why is MSN able to read higher than google? I have all my pages indexed on msn where as google only shows link to my homepage, they all visit daily & the site has been up since jan 2006. Thanks Ranjan
I have AWS version 6.4 (build 1.814) 6.5 is out too so may be its a version difference. Screen shot from my website cpanel lightzoneindia.com
I don't think you will see any change whether you add or do not. Generally googlebot, slurp, etc check robots.txt to see where they are allowed to index. All the statistics are showing is how many successful hits they made to a file you probably don't have. Do a search for robots.txt tutorial and make a simple one for your site. These two lines saved in a robots.txt file User-agent: * Disallow: Allows robots to index entire site. Where it is really nice to have a robots.txt file is to keep robots from indexing certain directories.
It will not change anything. For the bots, no robots.txt means that they are welcome everywhere in your web site. That's perfect. Jean-Luc
I didnt add the robots.txt file and i want the bots to index everything. so, isnt it better not to add the file?
The first number is the number of URL's requested by the bot (hits on any page or image, except robots.txt). Jean-Luc
Ok Thanks, so higher the number before + means more number of pages are being indexed by bots, right?