|
|
|
|
#1
Mar 31st 2005, 12:56 am
|
||||
|
||||
|
Awstats robots: 3304+1
What is the "+ 1"?
I'm seeing this in my awstats file: Inktomi Slurp 3304+1 12.86 MB 30 Mar 2005 - 02:15 AskJeeves 4+2 27.56 KB 30 Mar 2005 - 02:39 ... Nevermind. I found my own answer. Posted here in case anyone else is curious. I had just uploaded a robots.txt file. Quote:
__________________
|
|
#2
Apr 9th 2006, 7:05 am
|
|||
|
|||
|
Well I need to know what is the number before + sign.
I understand that +6 means googlebot sucessfully read 6 times my robots.txt file but what does 184+6 means in the front of googlebot. 184 ???? Further these number change daily & they are different for each Googlebot 184+6 MSNbot 292+26, Inktomi 6+4 I wonder why is MSN able to read higher than google? I have all my pages indexed on msn where as google only shows link to my homepage, they all visit daily & the site has been up since jan 2006. Thanks Ranjan Last edited by ranjan2001; Apr 9th 2006 at 7:11 am.
|
|
#3
Apr 9th 2006, 7:32 am
|
||||
|
||||
 These are my this month stats.Where is the "+" option?
|
|
#4
Apr 9th 2006, 7:40 am
|
||||
|
||||
|
Do you have a robots.txt file for robot to hit?
__________________
Shannon - . Controllable Christmas Lights for Celiac Disease : Zend Certified Engineer : Preschool Curriculum Ideas : Restorable Iron
|
|
#5
Apr 9th 2006, 7:41 am
|
||||
|
||||
|
Quote:
Jean-Luc
__________________
Regular Expression Tester Redirect Checker as easy as 1 2 3, even if you are not a HTTP-header guru !
|
|
#6
Apr 9th 2006, 7:44 am
|
||||
|
||||
|
Is it good if i add it now?
I mean will i see a boost in the bots hits if i add it?
|
|
#7
Apr 9th 2006, 7:47 am
|
|||
|
|||
|
I have AWS version 6.4 (build 1.814) 6.5 is out too so may be its a version difference.
Screen shot from my website cpanel lightzoneindia.com 
|
|
#8
Apr 9th 2006, 7:50 am
|
||||
|
||||
|
I don't think you will see any change whether you add or do not. Generally googlebot, slurp, etc check robots.txt to see where they are allowed to index. All the statistics are showing is how many successful hits they made to a file you probably don't have.
Do a search for robots.txt tutorial and make a simple one for your site. These two lines saved in a robots.txt file User-agent: * Disallow: Allows robots to index entire site. Where it is really nice to have a robots.txt file is to keep robots from indexing certain directories.
__________________
Shannon - . Controllable Christmas Lights for Celiac Disease : Zend Certified Engineer : Preschool Curriculum Ideas : Restorable Iron
|
|
#9
Apr 9th 2006, 7:51 am
|
||||
|
||||
|
Quote:
For the bots, no robots.txt means that they are welcome everywhere in your web site. That's perfect.  Jean-Luc
__________________
Regular Expression Tester Redirect Checker as easy as 1 2 3, even if you are not a HTTP-header guru !
|
|
#10
Apr 9th 2006, 7:52 am
|
||||
|
||||
|
I didnt add the robots.txt file and i want the bots to index everything.
so, isnt it better not to add the file?
|
|
#11
Apr 9th 2006, 11:12 am
|
|||
|
|||
|
So any answer to my original question ?
|
|
#12
Apr 9th 2006, 12:50 pm
|
||||
|
||||
|
Quote:
Jean-Luc
__________________
Regular Expression Tester Redirect Checker as easy as 1 2 3, even if you are not a HTTP-header guru !
|
|
#13
Apr 9th 2006, 8:12 pm
|
|||
|
|||
|
Ok Thanks, so higher the number before + means more number of pages are being indexed by bots, right?
|
 |
| Bookmarks |
| Thread Tools | |
|
|
Similar Threads
|
||||
| Thread | Thread Starter | Forum | Replies | Last Post |
| Robots Tab in Site Metadata - Helpful? or Harmful? | Rob | HTML & Website Design | 10 | Oct 15th 2005 12:59 pm |
| WArning: AWStats Security Hole discovered! | Redleg | Security | 9 | Jun 30th 2005 1:46 pm |
| Infant-level robots.txt question. | Owlcroft | robots.txt | 9 | Apr 29th 2005 1:02 pm |
| robots meta tag. please help me. | king_cobra | Search Engine Optimization | 6 | Apr 3rd 2005 11:50 am |
| googlebot in awstats | daboss | 1 | Feb 20th 2005 10:49 pm | |
