Servidores - Debt Help - Car Insurance - Homeowner - Free Ringtones
PDA

View Full Version : Alexa's ia_archiver bot

hurricane_sh
Nov 3rd 2004, 11:08 pm
It's on my forum all the time, what does it want? :confused:

They seem not to cache inner pages.
Help Desk
Nov 4th 2004, 5:33 am
Basically it is Amazon's search engine. Currently Amazon uses Google but is working on their own. It took up A LOT of my bandwidth, but I will let it for now hoping that when Amazon's search goes live, it might pay off.
mxlabs
Nov 4th 2004, 6:13 am
how is amazon affiliated with alexa?
I just checked it and it eats some nice bandwidth per month indeed.
DangerMouse
Nov 4th 2004, 6:32 am
They aren't affiliated... They are one and the same!
dejaone
Nov 4th 2004, 9:45 am
beside alexa, amazon runs A9.com search engine too
mxlabs
Nov 4th 2004, 10:03 am
They aren't affiliated... They are one and the same!

wow, never even noticed that. thanks for pointing me to it... lol, so obvious
Tid
Nov 5th 2004, 4:50 pm
No use. It is banned in robots.txt
eduardomaio
Nov 7th 2004, 4:42 pm
People realy underestimate Alexa because of their ranking tool... I won't hurt to leave it and let it spider you, it will give some results in Alexa and A9 for sure!