ia_archiver

[Help Desk]

Who here has been visited by the "ia_archiver" agent? It is hitting my site like crazy. Google has only made about 5,500 hits while Alexa's "ia_archiver" has made over 186,000. I'm not going to complain if I see some results, but I was looking for insight and information from everybody else.

[Kings]

It's pretty useless. Just spidering for the Internet Archive (http://www.archive.org), and not a search engine or anything.

[Kings]

Hmm, no, I was wrong. It's the Alexa spider (http://pages.alexa.com/help/webmasters/), but I still don't think it's useful though.

[expat]

bit unusual to be hit that hard - maybe it's first visit?

It comes in usefull when one has to fight copyright or other issues - a hint to archives.org usually setles it. It's also interesting to see if competitors are learning anything.

Not to forget a nice alexa position of within the top 100.000 and a nice rating makes a nice little ad on ones site.

cheers
M

[respree]

I banned ia_archiver from my robots.txt for a while.

However, after Amazon's A9 launched, I let them back in again. I can't help but feel there's a connection between the two (but have no proof).

[Help Desk]

ia_archiver is up to 196,169 hits, Google is at 5,644 and MSN is at 1,398. About 73% of my traffic is because of ia_archiver.

[expat]

ia_archiver is up to 196,169 hits, Google is at 5,644 and MSN is at 1,398. About 73% of my traffic is because of ia_archiver.
.. interesting pic you have on Alexa, you may want to update your contact info etc. top 30.000 can be usefull....
M

[Help Desk]

I have done so a couple of times. It always grabs the wrong page.

[hulkster]

ia_archiver is up to 196,169 hits, Google is at 5,644 and MSN is at 1,398. About 73% of my traffic is because of ia_archiver.

Jeez ... I feel neglected - looks at last week's traffic on www.komar.org , it looks like we had 2,870 Googlebots, 669 MSNbots ... and a whopping total of 47 ia_archivers.

He must REALLY REALLY like your site!

[misohoni]

is this archiver linked to Alexa?

[expat]

is this archiver linked to Alexa?
yup amazon - alexa - http://web.archive.org (WayBack)
M

[hulkster]

YEP - see http://pages.alexa.com/help/webmasters/

[ECS Dave]

I can't help but think that being "tapped" by "ia_archiver" is a good thing.
Your site has been visited, and is being indexed by the "biggie" alexa.

ECS Dave

[Nucca_The_Warrior]

I have been getting hit by this ia_archiver as well. The IP and user-agent is banned on my server. Plus it was trying to access my admin pages on my forums server. So I'm saying theres a guest on the internet trying to get admin access of all web servers. Apparently he/she failed to get control of mine.

[hattrick]

New here, came across your site whilst trying to find out what ia_archiver was, seems it just hit my site. Seems that this one is the one to have for indexing, lets just hope it brings some traffic my way.:)

[BoBByCooL]

I've always wanted my sites to be included in web.archive.org. If for no other reason it's got its nostalgic purposes. I've got plenty of bandwidth so I've never had to worry about it either.

[jakeruston]

Wow guys, please don't bump this up, it was posted over 3 years ago.

I haven't been hit by it anyway, I think thats good :)