Library of Congress has archive of tweets, but no plan for its public display

http://www.washingtonpost.com/lifes...db1c24-55d4-11e2-bf3e-76c0a789346f_story.html

In the few minutes it will take you to read this story, some 3 million new tweets will have flitted across the publishing platform Twitter and ricocheted across the Internet. The Library of Congress is busy archiving the sprawling and frenetic Twitter canon â€” with some key exceptions â€” dating back to the siteâ€™s 2006 launch. That means saving for posterity more than 170 billion tweets and counting, with an average of more than 400 million new tweets sent each day, according to Twitter.

But in the two years since the library announced this unprecedented acquisition project, few details have emerged about how its unwieldy corpus of 140-character bursts will be made available to the public.

Thatâ€™s because the library hasnâ€™t figured it out yet.

â€œPeople expect fully indexed â€” if not online searchable â€” databases, and thatâ€™s very difficult to apply to massive digital databases in real time,â€ said Deputy Librarian of Congress Robert Dizard Jr. â€œThe technology for archival access has to catch up with the technology that has allowed for content creation and distribution on a massive scale. Twitter is focused on creating and distributing content; thatâ€™s the model. Our focus is on collecting that data, archiving it, stabilizing it and providing access; a very different model.â€

Colorado-based data company Gnip is managing the transfer of tweets to the archive, which is populated by a fully automated system that processes tweets from across the globe. Each archived tweet comes with more than 50 fields of metadata â€” where the tweet originated, how many times it was retweeted, who follows the account that posted the tweet and so on â€” although content from links, photos and videos attached to tweets are not included. For securityâ€™s sake, there are two copies of the complete collection.

But the library hasnâ€™t started the daunting task of sorting or filtering its 133 terabytes of Twitter data, which it receives from Gnip in chronological bundles, in any meaningful way.
Click to expand...

Log in or Sign up

Advertising (learn more)

Library of Congress has archive of tweets, but no plan for its public display

Populace Well-Known Member

Log in or Sign up

Advertising (learn more)

Library of Congress has archive of tweets, but no plan for its public display

Populace Well-Known Member

Useful Searches