Huge Internet archive data centre opens
85 billion Web pages dating back to '1996
Friday, 20 March 2009, 12:33
THE INTERNET ARCHIVE ORGANISATION is getting a new data centre which can house two petabytes of information for its 'Wayback Machine'.
The digital time capsule stores 85 billion archived versions of Web pages dating back to 1996.
Five years ago it had just 30 billion Web pages. It is expected to continue to grow by 100TB of data per month.
The new data centre runs Solaris 10 with ZFS on Sun Fire x4500s servers inside a Sun Modular Datacenter. µ
L'Inq
Computerworld
Share this:
Share
Advertisement
Subscribe to the INQ Newsletter
Sign-up for the INQBot weekly newsletter
INQ Whitepapers
Business Intelligence Software
Customer Relationship Management (CRM)
Enterprise Accounting Software
Enterprise Resource Planning (ERP)
Enterprise Systems Management
Jobs
Advertisement
INQ Poll
Folks this is simply expansion of the bog-standard archive that has existed for years and years... I've used the wayback machine many times and yes it is neat and valuable but it ain't new as the title implies.
The title doesn't state that the Internet Archive is new, but rather a new data center is opening - big difference. The Internet Archive IS allowed to have more than one data center, isn't it?
The Archive Wayback machine is second only to Wikipedia as the most useful web site on the Planet.
Once a good site dies, it's gone for ever and all its useful data is lost.
Many a time I've found a good article, then discovered later that the makeover the site has had means that the useful stuff has been discarded in favour of a pretty Flash panel.
Many thanks to Archive.org. Long may it continue.
2 Petabytes = 2000 Terabytes.
Current rate of adding 100TB per month.
Therefore, they will need to add another 2 or 4 Petabyted in another 18 months.