Though the Internet Archive pays attention to robots.txt prohibitions. The NZ National Archives decided (controversially) to ignore this in their Web spidering efforts. What attitude will the British Library take?
The government will start recording it all in a database, which they will then duplicate to guard against loss by storing it on trains, taxis whorehouses or anywhere else that ministers and civil servants frequent....
On a not-entirely-unrelated topic,
http://www.theinquirer.net/inquirer/news/648/1050648/ddr3-phenom-ii
Scroll down to the third comment
Cheers,
ChemC
archive.org not enough?
Though the Internet Archive pays attention to robots.txt prohibitions. The NZ National Archives decided (controversially) to ignore this in their Web spidering efforts. What attitude will the British Library take?
Taking into account that brits are the greatest falsifiers of history to date, maybe its not such a bad thing.
Google is here - to archive all of your data for you.
The government will start recording it all in a database, which they will then duplicate to guard against loss by storing it on trains, taxis whorehouses or anywhere else that ministers and civil servants frequent....