Google detects a trillion URLs
An American trillion, that is
GOOGLE HAS DETECTED more than a trillion unique URLs on the Web according to the outfit's bog site.
Apparently the World-Wide Wibble is growing at a speed of a billion pages a day.
Jesse Alpert and Nissan Hajaj, software engineers in Google's Web Search Infrastructure Team said that Google didn't have to index every one of those trillion pages as many of them are similar to each other, or represent auto-generated content.
Google has not made public pronouncements about the size of its index for a while mostly because other major search engine players tend to hassle it about its methodology.
We can expect a round of reactions from rivals like Yahoo, Microsoft and Ask.com.
Google also mentioned how and with what frequency it analyses its links.
It said that it re-processes the entire web-link graph several times per day. This graph of one trillion URLs is similar to a map made up of one trillion intersections. So multiple times every day, it does the computational equivalent of fully exploring every intersection of every road in the United States.
Except it'd be a map about 50,000 times as big as the US, with 50,000 times as many roads and intersections. µ
L'Inq
Googleblog
Comments
Lets See 150 bytes x 1 trillion....
With new 1.5 terraflop hardrives & if trillion=1 terraflop, about 100 harddrives to store all addresses(each address being less than 150 bytes). =$ fifie thou. of HDD Max.No More than storing entire terra map project. Most people wouldn't exchange luxuary vechile for 100 HDD, let alone impossibility of finding data. So Must be Tape Job. thus: thou or so in machine + Tape(Use HDD for commonly used url). Plus your ready for lots more tape Jobs. Yet, Trillion addresses as unique webpages cost MORE than Trillion to create. Then What? Unplug Machine Obviously.
drashek
What?
WTF is this douche before me saying???Weird
Are you calling him a shower?Which scale do you use ?
1 trillion = (1 million) ^ 3 ?What scale do you use ?
The short scale or the long scale...
I say that because the most people on the world use the long scale with :
milliard, billion, billiard, trillion, trilliard...
and
1 billion = (1 million) ^ 2
1 trillion = (1 million) ^ 3
1 quadrillion = (1 million) ^ 4
...