The Inquirer-Home

Cray XT Jaguar takes supercomputing lead

Faster than Roadrunner
Tue Nov 11 2008, 03:30

THE CRAY XT JAGUAR at the US Department of Energy's Oak Ridge National Laboratory in Tennessee will probably lead the top 500 supercomputers list that comes out next week.

The DoE laboratory recently finished upgrading the Cray XT Jaguar to about two and a half times its original size, giving it 1.64 petaflops of peak computing power. That's substantially more number munching muscle than the 1.026 petaflops mark posted by IBM's Roadrunner at the Los Alamos National Laboratory in New Mexico to head up the Top 500 list last June.

While the IBM Roadrunner at Los Alamos is used for classified national security research, including nuclear weapons design and computational 'testing', the DoE started upgrading the Cray XT Jaguar installation at Oak Ridge four years ago to deliver more supercomputer power for unclassified research. The department claims its upgrade of the supercomputer was completed on time within budget and surpassed its original objectives.

The system has already completed a lengthy superconductivity calculation project that required sustained performance of more than 1.3 petaflops.

The faster Cray XT Jaguar will enable scientists to perform physics simulations on a scale "never seen before", according to Raymond L Orbach, the DoE undersecretary for science. "High-end computation will become the critical third pillar for scientific discovery, along with experiment and theory," Orbach said in a DoE statement.

Although joined at the hip with the nuclear power industry for much of its existence, the US Department of Energy is stretching to renew its relevance to national energy policies, since no new nuclear power plants have been built anywhere in the US for more than 20 years.

Michael Strayer, DOE associate director for Advanced Scientific Computing Research, said "The new petaflops machine will make it possible to address some of the most challenging scientific problems in areas such as climate modeling, renewable energy, materials science, fusion, and combustion."

The Linux-based Cray XT Jaguar supercomputer's original 84 cabinets were supplemented with 200 additional cabinets during the upgrade. The upgraded system has more than 45,000 AMD Opteron quad-core processors, 362TB of memory and a 10 petabyte file system. The processors have 578TB per second of memory bandwidth overall and the system has total I/O bandwidth of 284GB per second.

The system will undergo more testing in late December before starting production work early in 2009. ยต

See Also
AMD launches Barcelona chips for one-socket systems

L'Inq
Informationweek

Share this:

Comments
Upgrading this upgrade?

Can they clip 45,000 AMD "Shanghai"s into this system? Have AMD already sold out a few months of Shanghai production?!

posted by : Nigel Nunn, 11 November 2008 Complain about this comment
hmm

I bet it still won't run Crysis lol

posted by : Tom, 11 November 2008 Complain about this comment
Crysis anyone?

If there was just a PCI-e slot....

posted by : Adam, 11 November 2008 Complain about this comment
Cray CUDA

nVidia Quadro FX-5800 memory bandwidth 102GB a second vs Cray XT 286GB a second they should have stick in couple of nvidia gpu-s or is it gpgpu-s?

posted by : homo-anonymous, 11 November 2008 Complain about this comment
Yeah, but will it play Crysis?

Just kidding. Well done!

posted by : Doug A., 11 November 2008 Complain about this comment
I can see it now...

The Future News Headline:

"Computer scientists at Cray are stumped on why their newest supercomputer no longer seems to be working. Instead of the giving the correct answer to an array of problems presented to it, the machine simply shows a large '42' on its display."

"In unrelated news, the building hosting the supercomputer has been plagued with an outbreak of infestation from white mice."

posted by : Bob Diller, 11 November 2008 Complain about this comment
Send to Sylvie Barak

We will see tomorrow but for the first time ever IBM's Blue Gene L may not make the DARPA HPC top 3 in any benchmark. Ranger at TACC passed BGL a couple of months ago. Roadrunner doubled Blue Gene L. 

Sylvie these benchmarks are a whole lot more reliable than what you cited in your story.

posted by : Ed H, 11 November 2008 Complain about this comment
Awesome!

Finally a computer with that can run Vista.

posted by : Sasho, 12 November 2008 Complain about this comment
RoadRunner needs 10489 AMD Old Opterons for 1.64 PataFlops

Wikipedia: Roadrunner is designed for a peak performance of 1.7 petaflops. If reverse engineer math with this statement.

If 45000 Opetrons in jaguar give 1.64petaflop then 6480 Opterons (in roadrunner will be contribuiting) 0.24 petaflops of roadrunner's peak 1.7 petaflop. also meaning each PowerXCell operates at 7.2 times the performance of each Opteron. though Opteron is documented to operate at PowerXCell connector only.

http://www.hpcwire.com/topic/processors/IBM_Roadrunner_Takes_the_Gold_in_the_Petaflop_Race.html
http://www.nzherald.co.nz/technology/news/article.cfm?c_id=5&objectid=10515465

If this how then
-----------------------------
6948 .44 x 1.7 ........ x=26845
6480 .44 x 1.7 ........ x=25036

jaguar is using 18155 (45000-26845) more opterons than math requires to reach 1.7petaflops (1.64 infact). this also means 2 times drop in opteron scaling.

6948 .44 12960 x
x=0.82 (is roadruner 0.82+0.44=1.26pf peak capable, wikipedia false?)

6948 .44 x 1.26 ........ x=19896 (opteron only config)

so intead of 6480+12960=19440 cocktail-cpus stunt, IBM should have just used 19896 opetrons only to reach 1.26pf i.e just 456 more opterons.

19896 1.26 45000 x ........ x=2.85pf (jaguar pf !! either jaguar is lieing or with 45000 opterons we have 4 times drop in scaling or they have infact a 2+ pf machine)

any ideas !?!

posted by : Muhammad Imran, 12 November 2008 Complain about this comment
Mr. Imran don't mix apples and oranges

Roadrunner uses Opterons clustered with IBM Cell processors . You have Opteron AM2 Santa Rosa cpus matched with the PowerXCell 8i (64 bit version of the PS3 cpu). In apps like radiation transfer the Opeteron /Cell is 6 times faster than the Opteron alone. So it really depends on what you do which one will be faster. It is much like Red Storm is 30% faster than Blue Gene L in Fast Fourier transforms but 75% slower in Global Linear Algebra apps. Jaguar uses a mix of about 50 tflops of XT3's with Denmark 185's in the original configuration in 2006(ranked 3rd in HPC's Fast Fourier benchmark for 2006 and 2007). http://www.hpcchallenge.org/ Late 2007 they added about 200 tflops of XT4's with Opteron 1222's or 1224's. Now they have Opteron Barcelona 9600's in the XT5 frame. Both the Shanghai and the next generation will fit in the XT5 socket. 2009 should see the Cray/AMD Cascade and the IBM P7 make their appearances at about 4+ Pflops or 3 times faster than Jaguar and Roadrunner. http://www.nitrd.gov/pubs/2006supplement/hec_rd.pdf

posted by : Ed H, 12 November 2008 Complain about this comment
as scrackers

"I bet it still won't run Crysis lol"

actually i think ur right, since crysis can only multithread on like 4 cpu's --... not 45,000.... or something

posted by : G. Izzinglot Inherrpoon, 12 November 2008 Complain about this comment
aboutus
Advertisement
Subscribe to INQ newsletters
Advertisement
INQ Poll

48 core processors

What would you use a 48-core processor for?