logo

EnterTheGrid - PrimeurMonthly

EnterTheGrid - PrimeurMagazine is the premier Grid Computing and Supercomputing information source in the world. With PrimeurMonthly we provide you a free update with grid computing and supercomputer-news and in-depth analysis.

>PrimeurMagazine
>PrimeurLive!
>EnterTheGrid
>Analysis
>Backissues
>Calendar
>Subscribe
>Advertise
>Contact
Contents August 2008
World's fastest Ethernet compute cluster relies on Woven Systems 10 Gigabit Ethernet Fabric
Santa Clara 01 July 2008 The ATLAS compute cluster at the Max Planck Institute for Gravitational Physics in Hannover, Germany, achieved top ranking among the 285 Gigabit Ethernet clusters in the most recent TOP500 list of supercomputer sites. The ATLAS cluster successfully leverages the Dynamic Congestion Avoidance feature in Woven Systems' 10 Gigabit Ethernet (GE) Fabric to reach a performance level of 32.8 Teraflops, making it the fastest Ethernet cluster in the world today. Woven Systems Inc. is an innovator of Ethernet Fabric switching solutions based on its patented vSCALE technology for data centres and high-performance computing (HPC) clusters.
Advertisement
Visit our sponsors
Advertisement
Visit our sponsors

"What is remarkable about the ATLAS cluster is that we were able to take the lead very cost-effectively with a creative combination of more processors at lower clock rates and a higher Ethernet switching efficiency", explained Professor Bruce Allen, director of the Max Planck Institute for Gravitational Physics. "Woven's 10 Gigabit Ethernet Fabric switch is able to deliver sustained performance at an impressive 64 percent of the theoretical peak. The HPC Linpack experts we consulted tell us that they have never seen such a high level of Ethernet efficiency on such a large cluster. Without the Woven switch, ATLAS would not be the world's fastest Ethernet cluster. It's that simple."

The Institute attributes Woven's unprecedented efficiency to the vSCALE ASIC's Dynamic Congestion Avoidance capability that is constantly balancing traffic loads intelligently and in real-time along available paths in the non-blocking 10 GE fabric. A cluster's computational efficiency is critical to its performance, and efficiency is determined by the network's ability to handle inter-processor communications.

The efficiency is calculated using the Linpack benchmark from the ratio of the actual performance to the theoretical peak performance for all processors in the cluster. Of the 285 Gigabit Ethernet clusters on the TOP500 List, only six achieved a computational efficiency greater than 60 percent and of those, ATLAS was the most powerful. Of the remaining Gigabit Ethernet clusters, 76 had efficiencies of 50 percent or less; 97 had efficiencies of 51-55 percent and 106 had efficiencies of 56-60 percent.

The new ATLAS compute cluster is located in Hannover, Germany at the Max Planck Institute for Gravitational Physics, also known as the Albert Einstein Institute. The division of Observational Relativity and Cosmology, which built and operates the cluster, is part of an international collaborative effort to make direct detections of gravitational waves, first predicted by Einstein's General Theory of Relativity in 1917. The cluster must process a multitude of complex data analysis algorithms that scrutinize past and present measurements to search for patterns expected to result from passing waves. The four next-generation detectors deployed throughout the world generate over a terabyte of data daily, which is sent to all participating members for analysis.

The ATLAS cluster consists of 1342 compute nodes occupying 32 full racks. The use of Intel Xeon Quad-core processors gives the cluster over 5000 CPU cores. Each server node has its own dedicated Gigabit Ethernet connection to a Woven TRX 100 Ethernet switch, which has four separate 10 GE uplinks to the EFX 1000 Ethernet Fabric Switch at the core of the Ethernet fabric. Because this configuration is not over-subscribed, it assures non-blocking throughput performance for both inter-processor communications and storage access.

"We specifically designed vSCALE to create an Ethernet fabric that constantly performs at peak efficiency, and the Max Planck Institute has confirmed this in the world's fastest Ethernet cluster", stated Joe Ammirato, Woven's vice president of marketing. "Gravitational waves are seminal to Einstein's General Theory of Relativity, which is at the core of modern cosmology. Woven is proud to play in a role the Institute's search for the existence of these waves as the enabling interconnect technology for the ATLAS cluster."
Advertisement
Advertisement
Source: Woven Systems

EnterTheGrid - PrimeurMagazine

James Stewartstraat 248

1325 JN Almere

The Netherlands

http://EnterTheGrid.com

mailto:primeur [AT] enterthegrid [DOT] COM

© EnterTheGrid - PrimeurMonthly