ALBUQUERQUE, NM — A software program that ranks supercomputers on their ability to solve complex problems rather than on raw speed alone continues to gain traction in the high performance computing community. More than 60 supercomputers were ranked by the emerging tool, termed the High Performance Conjugate Gradients (HPCG) benchmark, in ratings released at the annual supercomputing meeting SC15 in late November. Eighteen months earlier, only 15 supercomputers were on the list.
“HPCG is designed to complement the traditional High Performance Linpack (HPL) benchmark used as the official metric for ranking the TOP500 systems,” said Sandia National Laboratories researcher Mike Heroux, who developed the HPCG program in collaboration with Jack Dongarra and Piotr Luszczek from the University of Tennessee.
The current list contains the same entries as many of the top 50 systems from Linpack’s TOP500 but significantly shuffles HPL rankings, indicating that HPCG puts different system characteristics through their paces.
This is because the different measures provided by HPCG and HPL act as bookends on the performance spectrum of a given system, said Heroux. “While HPL tests supercomputer speed in solving relatively straightforward problems, HPCG’s more complex criteria test characteristics such as high-performance interconnects, memory systems and fine-grain cooperative threading that are important to a different and broader set of applications.”
Heroux said only time will tell whether supercomputer manufacturers and users gravitate toward HPCG as a useful test. “All major vendor computing companies have invested heavily in optimizing our benchmark. All participating system owners have dedicated machine time to make runs. These investments are the strongest confirmation that we have developed something useful.
“Many benchmarks have been proposed as complements or even replacements for Linpack,” he said. “We have had more success than previous Oefforts. But there is still a lot of work to keep the effort going.”
Sandia National Laboratories is a multi-program laboratory operated by Sandia Corporation, a wholly owned subsidiary of Lockheed Martin, for the U.S. Department of Energy’s National Nuclear Security Administration. With main facilities in Albuquerque, NM, and Livermore, CA, Sandia has major R&D responsibilities in national security, energy and environmental technologies and economic competitiveness.
