New World Record: Energy-efficient Data Processing uses Low-energy Processors
Scientists have developed a system that substantially reduces the energy consumption for processing huge amounts of data. They improved over the power efficiency of the former record holders by a factor of three to four. The record is listed in the “sort benchmark,” which is published by companies like Hewlett-Packard and Microsoft.
The team around Ulrich Meyer from Frankfurt´s Goethe University and Peter Sanders from Karlsruhe Institute of Technology (KIT) broke Stanford University’s previous record by using seemingly unconventional hardware: instead of server processors with high power requirements, the computer scientists used Intel Atom processors. These are microprocessors originally developed for Netbooks.
Their lower processing power compared to server systems was compensated by the use of highly efficient algorithms. Instead of hard drives, which consume a lot of power for the mechanics, the team employed so-called solid state disks (SSD), which are clearly faster and, at the same time, more power-economical. The record raises the question of whether the increasing hunger for energy in information technology could be strongly reduced. “In the long run, many small, power-efficient and cooperating systems are going to replace the so far used, heavy weighted ones,” explains Peter Sanders.
The starting point for their research project was one of the key problems in computer science, namely sorting of data. Computers connected via Internet generate constantly growing amounts of data. In order to enable analysis of the data, it first has to be sorted according to a specific criterion. The efficient sorting of data is thus of central interest for search engines and databases — and therefore an important research topic in both theoretical and practical computer science.
In the three categories of the competition, the researchers had to sort data amounts of 10 GB, 100 GB and 1 TB, respectively, consisting of datasets with 100 Byte each. Even in the largest category of 1 Terabyte, which corresponds to a stack of paper of 10 km height, the new record holders only spent 0,2 kWh. This is about the energy needed to boil two liters of water.
Supervised by Sanders and Meyer, Ph.D. candidates Johannes Singler (KIT) and Andreas Beckmann (Goethe University) developed the energy-saving system. The research groups of both universities are internationally noted for their work on the design and implementation of efficient algorithms for processing large data.
