Research & Development World

  • Home Page
  • Topics
    • Aerospace
    • Archeology
    • Automotive
    • Biotech
    • Chemistry
    • COVID-19
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Market Pulse
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
      • Software
    • Semiconductors
  • 2021 R&D 100 Award Winners
    • R&D 100 Awards
    • 2020 Winners
    • Winner Archive
  • Resources
    • Digital Issues
    • Podcasts
    • Subscribe
  • Global Funding Forecast
  • Webinars

Bandwidth wizardry improves efficiency of multi-core chips

By R&D Editors | May 26, 2011

Researchers
from North Carolina State University have developed two new techniques
to help maximize the performance of multi-core computer chips by
allowing them to retrieve data more efficiently, which boosts chip
performance by 10 to 40 percent.

To
do this, the new techniques allow multi-core chips to deal with two
things more efficiently: allocating bandwidth and “prefetching” data.

Multi-core
chips are supposed to make our computers run faster. Each core on a
chip is its own central processing unit, or computer brain. However,
there are things that can slow these cores. For example, each core needs
to retrieve data from memory that is not stored on its chip. There is a
limited pathway – or bandwidth – these cores can use to retrieve that
off-chip data. As chips have incorporated more and more cores, the
bandwidth has become increasingly congested – slowing down system
performance.

One
of the ways to expedite core performance is called prefetching. Each
chip has its own small memory component, called a cache. In prefetching,
the cache predicts what data a core will need in the future and
retrieves that data from off-chip memory before the core needs it.
Ideally, this improves the core’s performance. But, if the cache’s
prediction is inaccurate, it unnecessarily clogs the bandwidth while
retrieving the wrong data. This actually slows the chip’s overall
performance.

“The
first technique relies on criteria we developed to determine how much
bandwidth should be allotted to each core on a chip,” says Dr. Yan
Solihin, associate professor of electrical and computer engineering at
NC State and co-author of a paper describing the research.

Some
cores require more off-chip data than others. The researchers use
easily-collected data from the hardware counters on each chip to
determine which cores need more bandwidth. “By better distributing the
bandwidth to the appropriate cores, the criteria are able to maximize
system performance,” Solihin says.

“The
second technique relies on a set of criteria we developed for
determining when prefetching will boost performance and should be
utilized,” Solihin says, “as well as when prefetching would slow things
down and should be avoided.”

These
criteria also use data from each chip’s hardware counters. The
prefetching criteria would allow manufacturers to make multi-core chips
that operate more efficiently, because each of the individual cores
would automatically turn prefetching on or off as needed.

Utilizing
both sets of criteria, the researchers were able to boost multi-core
chip performance by 40%, compared to multi-core chips that do not
prefetch data, and by 10% over multi-core chips that always prefetch
data.

The
paper, “Studying the Impact of Hardware Prefetching and Bandwidth
Partitioning in Chip-Multiprocessors,” will be presented June 9 at the
International Conference on Measurement and Modeling of Computer Systems
(SIGMETRICS) in San Jose, Calif. The paper was co-authored by Dr. Fang
Liu, a former Ph.D. student at NC State. The research was supported, in
part, by the National Science Foundation.

NC State’s Department of Electrical and Computer Engineering is part of the university’s College of Engineering.

Citation:

“Studying the Impact of Hardware Prefetching and Bandwidth Partitioning in Chip-Multiprocessors”

Authors: Fang Liu and Yan Solihin, North Carolina State University

Presentation: June 9, 2011, at the International Conference on Measurement and Modeling of Computer Systems, San Jose, Calif.

SOURCE

Related Articles Read More >

ENPICOM launches display solution to accelerate antibody selection while maximizing precision
Groundbreaking research could help paramedics save the lives of pedestrian casualties 
R&D 100 winner of the day: Slycat
R&D 100 winner of the day: dGen
2021 R&D Global Funding Forecast

Need R&D World news in a minute?

We Deliver!
R&D World Enewsletters get you caught up on all the mission critical news you need in research and development. Sign up today.
Enews Signup

R&D World Digital Issues

February 2020 issue

Browse the most current issue of R&D World and back issues in an easy to use high quality format. Clip, share and download with the leading R& magazine today.

Research & Development World
  • Subscribe to R&D World Magazine
  • Enews Sign Up
  • Contact Us
  • About Us
  • Drug Discovery & Development
  • Pharmaceutical Processing
  • 2021 Global Funding Forecast

Copyright © 2022 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search R&D World

  • Home Page
  • Topics
    • Aerospace
    • Archeology
    • Automotive
    • Biotech
    • Chemistry
    • COVID-19
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Market Pulse
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
      • Software
    • Semiconductors
  • 2021 R&D 100 Award Winners
    • R&D 100 Awards
    • 2020 Winners
    • Winner Archive
  • Resources
    • Digital Issues
    • Podcasts
    • Subscribe
  • Global Funding Forecast
  • Webinars