Research & Development World

  • Home Page
  • Topics
    • Aerospace
    • Archeology
    • Automotive
    • Biotech
    • Chemistry
    • COVID-19
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Market Pulse
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
      • Software
    • Semiconductors
  • 2021 R&D 100 Award Winners
    • R&D 100 Awards
    • 2020 Winners
    • Winner Archive
  • Resources
    • Digital Issues
    • Podcasts
    • Subscribe
  • Global Funding Forecast
  • Webinars

Dealing with massive data from miniscule communities

By R&D Editors | August 2, 2012

It’s
relatively easy to collect massive amounts of data on microbes. But the
files are so large that it takes days to simply transmit them to other
researchers and months to analyze once they are received.

Researchers
at Michigan State University have developed a new computational
technique, featured in the current issue of the Proceedings of the
National Academy of Sciences, that relieves the logjam that these “big
data” issues create.

Microbial
communities living in soil or the ocean are quite complicated. Their
genomic data is easy enough to collect, but their data sets are so big
that they actually overwhelm today’s computers. C. Titus Brown, MSU
assistant professor in bioinformatics, demonstrates a general technique
that can be applied on most microbial communities.

The
interesting twist is that the team created a solution using small
computers, a novel approach considering most bioinformatics research
focuses on supercomputers, Brown said.

“To
thoroughly examine a gram of soil, we need to generate about 50
terabases of genomic sequence—about 1,000 times more data than generated
for the initial human genome project,” said Brown, who co-authored on
the paper with Jim Tiedje, University Distinguished professor of
microbiology and molecular genetics. “That would take about 50 laptops
to store that much data. Our paper shows the way to make it work on a
much smaller scale.”

Analyzing
DNA data using traditional computing methods is like trying to eat a
large pizza in a single bite. The huge influx of data bogs down
computers’ memory and causes them to choke. The new method employs a
filter that folds the pizza up compactly using a special data structure.
This allows computers to nibble at slices of the data and eventually
digest the entire sequence. This technique creates a 40-fold decrease in
memory requirements, allowing scientists to plow through reams of data
without using a supercomputer.

Brown
and Tiedje will continue to pursue this line of research, and they are
encouraging others to improve upon it as well. The researchers made the
complete source code and the ancillary software available to the public
to encourage extension.

“We
want this program to continue to evolve and improve,” Brown said. “In
fact, it already has. Other researchers have taken our approach in a new
direction and made a better genome assembler.”

Scaling metagenome sequence assembly with probabilistic de Bruijn graphs

Source: Michigan State University

Related Articles Read More >

R&D winner of the day: Monolithic Fiber Array Launcher
R&D collaborations looking to build expertise, in this week’s R&D power index
Invention addresses the problems of running a red light at traffic intersections
Liberty Defense airport shoe screening technology earns prestigious national award
2021 R&D Global Funding Forecast

Need R&D World news in a minute?

We Deliver!
R&D World Enewsletters get you caught up on all the mission critical news you need in research and development. Sign up today.
Enews Signup

R&D World Digital Issues

February 2020 issue

Browse the most current issue of R&D World and back issues in an easy to use high quality format. Clip, share and download with the leading R& magazine today.

Research & Development World
  • Subscribe to R&D World Magazine
  • Enews Sign Up
  • Contact Us
  • About Us
  • Drug Discovery & Development
  • Pharmaceutical Processing
  • 2022 Global Funding Forecast

Copyright © 2022 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search R&D World

  • Home Page
  • Topics
    • Aerospace
    • Archeology
    • Automotive
    • Biotech
    • Chemistry
    • COVID-19
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Market Pulse
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
      • Software
    • Semiconductors
  • 2021 R&D 100 Award Winners
    • R&D 100 Awards
    • 2020 Winners
    • Winner Archive
  • Resources
    • Digital Issues
    • Podcasts
    • Subscribe
  • Global Funding Forecast
  • Webinars