Research & Development World

  • Home Page
  • Topics
    • Aerospace
    • Archeology
    • Automotive
    • Biotech
    • Chemistry
    • COVID-19
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Market Pulse
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
      • Software
    • Semiconductors
  • 2021 R&D 100 Award Winners
    • R&D 100 Awards
    • 2020 Winners
    • Winner Archive
  • Resources
    • Digital Issues
    • Podcasts
    • Subscribe
  • Global Funding Forecast
  • Webinars

What is deep learning?

By Paul Heney | March 8, 2021

A form of machine learning that excels at pattern recognition

Deep learning is a form of artificial neural network used for machine learning. This is a way of storing and processing information that is very different to conventional computers. Deep learning allows a computer to learn a task without a human first defining the algorithm, the computer only needs to know the objective and be shown examples of correct inputs and outputs. Tasks such as controlling complex systems and pattern recognition are often performed best by deep learning.

A deep neural net
Artificial neural networks are simplified mathematical representations of the neural networks found in biological brains. They have sets of numerical inputs and outputs, connected by a network of connections. The ease with which information can flow along a particular pathway through this network is determined by adjustable weightings at the hidden nodes between the input and output layers. Information is processed as it flows through the network. Information is stored, or the network is trained, by adjusting the weightings of the nodes. Training algorithms are used to adjust nodes, strengthening a pathway when the network gives a correct output and weakening it when the network makes a mistake. Training datasets with inputs and known correct outputs are used.

Early neural networks were shallow, typically with only one hidden layer of nodes between the inputs and outputs. Although these can theoretically solve any problem, they generally require a lot of input parameters and can be very computationally inefficient. When the training datasets are small, shallow networks can give better results.

Deep learning uses a neural network that is deep — with more hidden layers of nodes between the inputs and outputs. This can create a more sophisticated model, which often requires fewer input parameters and can find a solution more quickly. However, it also often requires a larger training dataset before the model becomes accurate.

Mathematics of deep learning
Conventional regression fits a curve to data in two dimensions or a surface to data in three dimensions. Deep learning can fit a model to data with many, sometimes even hundreds of, dimensions.

Applications
A person is able to make a good approximation to a two dimensional regression, simply sketching a curve through data points on a graph. However, humans can find it extremely difficult to find more complex patterns in data with many dimensions. In some areas, such as recognising faces or voices, humans have natural abilities to solve such problems. However, humans are not good at recognizing complex patterns when the data relates to a less familiar problem, such as control parameters in a complex system like a distributed renewable power grid or a financial market. Deep learning can, therefore, tackle problems that are conventionally seen as requiring a human, as well as new classes of problem that humans cannot solve.

 

Tell Us What You Think! Cancel reply

Related Articles Read More >

Groundbreaking research could help paramedics save the lives of pedestrian casualties 
R&D 100 winner of the day: Slycat
NNSA And Cornelis Networks to collaborate on next-generation high performance networking
TROY awarded $161K National Science Foundation grant
2021 R&D Global Funding Forecast

Need R&D World news in a minute?

We Deliver!
R&D World Enewsletters get you caught up on all the mission critical news you need in research and development. Sign up today.
Enews Signup

R&D World Digital Issues

February 2020 issue

Browse the most current issue of R&D World and back issues in an easy to use high quality format. Clip, share and download with the leading R& magazine today.

Research & Development World
  • Subscribe to R&D World Magazine
  • Enews Sign Up
  • Contact Us
  • About Us
  • Drug Discovery & Development
  • Pharmaceutical Processing
  • 2021 Global Funding Forecast

Copyright © 2022 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search R&D World

  • Home Page
  • Topics
    • Aerospace
    • Archeology
    • Automotive
    • Biotech
    • Chemistry
    • COVID-19
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Market Pulse
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
      • Software
    • Semiconductors
  • 2021 R&D 100 Award Winners
    • R&D 100 Awards
    • 2020 Winners
    • Winner Archive
  • Resources
    • Digital Issues
    • Podcasts
    • Subscribe
  • Global Funding Forecast
  • Webinars