Research & Development World

  • Home Page
  • Topics
    • Aerospace
    • Archeology
    • Automotive
    • Biotech
    • Chemistry
    • COVID-19
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Market Pulse
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
      • Software
    • Semiconductors
  • 2021 R&D 100 Award Winners
    • R&D 100 Awards
    • 2020 Winners
    • Winner Archive
  • Resources
    • Digital Issues
    • Podcasts
    • Subscribe
  • Global Funding Forecast
  • Webinars

What are neural networks?

By Paul Heney | October 1, 2020

Neural networks are a way of processing information that is used in both biological nervous systems and in artificial intelligence, or machine learning. Digital computers follow a von Neumann model, moving data from memory, performing clearly defined calculations on it, and then storing the resulting transformed data back in the memory. Neural networks on the other hand, use a network of connections to both store and process information. They are able to learn to perform operations, given only an objective and no precise instructions as to how it should be carried out. In many ways they function like a highly-complex statistical regression, fitting a model in many dimensions. Neural networks are particularly well-suited to applications such as image recognition, speech recognition and adaptive control.

Biological Neural Networks

Biological neural networks consist of nerve cells called neurons which each have many nerve fibres protruding from them, known as axons. The axons of different neurons have electrochemical connections known as synapses. Synapses act as variable attenuators, allowing the strength of connections between neurons to be adjusted. It is thought that both memories and skills are formed by creating pathways through which signals can flow via synapses with lowered resistance. Although this basic theory of the brain was suggested in the 19th Century, it was mathematical models of its functioning developed in the 1940’s that led directly to the development of artificial neural networks.

Artificial Neural Networks

Artificial neural networks are simplified mathematical models of biological ones, which can be simulated within a conventional digital computer. These models have a set of numerical inputs and a set of numerical outputs. The inputs are linked to the outputs through a network of connections with layers of nodes. The weighting of the nodes can be adjusted to make a particular path more likely to be followed. The neural network can then be presented with a training set of inputs for which the correct outputs are already known. The nodes are adjusted to minimize the difference between the neural networks outputs and the correct outputs. This involves solving large matrices.

Neural networks form non-linear statistical models. This is much like a regression fitting a curve to data in two dimensions. However, a neural network can fit models in many dimensions, spotting patterns in numerical data that humans cannot see. For example, this can map inputs to outputs for complex control applications. One limitation of neural networks is that, because of the high dimensionality of the models, they require very large datasets to train them effectively.

Networks may be shallow or deep, referring to the layers of nodes between the inputs and the outputs. The application of deep neural networks is known as deep learning and has proved the most useful area of artificial intelligence in recent years.

Tell Us What You Think! Cancel reply

Related Articles Read More >

Object detection and tracking software accelerates thermal camera integration for ADAS and AV
Groundbreaking research could help paramedics save the lives of pedestrian casualties 
CEA-Leti scientist receives $3.30M grant to develop nanoscale memories inspired by insect nervous systems
‘Self-driving’ lab speeds up research, synthesis of energy materials
2021 R&D Global Funding Forecast

Need R&D World news in a minute?

We Deliver!
R&D World Enewsletters get you caught up on all the mission critical news you need in research and development. Sign up today.
Enews Signup

R&D World Digital Issues

February 2020 issue

Browse the most current issue of R&D World and back issues in an easy to use high quality format. Clip, share and download with the leading R& magazine today.

Research & Development World
  • Subscribe to R&D World Magazine
  • Enews Sign Up
  • Contact Us
  • About Us
  • Drug Discovery & Development
  • Pharmaceutical Processing
  • 2021 Global Funding Forecast

Copyright © 2022 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search R&D World

  • Home Page
  • Topics
    • Aerospace
    • Archeology
    • Automotive
    • Biotech
    • Chemistry
    • COVID-19
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Market Pulse
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
      • Software
    • Semiconductors
  • 2021 R&D 100 Award Winners
    • R&D 100 Awards
    • 2020 Winners
    • Winner Archive
  • Resources
    • Digital Issues
    • Podcasts
    • Subscribe
  • Global Funding Forecast
  • Webinars