Illustration of the on-chip classification process with the Yin-Yang dataset. Each symbol represents the spike time delay for various classifying neurons.
Credit: Göltz and Kriener et al. (Heidelberg / Bern)
RESEARCHERS FROM HEIDELBERG AND BERN DEVELOP A NEW TRAINING APPROACH FOR SPIKING NEURAL NETWORKS
Developing a machine that processes information as efficiently as the human brain has been a long-standing research goal towards true artificial intelligence. An interdisciplinary research team at Heidelberg University and the University of Bern (Switzerland) led by Dr Mihai Petrovici is tackling this problem with the help of biologically-inspired artificial neural networks.
Spiking neural networks, which mimic the structure and function of a natural nervous system, represent promising candidates because they are powerful, fast, and energy-efficient. One key challenge is how to train such complex systems. The German-Swiss research team has now developed and successfully implemented an algorithm that achieves such training.
The nerve cells (or neurons) in the brain transmit information using short electrical pulses known as spikes. These spikes are triggered when a certain stimulus threshold is exceeded. Both the frequency with which a single neuron produces such spikes and the temporal sequence of the individual spikes are critical for the exchange of information. “The main difference of biological spiking networks to artificial neural networks is that, because they are using spike-based information processing, they can solve complex tasks such as image recognition and classification with extreme energy efficiency,” states Julian Göltz, a doctoral candidate in Dr Petrovici’s research group.
Both the human brain and the architecturally similar artificial spiking neural networks can only perform at their full potential if the individual neurons are properly connected to one another. But how can brain-inspired – that is, neuromorphic – systems be adjusted to process spiking input correctly? “This question is fundamental for the development of powerful artificial networks based on biological models,” stresses Laura Kriener, also a member of Dr Petrovici’s research team. Special algorithms are required to guarantee that the neurons in a spiking neural network fire at the correct time. These algorithms adjust the connections between the neurons so that the network can perform the required task, such as classifying images with high precision.
The team under the direction of Dr Petrovici developed just such an algorithm. “Using this approach, we can train spiking neural networks to code and transmit information exclusively in single spikes. They thereby produce the desired results especially quickly and efficiently,” explains Julian Göltz. Moreover, the researchers succeeded in implementing a neural network trained with this algorithm on a physical platform – the BrainScaleS-2 neuromorphic hardware platform developed at Heidelberg University.
According to the researchers, the BrainScaleS system processes information up to a thousand times faster than the human brain and needs far less energy than conventional computer systems. It is part of the European Human Brain Project, which integrates technologies like neuromorphic computing into an open platform called EBRAINS. “However, our work is not only interesting for neuromorphic computing and biologically inspired hardware. It also acknowledges the demand from the scientific community to transfer so-called Deep Learning approaches to neuroscience and thereby further unveil the secrets of the human brain,” emphasises Dr Petrovici.
Original Article: SOLVING COMPLEX LEARNING TASKS IN BRAIN-INSPIRED COMPUTERS
More from: Heidelberg University | University of Bern
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Spiking neural networks
- Liquid Neural Networks Do More With Less
[Ramin Hasani] and colleague [Mathias Lechner] have been working with a new type of Artificial Neural Network called Liquid Neural Networks, and presented some of the exciting results at a recent ...
- Elon Musk’s Neuralink begins accepting human patients for trials of its brain implant
Are you at least 22 years old and do you have quadriplegia from a spinal cord injury, or amyotrophic lateral sclerosis (ALS)?
- China Aims To Replicate Human Brain in Bid To Dominate Global AI
The pursuit of the most advanced AI—human-like artificial general intelligence—has prompted concerns among experts about potential dangers if it runs amok.
- VCSEL used in novel photonic neural network
Photonic neural network systems, which are fast and energy efficient, are helpful for dealing with large amounts of data. To advance photonic brain-like computing technologies, a group of researchers ...
- New photonic neural networks promise ultrafast computing for complex tasks
Photonic neural network systems, which are fast and energy efficient, are especially helpful for dealing with large amounts of data. To advance photonic brain-like computing technologies, a group of ...
Go deeper with Google Headlines on:
Spiking neural networks
[google_news title=”” keyword=”spiking neural networks” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Biologically-inspired artificial neural networks
- Neurons, Astrocytes, and Transformers: Are AI Models Biologically Plausible?
A new study bridging neuroscience and machine learning offers insights into the potential role of astrocytes in the human brain. Artificial neural networks are ubiquitous machine-learning models that ...
- Liquid Neural Networks Do More With Less
Liquid neural networks are inspired by biological neurons ... expect to see the operational gap between biological neural networks and artificial neural networks continue to close and blur.
- Scientists Have Merged Artificial Intelligence With Human Brain Cells And It Can Play Video Games
“We will be using this grant to develop better AI machines that replicate the learning capacity of these biological neural networks. This will help us scale up the hardware and methods capacity to the ...
- How Convolutional Neural Networks Learn From Visual Inputs
As machine learning and artificial intelligence advance, one technology stands out for its remarkable success in processing visual data: Convolutional Neural Networks (CNNs). These specialized forms ...
- 2030, Artificial Neural Networks Market Size | Industry Report 2023
The "Artificial Neural Networks Market" is one of the sectors that is expanding the fastest, thus it is crucial for players in the market to first do an exhaustive analysis of the sector.
Go deeper with Google Headlines on:
Biologically-inspired artificial neural networks
[google_news title=”” keyword=”biologically-inspired artificial neural networks” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
