Intelligent machines of the future may need to sleep as much as we do.
States that resemble sleep-like cycles in simulated neural networks quell the instability that comes with uninterrupted self-learning in artificial analogs of brains
No one can say whether androids will dream of electric sheep, but they will almost certainly need periods of rest that offer benefits similar to those that sleep provides to living brains, according to new research from Los Alamos National Laboratory.
“We study spiking neural networks, which are systems that learn much as living brains do,” said Los Alamos National Laboratory computer scientist Yijing Watkins. “We were fascinated by the prospect of training a neuromorphic processor in a manner analogous to how humans and other biological systems learn from their environment during childhood development.”
It was as though we were giving the neural networks the equivalent of a good night’s rest
Watkins and her research team found that the network simulations became unstable after continuous periods of unsupervised learning. When they exposed the networks to states that are analogous to the waves that living brains experience during sleep, stability was restored. “It was as though we were giving the neural networks the equivalent of a good night’s rest,” said Watkins.
The discovery came about as the research team worked to develop neural networks that closely approximate how humans and other biological systems learn to see. The group initially struggled with stabilizing simulated neural networks undergoing unsupervised dictionary training, which involves classifying objects without having prior examples to compare them to.
“The issue of how to keep learning systems from becoming unstable really only arises when attempting to utilize biologically realistic, spiking neuromorphic processors or when trying to understand biology itself,” said Los Alamos computer scientist and study coauthor Garrett Kenyon. “The vast majority of machine learning, deep learning, and AI researchers never encounter this issue because in the very artificial systems they study they have the luxury of performing global mathematical operations that have the effect of regulating the overall dynamical gain of the system.”
The researchers characterize the decision to expose the networks to an artificial analog of sleep as nearly a last ditch effort to stabilize them. They experimented with various types of noise, roughly comparable to the static you might encounter between stations while tuning a radio. The best results came when they used waves of so-called Gaussian noise, which includes a wide range of frequencies and amplitudes. They hypothesize that the noise mimics the input received by biological neurons during slow-wave sleep. The results suggest that slow-wave sleep may act, in part, to ensure that cortical neurons maintain their stability and do not hallucinate.
The groups’ next goal is to implement their algorithm on Intel’s Loihi neuromorphic chip. They hope allowing Loihi to sleep from time to time will enable it to stably process information from a silicon retina camera in real time. If the findings confirm the need for sleep in artificial brains, we can probably expect the same to be true of androids and other intelligent machines that may come about in the future.
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Neuromorphic processor
- Sandia Pushes The Neuromorphic AI Envelope With Hala Point “Supercomputer”
Not many devices in the datacenter have been etched with the Intel 4 process, which is the chip maker’s spin on 7 nanometer extreme ultraviolet immersion ...
- AI Chip Market Report By DataHorizzon Research. CAGR 40.6% By 2032
Market Study on AI Chip Market.Fort Collins, Colorado, April 24, 2024 (GLOBE NEWSWIRE) -- Artificial intelligence has become a beacon of innovation for rapid technological advancement. As AI ...
- Intel aims for sustainable AI with world’s largest neuromorphic system
Intel says it has built the world’s largest neuromorphic system. Code-named Hala Point, the large-scale neuromorphic system, initially deployed at Sandia National Laboratories, utilises Intel’s Loihi ...
- Intel Develops World's Largest Neuromorphic Computer System for Advancing AI Research
Intel has developed the world's largest neuromorphic computer system, a hardware stack modeled after the complexities of the human brain.
- Intel Unveils World’s Largest Neuromorphic Computer, Drawing Inspiration from Human Brain to Train AI
Continue reading Mike Davies, the visionary director of Intel Labs’ Neuromorphic Computing Lab, underscores the critical necessity for more efficient AI models in today’s rapidly evolving landscape.
Go deeper with Google Headlines on:
Neuromorphic processor
[google_news title=”” keyword=”neuromorphic processor” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Artificial brains
- Fiverr Is My Top Artificial Intelligence (AI) Stock to Buy Now. Here's Why.
The freelance services marketplace's stock has taken a beating in the last three years, but the business just kept growing.
- AI helps researchers uncover gut-brain interactions in Alzheimer's
AI technology reveals more information about the gut-brain health link in Alzheimer's, suggesting new pathways for research around treatments.
- Scientists use salt, water to prove human brain-like computer can exist
The artificial synapse known as an iontronic memristor functions as a microchannel filled with a solution of water and salt.
- Are artificial sweeteners safe for you?
The biggest question, probably, is that even though artificial sweeteners offer a solution for calorie trackers, are they really safe? What are artificial sweeteners? Said to be hundreds of times ...
- First experimental proof for brain-like computer with water and salt
Theoretical physicists at Utrecht University, together with experimental physicists at Sogang University in South Korea, have succeeded in building an artificial synapse. This synapse works with water ...
Go deeper with Google Headlines on:
Artificial brains
[google_news title=”” keyword=”artificial brains” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]