Teaching advanced systems to learn like humans could help scientists better understand an AI’s behavior
New study measures effectiveness of machine learning method
Memories can be as tricky to hold onto for machines as they can be for humans. To help understand why artificial agents develop holes in their own cognitive processes, electrical engineers at The Ohio State University have analyzed how much a process called “continual learning” impacts their overall performance.
Continual learning is when a computer is trained to continuously learn a sequence of tasks, using its accumulated knowledge from old tasks to better learn new tasks.
Yet one major hurdle scientists still need to overcome to achieve such heights is learning how to circumvent the machine learning equivalent of memory loss – a process which in AI agents is known as “catastrophic forgetting.” As artificial neural networks are trained on one new task after another, they tend to lose the information gained from those previous tasks, an issue that could become problematic as society comes to rely on AI systems more and more, said Ness Shroff, an Ohio Eminent Scholar and professor of computer science and engineering at The Ohio State University.
“As automated driving applications or other robotic systems are taught new things, it’s important that they don’t forget the lessons they’ve already learned for our safety and theirs,” said Shroff. “Our research delves into the complexities of continuous learning in these artificial neural networks, and what we found are insights that begin to bridge the gap between how a machine learns and how a human learns.”
Researchers found that in the same way that people might struggle to recall contrasting facts about similar scenarios but remember inherently different situations with ease, artificial neural networks can recall information better when faced with diverse tasks in succession, instead of ones that share similar features, Shroff said.
The team, including Ohio State postdoctoral researchers Sen Lin and Peizhong Ju and professors Yingbin Liang and Shroff, will present their research this month at the 40th annual International Conference on Machine Learning in Honolulu, Hawaii, a flagship conference in machine learning.
While it can be challenging to teach autonomous systems to exhibit this kind of dynamic, lifelong learning, possessing such capabilities would allow scientists to scale up machine learning algorithms at a faster rate as well as easily adapt them to handle evolving environments and unexpected situations. Essentially, the goal for these systems would be for them to one day mimic the learning capabilities of humans.
Traditional machine learning algorithms are trained on data all at once, but this team’s findings showed that factors like task similarity, negative and positive correlations, and even the order in which an algorithm is taught a task matter in the length of time an artificial network retains certain knowledge.
For instance, to optimize an algorithm’s memory, said Shroff, dissimilar tasks should be taught early on in the continual learning process. This method expands the network’s capacity for new information and improves its ability to subsequently learn more similar tasks down the line.
Their work is particularly important as understanding the similarities between machines and the human brain could pave the way for a deeper understanding of AI, said Shroff.
“Our work heralds a new era of intelligent machines that can learn and adapt like their human counterparts,” he said.
More from: Ohio State University
The Latest Updates from Bing News
Go deeper with Bing News on:
- Introducing the ROVEMA E-Learning Platform: PackPro Learning Hub
ROVEMA believes that a skilled and knowledgeable team is the foundation of packaging excellence. Packaging machinery operators are the first line of defense against unplanned downtime. By investing in ...
- Deep Learning Discovers Millions Of New Materials (Google)
A technical paper titled “Scaling deep learning for materials discovery” was published by researchers at Google DeepMind and Google Research. Abstract: “Novel functional materials enable fundamental ...
- CSU, PNP Region 2 ink ties for continuous learning
THE Cagayan Valley-based Cagayan State University (CSU) signed a memorandum of understanding (MoU) with the Philippine National Police Region 2 Office (PNP-PRO2) to provide quality education. The MoU, ...
- From India To The World: GCCs' Path To Continuous Innovation And Value Creation
In my previous article, I delved into the ways in which Indian global capability centers (GCCs) can enhance their strategic value with artificial intelligence. However, it's vital to understand that ...
- Coming soon: Summer School, rooted in 100 years of lifelong learning
Summer School will celebrate its 74th ‘edition’, continuing UCT’s century-long tradition of continuous lifelong learning.
Go deeper with Bing News on:
- UN refugee chief: An exodus from Gaza would be ‘catastrophic’
GENEVA, Dec 7 — An exodus of Palestinians from Gaza into other countries in the region would be “catastrophic”, the United Nations refugee chief Filippo Grandi told AFP in an interview yesterday, ...
- Israel-Hamas war live: Netanyahu advisor calls operation at Hamas leader’s home in Gaza a ‘symbolic victory’ for Israel
Netanyahu says Israeli forces are ‘encircling’ the Gaza house of top Hamas leader, Yahya Sinwar ...
- 🔴 LIVE UPDATES: Palestinians bury the dead in mass graves as Israel continues a mad bombardment campaign in Gaza
Israel’s widening air and ground war in southern Gaza has displaced tens of thousands more Palestinians and worsened the territory’s dire humanitarian conditions. The war is preventing the ...
- Exodus Of Palestinians From Gaza Would Be "Catastrophic": UN Refugee Chief
An exodus of Palestinians from Gaza into other countries in the region would be "catastrophic", the United Nations refugee chief Filippo Grandi told AFP in an interview Wednesday, stressing the need ...
- UNHCR's Grandi: An exodus of Palestinians from Gaza would be 'catastrophic'
The United Nations High Commissioner for Refugees, Filippo Grandi, said in an interview with Agence France-Presse on Wednesday that the displacement of Palestinians from Gaza to neighboring countries ...