A maze is a popular device among psychologists to assess the learning capacity of mice or rats. But how about robots?
Can they learn to successfully navigate the twists and turns of a labyrinth? Now, researchers at the Eindhoven University of Technology (TU/e) and the Max Planck Institute for Polymer Research in Mainz, Germany, have proven they can. Their robot bases its decisions on the very system humans use to think and act: the brain. The study, which was published in Science Advances, paves the way to exciting new applications of neuromorphic devices in health and beyond.
Machine learning and neural networks have become all the rage in recent years, and quite understandably so, considering their many successes in image recognition, medical diagnosis, e-commerce and many other fields. Still though, this software-based approach to machine intelligence has its drawbacks, not least because it consumes so much power to train the algorithms.
The Lego Mindstorms EV3 robot is equipped with an organic neuromorphic brain. Click for video on how the robot learns to find the exit of a maze.
MIMICKING THE HUMAN BRAIN
This power issue is one of the reasons that researchers have been trying to develop computers that are much more energy efficient. And to find a solution many are finding inspiration in the human brain, a thinking machine unrivalled in its low power consumption due to how it combines memory and processing.
Neurons in our brain communicate with one another through so-called synapses, which are strengthened each time information flows through them. It is this plasticity that ensures that humans remember and learn.
“In our research, we have taken this model to develop a robot that is able to learn to move through a labyrinth”, explains Imke Krauhausen, PhD student at the department of Mechanical Engineering at TU/e and principal author of the paper.
“Just as a synapse in a mouse brain is strengthened each time it takes the correct turn in a psychologist’s maze, our device is ‘tuned’ by applying a certain amount of electricity. By tuning the resistance in the device, you change the voltage that control the motors. They in turn determine whether the robot turns right or left.”
SO HOW DOES IT WORK?
The robot that Krauhausen and her colleagues used for their research is a Mindstorms EV3, a robotics kit made by Lego. Equipped with two wheels, traditional guiding software to make sure it can follow a line, and a number of reflectance and touch sensors, it was sent into a 2 m2 large maze made up out of black-lined hexagons in a honeycomb-like pattern.
The robot is programmed to turn right by default. Each time it reaches a dead end or diverges from the designated path to the exit (which is indicated by visual cues), it is told to either return or turn left. This corrective stimulus is then remembered in the neuromorphic device for the next effort.
“In the end, it took our robot 16 runs to find the exit successfully,” says Krauhausen (see image). “And, what’s more, once it has learned to navigate this specific route (target path 1), it can navigate any other path that it is given in one go (target path 2). So, the knowledge it has acquired is generalizable.”
Part of the success of the robot’s ability to learn and exit the maze lies in the unique integration of sensors and motors, according to Krauhausen, who cooperated closely with the Max Planck Institute for Polymer Research in Mainz for this research. “This sensorimotor integration, in which sense and movement reinforce one another, is also very much how nature operates, so this is what we tried to emulate in our robot.”
Another clever thing about the research is the organic material used for the neuromorphic robot. This polymer (known as p(g2T-TT)) is not only stable, but it also is able to ‘retain’ a large part of the specific states in which it has been tuned during the various runs through the labyrinth. This ensures that the learned behaviour ‘sticks’, just like neurons and synapses in a human brain remember events or actions.
The use of polymer instead of silicon in the field of neuromorphic computing was pioneered by Paschalis Gkoupidenis of the Max Planck Institute for Polymer Research in Mainz and Yoeri van de Burgt of TU/e, both co-authors of the paper.
In their research (dating from 2015 and 2017), they proved that the material can be tuned in a much larger range of conduction than inorganic materials, and that it is able to ‘remember’ or store learned states for extended periods. Since then, organic devices have become a hot topic in the field of hardware-based artificial neural networks.
Polymeric materials also have the added advantage that they can be used in numerous biomedical applications. “Because of their organic nature, these smart devices can in principle be integrated with actual nerve cells. Say you lost your arm during an injury. Then you could potentially use these devices to link your body to a bionic hand,” says Krauhausen.
Another promising application of organic neuromorphic computing lies in small so-called edge computing devices where data from sensors is processed locally outside of the cloud. Van de Burgt: “This is where I see our devices going in the future, our materials will be very useful because they are easy to tune, use much less power, and are cheap to make.”
So will neuromorphic robots one day be able to play a soccer game, just like TU/e’s successful soccer robots?
Krauhausen: “In principle, that is certainly possible. But there’s a long way to go. Our robots still rely partly on traditional software to move around. And for the neuromorphic robots to execute really complex tasks, we need to build neuromorphic networks in which many devices work together in a grid. That’s something that I will be working on in the next phase of my PhD research.”
Original Article: Human-like brain helps robot out of a maze
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
- Simply Scientifico
Researchers used neuromorphic computing, which mimics brain functions by training on past data sets and learning from experience and is compatible with stretchable. THIS ROBOT CAN HELP WITH HOUSE ...
- How Intel's bleeding-edge Loihi 2 chips help robots perceive the world
but there's not a robot in the world you could send into an unfamiliar house and tell it to feed the dog; the general intelligence and adaptability of the human brain remain unrivalled. Intel's ...
- Google is testing a new robot that can program itself
Human operators can type in instructions like "pick up the yellow block" and the robot will do the rest. By Harry Guinness | Published Nov 5, 2022 7:00 AM Writing working code can be a challenge.
- Amazon enters the age of robots. What does that mean for its workers?
People have predicted robots will destroy the labour market, but Amazon believes investment in robotics could create jobs Trapped in a metal cage in a corner of a 350,000 sq ft Amazon warehouse ...
- Robots will roam a university to study “a socio-technical problem”
Will robots take over the world? Will our new machine overlords be generous gods or cruel taskmasters? A new research project isn’t going to answer these questions, but it aims to highlight how ...
Go deeper with Google Headlines on:
[google_news title=”” keyword=”neuromorphic robots” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
- Rage Against the Machine and the Narrow ’90s
When the rap-rock group took their political music to the mainstream, no one knew quite what to make of it—but they loved it all the same.
- Martin Lewis says you should never put washing machine between 4pm and 7pm
With rising cost of living impacting Brits more than ever, some have been thinking of ways they can save pennies ... Martin urged households not to use high energy appliances such as washing machines ...
- Inside the All Blacks machine: The real reason Scott Robertson is not All Blacks coach
But, in the eyes of the All Blacks, that’s not always a good thing. In part six of Inside the All Blacks Machine, ...
- Accel Entertainment: Thinking Big In Distributed Gaming
Accel's growth has been impressive. While growing debt is a concern, healthy margins and cash generation support the bull case. Read this article to learn more.
- Feeding the world by AI, machine learning and the cloud
And so that's another huge playing field for artificial intelligence, for machine learning, and for putting our data ... Laurel Ruma: That's really interesting thinking about how much data F1 ...
Go deeper with Google Headlines on:
[google_news title=”” keyword=”nano factory” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]