UC Berkeley researchers have developed algorithms that enable robots to learn motor tasks through trial and error using a process that more closely approximates the way humans learn, marking a major milestone in the field of artificial intelligence.
They demonstrated their technique, a type of reinforcement learning, by having a robot complete various tasks — putting a clothes hanger on a rack, assembling a toy plane, screwing a cap on a water bottle, and more — without pre-programmed details about its surroundings.
“What we’re reporting on here is a new approach to empowering a robot to learn,” said Professor Pieter Abbeel of UC Berkeley’s Department of Electrical Engineering and Computer Sciences. “The key is that when a robot is faced with something new, we won’t have to reprogram it. The exact same software, which encodes how the robot can learn, was used to allow the robot to learn all the different tasks we gave it.”
The latest developments will be presented on Thursday, May 28, in Seattle at the International Conference on Robotics and Automation (ICRA). Abbeel is leading the project with fellow UC Berkeley faculty member Trevor Darrell, director of the Berkeley Vision and Learning Center. Other members of the research team are postdoctoral researcher Sergey Levine and Ph.D. student Chelsea Finn.
The work is part of a new People and Robots Initiative at UC’s Center for Information Technology Research in the Interest of Society (CITRIS). The new multi-campus, multidisciplinary research initiative seeks to keep the dizzying advances in artificial intelligence, robotics and automation aligned to human needs.
“Most robotic applications are in controlled environments where objects are in predictable positions,” said Darrell. “The challenge of putting robots into real-life settings, like homes or offices, is that those environments are constantly changing. The robot must be able to perceive and adapt to its surroundings.”
Neural inspiration
Conventional, but impractical, approaches to helping a robot make its way through a 3D world include pre-programming it to handle the vast range of possible scenarios or creating simulated environments within which the robot operates.
Instead, the UC Berkeley researchers turned to a new branch of artificial intelligence known as deep learning, which is loosely inspired by the neural circuitry of the human brain when it perceives and interacts with the world.
“For all our versatility, humans are not born with a repertoire of behaviors that can be deployed like a Swiss army knife, and we do not need to be programmed,” said Levine. “Instead, we learn new skills over the course of our life from experience and from other humans. This learning process is so deeply rooted in our nervous system, that we cannot even communicate to another person precisely how the resulting skill should be executed. We can at best hope to offer pointers and guidance as they learn it on their own.”
In the world of artificial intelligence, deep learning programs create “neural nets” in which layers of artificial neurons process overlapping raw sensory data, whether it be sound waves or image pixels. This helps the robot recognize patterns and categories among the data it is receiving. People who use Siri on their iPhones, Google’s speech-to-text program or Google Street View might already have benefited from the significant advances deep learning has provided in speech and vision recognition.
Applying deep reinforcement learning to motor tasks has been far more challenging, however, since the task goes beyond the passive recognition of images and sounds.
“Moving about in an unstructured 3D environment is a whole different ballgame,” said Finn. “There are no labeled directions, no examples of how to solve the problem in advance. There are no examples of the correct solution like one would have in speech and vision recognition programs.”
Read more: New ‘deep learning’ technique enables robot mastery of skills via trial and error
The Latest on: Deep Learning
[google_news title=”” keyword=”Deep Learning” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Deep Learning
- Researchers use deep learning to improve ultrasound localization microscopyon May 17, 2024 at 12:29 pm
Researchers at the University of Illinois have a technique to make ultrasound localization microscopy more practical for clinical settings.
- Astronomers detect rare neutral atomic-carbon absorbers with deep neural networkon May 17, 2024 at 7:51 am
Recently, an international team led by Prof. Ge Jian from the Shanghai Astronomical Observatory of the Chinese Academy of Sciences conducted a search for rare weak signals in quasar spectral data ...
- Are You Doing 'Deep Fake' Marketing? Consider Using a Scorecardon May 16, 2024 at 11:21 am
How can in-house counsel swiftly and competently assess legal risk for newly minted AI-driven campaigns? The answer lies in striking a balance of acceptable levels of legal risk, as defined within ...
- Revolutionising data security in IoT: A Deep Learning approachon May 16, 2024 at 5:35 am
Discover how a groundbreaking deep learning approach, rooted in Cyber Physical Systems (CPS), is revolutionizing IoT data security. By harnessing the power of advanced algorithms and ...
- Into The Deep: How Businesses And Consumers Can Stay Vigilant In The Deep Fakes Eraon May 15, 2024 at 4:45 am
The developments regarding AI and deep fakes call for you to be more vigilant in trusting what you see on the internet—even more so if you are running a business.
- Deep Learning Model Using Transthoracic Echocardiograms Can ID A-Fibon May 14, 2024 at 11:30 pm
A deep learning model using transthoracic echocardiograms (TTEs) can predict patients with active or occult atrial fibrillation (AF), according to a study published online April 13 in npj Digital ...
- Machine learning sheds light on gene transcriptionon May 14, 2024 at 6:35 am
A team led by researchers at UT Southwestern Medical Center has developed deep learning models to identify a simple set of rules that govern the activity of promoters—regions of DNA that initiate the ...
- Deep learning framework predicts drug effectiveness, treatment outcomeson May 13, 2024 at 6:57 am
New deep learning approach outperformed seven existing models and recommended the same stroke treatments as four randomized clinical trials.
- DeepCRBP: Improved predicting function of circRNA-RBP binding sites with deep feature learningon May 12, 2024 at 5:00 pm
To address the above problems, the authors propose the DeepCRBP to identify the binding sites of circRNA-RBPs and the experimental results on the circRNA datasets indicate that DeepCRBP significantly ...
- Deep learning empowers reconfigurable intelligent surfaces in terahertz communicationon May 9, 2024 at 10:38 am
The escalating demand for wireless data traffic, driven by the proliferation of internet-of-things devices and broadband multimedia applications, has intensified the search for innovative solutions in ...
via Bing News