via Caltech
Engineers at Caltech, ETH Zurich, and Harvard are developing an artificial intelligence (AI) that will allow autonomous drones to use ocean currents to aid their navigation, rather than fighting their way through them.
“When we want robots to explore the deep ocean, especially in swarms, it’s almost impossible to control them with a joystick from 20,000 feet away at the surface. We also can’t feed them data about the local ocean currents they need to navigate because we can’t detect them from the surface. Instead, at a certain point we need ocean-borne drones to be able to make decisions about how to move for themselves,” says John O. Dabiri (MS ’03, PhD ’05), the Centennial Professor of Aeronautics and Mechanical Engineering and corresponding author of a paper about the research that was published by Nature Communications on December 8.
To tackle this challenge, researchers turned to reinforcement learning (RL) networks. Compared to conventional neural networks, reinforcement learning networks do not train on a static data set but rather train as fast as they can collect experience. This scheme allows them to exist on much smaller computers—for the purposes of this project, the team wrote software that can be installed and run on a Teensy—a 2.4-by-0.7-inch microcontroller that anyone can buy for less than $30 on Amazon and only uses about a half watt of power.
Using a computer simulation in which flow past an obstacle in water created several vortices moving in opposite directions, the team taught the AI to navigate in such a way that it took advantage of low-velocity regions in the wake of the vortices to coast to the target location with minimal power used. To aid its navigation, the simulated swimmer only had access to information about the water currents at its immediate location, yet it soon learned how to exploit the vortices to coast toward the desired target. In a physical robot, the AI would similarly only have access to information that could be gathered from an onboard gyroscope and accelerometer, which are both relatively small and low-cost sensors for a robotic platform.
This kind of navigation is analogous to the way eagles and hawks ride thermals in the air, extracting energy from air currents to maneuver to a desired location with the minimum energy expended. Surprisingly, the researchers discovered that their reinforcement learning algorithm could learn navigation strategies that are even more effective than those thought to be used by real fish in the ocean.
“We were initially just hoping the AI could compete with navigation strategies already found in real swimming animals, so we were surprised to see it learn even more effective methods by exploiting repeated trials on the computer,” says Dabiri.
Original Article: Engineers Teach AI to Navigate Ocean with Minimal Energy
More from: California Institute of Technology | ETH Zürich | Harvard University
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Ocean-borne drones
- Pedersen: Syria Treated by Many as a Space for Settling Scores
UN Special Envoy for Syria Geir Pedersen said on Thursday that Syria has become a "sort of free-for-all space for settling scores," warning that each month, trends are moving further in the wrong ...
- Kongsberg’s electric underwater drone with 15-day range nails final test
Kongsberg's Discovery's HUGIN Endurance AUV has completed its sea trials and is now ready for customer delivery.
- UNICEF: Extreme Weather Put Yemeni Children at Risk
A recent UN report has revealed that climate change provokes displacement in Yemen and contributes to poverty, conflict, violence, and exploitation, putting children at risk. “Children are most at ...
- U.S. will not participate in reprisal strike against Iran, official says
National Security Council coordinator for strategic communications John Kirby said that President Biden and Israeli Prime Minister Benjamin Netanyahu had a "good conversation." ...
- Biden in 'very tough spot' trying to stop Middle East escalation
Tensions with Benjamin Netanyahu over Israel's war on Gaza were papered over as the US president offered "ironclad" support, including shooting down Iranian drones. But the White House has made it ...
Go deeper with Google Headlines on:
Ocean-borne drones
[google_news title=”” keyword=”ocean-borne drones” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Reinforcement learning
- SenseNova 5.0: China’s latest AI model surpasses OpenAI’s GPT-4
In a new development in the sphere of artificial intelligence, China-based firm SenseTime unveiled the SenseNova 5.0. The AI model seems to have surpassed the performance of Generative Pre-trained ...
- Inside Disney Imagineering and the Tech That Could Power the Company’s $60B Parks Bet
New robots and an ominidirectional treadmill-like floor, which could help engineers walk through potential designs for new parks, are among the newer innovations.
- 8 AI Business Trends in 2024, According to Stanford Researchers
AI makes workers more productive, but we are still lacking in regulations, according to new research from Stanford University.
- ETH Zurich’s wheeled-legged robot masters urban terrain autonomously
ETH Zurich researchers use advanced learning methods to create an autonomous wheeled-legged robot's control system.
- Study finds AI can develop treatments to prevent 'superbugs'
Cleveland Clinic researchers developed an artificial intelligence (AI) model that can determine the best combination and timeline to use when prescribing drugs to treat a bacterial infection, based ...
Go deeper with Google Headlines on:
Reinforcement learning
[google_news title=”” keyword=”reinforcement learning” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]