via Caltech
Engineers at Caltech, ETH Zurich, and Harvard are developing an artificial intelligence (AI) that will allow autonomous drones to use ocean currents to aid their navigation, rather than fighting their way through them.
“When we want robots to explore the deep ocean, especially in swarms, it’s almost impossible to control them with a joystick from 20,000 feet away at the surface. We also can’t feed them data about the local ocean currents they need to navigate because we can’t detect them from the surface. Instead, at a certain point we need ocean-borne drones to be able to make decisions about how to move for themselves,” says John O. Dabiri (MS ’03, PhD ’05), the Centennial Professor of Aeronautics and Mechanical Engineering and corresponding author of a paper about the research that was published by Nature Communications on December 8.
To tackle this challenge, researchers turned to reinforcement learning (RL) networks. Compared to conventional neural networks, reinforcement learning networks do not train on a static data set but rather train as fast as they can collect experience. This scheme allows them to exist on much smaller computers—for the purposes of this project, the team wrote software that can be installed and run on a Teensy—a 2.4-by-0.7-inch microcontroller that anyone can buy for less than $30 on Amazon and only uses about a half watt of power.
Using a computer simulation in which flow past an obstacle in water created several vortices moving in opposite directions, the team taught the AI to navigate in such a way that it took advantage of low-velocity regions in the wake of the vortices to coast to the target location with minimal power used. To aid its navigation, the simulated swimmer only had access to information about the water currents at its immediate location, yet it soon learned how to exploit the vortices to coast toward the desired target. In a physical robot, the AI would similarly only have access to information that could be gathered from an onboard gyroscope and accelerometer, which are both relatively small and low-cost sensors for a robotic platform.
This kind of navigation is analogous to the way eagles and hawks ride thermals in the air, extracting energy from air currents to maneuver to a desired location with the minimum energy expended. Surprisingly, the researchers discovered that their reinforcement learning algorithm could learn navigation strategies that are even more effective than those thought to be used by real fish in the ocean.
“We were initially just hoping the AI could compete with navigation strategies already found in real swimming animals, so we were surprised to see it learn even more effective methods by exploiting repeated trials on the computer,” says Dabiri.
Original Article: Engineers Teach AI to Navigate Ocean with Minimal Energy
More from: California Institute of Technology | ETH Zürich | Harvard University
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Ocean-borne drones
- DARPA's autonomous 'Manta Ray' drone can glide through ocean depths undetected
Northrop Grumman Corporation has built its Manta Ray uncrewed underwater vehicle, which will operate long-duration missions and carry payloads into the ocean depths in partnership with DARPA.
- Ukraine's Sea Drones Have Inflicted $500M in Damage on Russian Fleet: Kyiv
Kyiv's military intelligence said Friday that a Magura V5 maritime drone is the "best weapon available" to strike Russia's Black Sea Fleet.
- Frozen Ocean, Solid Science: UAF Drones Measure Ice Thickness
UAF and Boise State University test aerial drones’ ability to measure sea ice thickness and snow depth near Utqiaġvik.
- Navy tests surface drone that can dive for days at West African exercise
The U.S. Navy is testing an autonomous drone that can operate above and below the surface in a bid to help African countries battling piracy, the illicit drug trade and other illegal activities in the ...
- Using high-tech drones, Russia is pressing aerial advantage against beleaguered Ukrainian artillery
Across the hills and valleys of the east, Ukrainian artillery units play a cat-and-mouse game with Russian drones hunting high-value artillery weapons such as this self-propelled Panzerhaubitze 2000.
Go deeper with Google Headlines on:
Ocean-borne drones
[google_news title=”” keyword=”ocean-borne drones” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Reinforcement learning
- Breaking the black box: Chinese scientists solve a ‘big tough challenge’ to the US Air Force’s AI project
Prevailing AI technologies, such as deep reinforcement learning and large language models, operate like a black box: tasks enter one end and results emerge from the other, while h ...
- What Is a Large Language Model (LLM) and How Does It Affect You
Large language models (LLMs) play a big role in AI development. Discover what LLMs are and how they are reshaping how we use technology.
- MIT's Mighty Morphing Bots Set to Stretch and Squeeze into the Future!
MIT researchers have created a control algorithm that allows soft robots to change shape for tasks such as navigating tight spaces or manipulating objects.
- Exploration-focused training lets robotics AI immediately handle new tasks
Reinforcement-learning algorithms in systems like Chat GPT or Google’s Gemini can work wonders, but they usually need hundreds of thousands of shots at a task before they get good at it. That’s why it ...
- A better way to control shape-shifting soft robots
A new machine-learning technique can train and control a reconfigurable soft robot that can dynamically change its shape to complete a task. The researchers also built a simulator that can evaluate ...
Go deeper with Google Headlines on:
Reinforcement learning
[google_news title=”” keyword=”reinforcement learning” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]