The researchers’ self-driving neural network gets into very few accidents in their virtual town.
Self-driving cars are powered by machine learning algorithms that require vast amounts of driving data in order to function safely. But if self-driving cars could learn to drive in the same way that babies learn to walk – by watching others around them and trying to mimic certain movements – they would require far less data. Hariri Institute Junior Faculty Fellow Eshed Ohn-Bar, an assistant professor of electrical and computer engineering, developed an efficient, safe, and collaborative paradigm for watching and predicting other cars’ actions to train autonomous vehicles.
Ohn-Bar and Jimuyang Zhang, a PhD student in electrical and computer engineering, presented their findings recently at the 2021 Conference on Computer Vision and Pattern Recognition (CVPR 2021).
The idea for the team’s training paradigm came from a desire to increase data-sharing and cooperation among researchers. Autonomous vehicles require many hours of driving data to learn how to drive safely, and some of the world’s largest car companies keep their vast data private to prevent competition. “There are a lot of autonomous driving companies and each company goes through the same process of taking cars, putting sensors on them, paying drivers to drive the vehicles, collecting data, and teaching the cars to drive,” said Ohn-Bar. Sharing driving data could help companies create safe autonomous vehicles faster, allowing everyone in society to benefit from the cooperation. Ohn-Bar highlights that no one company can solve this problem today on their own because current AI systems require so much data to work well. “Billions of miles are just a drop in an ocean of real-world events and diversity. Yet, a missing data sample could lead to unsafe behavior and a potential crash, and billions of miles are just a drop in an ocean of real-world events and diversity,” Ohn-Bar said.
The researchers’ proposed machine learning algorithm leverages data from other cars. The algorithm estimates the viewpoints and blind spots of other cars in the area to create a map that has a bird’s eye view of the surrounding environment. These maps help self-driving cars detect obstacles, like other cars or pedestrians, and can be used to understand how the other cars turn, negotiate, and yield without crashing into anything. A self-driving neural network is then trained by translating the actions of surrounding vehicles into the autonomous vehicle’s own frame of reference. These other cars may be human-driven vehicles without any sensors, or another company’s auto-piloted vehicles. Since observations from all of the surrounding cars in a scene are central to the algorithm’s training, this “learning by watching” paradigm encourages data sharing, and consequently safer autonomous vehicles.
Ohn-Bar and Zhang tested their self-driving cars in two virtual towns — one with straightforward turns and obstacles similar to their training environment, and another with unexpected twists like five-way intersections. In both scenarios, the researchers found that their self-driving neural network gets into very few accidents. With just one hour of driving data to train the machine learning algorithm, the autonomous vehicles arrived safely at their destinations 92 percent of the time. “While previous best methods required hours, we were surprised that our method could learn to drive safely with just ten minutes of driving data,” said Ohn-Bar.
While these results are promising, Ohn-Bar said that there are still several open challenges in dealing with intricate urban settings. “Accounting for drastically varying perspectives across the watched vehicles, noise and occlusion in sensor measurements, and various drivers is very difficult,” said Ohn-Bar.
The team’s paradigm for teaching autonomous vehicles how to self-drive could be used in other technologies as well. “This machine learning paradigm can be applied to many other systems,” said Ohn-Bar, “Delivery robots or even drones could all learn by watching other AI systems in their environment.”
Original Article: Cars that learn how to drive themselves by watching other cars
More from: Boston University
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Training autonomous vehicles
- Multi Level Group, EHang and ADIO seal strategic collaboration to drive eVTOL development in the UAE
Collaboration with global eVTOL player EHang announced during Abu Dhabi’s inaugural DRIFTx eventAgreement aims to promote eVTOLs to transform the ...
- DARPA puts sinister green eyes on its robot tank
Messing with your mind DARPA's latest step into the world of autonomous vehicles a real eye-opener—literally. They've unleashed their new robotic beasts as part of the Robotic Autonomy in Complex ...
- DARPA’s Experimental RACER Heavy Platform is the Massive New Autonomous Fleet Vehicle of the Future
DARPA says it has successfully conducted tests with an extra-large new fleet vehicle as part of its innovative RACER program.
- Autonomous cars coming to Australia with upcoming legislation
The organisation assigned responsibility for the actions of an autonomous car would be required to ensure the vehicle meets all road rules, make efforts to prevent the vehicle being hacked by third ...
- Robotaxi company Waymo testing self-driving cars in Atlanta
ATLANTA — Some new technology is headed to the streets of Atlanta. Waymo, a self-driving car company, is now testing its robotaxis in Atlanta. Waymo announced that it began testing the autonomous ...
Go deeper with Google Headlines on:
Training autonomous vehicles
[google_news title=”” keyword=”training autonomous vehicles” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Self-driving cars
- Tesla’s Autopilot and Full Self-Driving linked to hundreds of crashes, dozens of deaths
In total, NHTSA investigated 956 crashes, starting in January 2018 and extending all the way until August 2023. Of those crashes, some of which involved other vehicles striking th ...
- Young pedestrians, self-driving vehicles: What’s the safest scenario for crossing the road?
Crossing roads for children can be a risky calculation, especially when the vehicles are self-driven. In a new study, University of Iowa researchers determined pre-teenage children are safest when sel ...
- Self-Driving Waymo Spotted Plowing Down Wrong Side of Street
A video making its rounds on social media shows a self-driving Waymo car bombing down the wrong side of the road in downtown San Francisco — yet another glaring incident involving the company's ...
- 1st self-driving car that 'lets you take your eyes off the road' goes on sale in the US — and it's not a Tesla
Mercedes-Benz has sold at least one of its new vehicles fitted with its Drive Pilot autonomous driving software, which lets you take your hands off the steering wheel and your eyes off the road.
- Some Mercedes Self-Driving Cars Won't Require You to Even Watch the Road
The cars are only available in California and Nevada and will only autonomously drive under certain circumstances.
Go deeper with Google Headlines on:
Self-driving cars
[google_news title=”” keyword=”self-driving cars” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]