The researchers’ self-driving neural network gets into very few accidents in their virtual town.
Self-driving cars are powered by machine learning algorithms that require vast amounts of driving data in order to function safely. But if self-driving cars could learn to drive in the same way that babies learn to walk – by watching others around them and trying to mimic certain movements – they would require far less data. Hariri Institute Junior Faculty Fellow Eshed Ohn-Bar, an assistant professor of electrical and computer engineering, developed an efficient, safe, and collaborative paradigm for watching and predicting other cars’ actions to train autonomous vehicles.
Ohn-Bar and Jimuyang Zhang, a PhD student in electrical and computer engineering, presented their findings recently at the 2021 Conference on Computer Vision and Pattern Recognition (CVPR 2021).
The idea for the team’s training paradigm came from a desire to increase data-sharing and cooperation among researchers. Autonomous vehicles require many hours of driving data to learn how to drive safely, and some of the world’s largest car companies keep their vast data private to prevent competition. “There are a lot of autonomous driving companies and each company goes through the same process of taking cars, putting sensors on them, paying drivers to drive the vehicles, collecting data, and teaching the cars to drive,” said Ohn-Bar. Sharing driving data could help companies create safe autonomous vehicles faster, allowing everyone in society to benefit from the cooperation. Ohn-Bar highlights that no one company can solve this problem today on their own because current AI systems require so much data to work well. “Billions of miles are just a drop in an ocean of real-world events and diversity. Yet, a missing data sample could lead to unsafe behavior and a potential crash, and billions of miles are just a drop in an ocean of real-world events and diversity,” Ohn-Bar said.
The researchers’ proposed machine learning algorithm leverages data from other cars. The algorithm estimates the viewpoints and blind spots of other cars in the area to create a map that has a bird’s eye view of the surrounding environment. These maps help self-driving cars detect obstacles, like other cars or pedestrians, and can be used to understand how the other cars turn, negotiate, and yield without crashing into anything. A self-driving neural network is then trained by translating the actions of surrounding vehicles into the autonomous vehicle’s own frame of reference. These other cars may be human-driven vehicles without any sensors, or another company’s auto-piloted vehicles. Since observations from all of the surrounding cars in a scene are central to the algorithm’s training, this “learning by watching” paradigm encourages data sharing, and consequently safer autonomous vehicles.
Ohn-Bar and Zhang tested their self-driving cars in two virtual towns — one with straightforward turns and obstacles similar to their training environment, and another with unexpected twists like five-way intersections. In both scenarios, the researchers found that their self-driving neural network gets into very few accidents. With just one hour of driving data to train the machine learning algorithm, the autonomous vehicles arrived safely at their destinations 92 percent of the time. “While previous best methods required hours, we were surprised that our method could learn to drive safely with just ten minutes of driving data,” said Ohn-Bar.
While these results are promising, Ohn-Bar said that there are still several open challenges in dealing with intricate urban settings. “Accounting for drastically varying perspectives across the watched vehicles, noise and occlusion in sensor measurements, and various drivers is very difficult,” said Ohn-Bar.
The team’s paradigm for teaching autonomous vehicles how to self-drive could be used in other technologies as well. “This machine learning paradigm can be applied to many other systems,” said Ohn-Bar, “Delivery robots or even drones could all learn by watching other AI systems in their environment.”
Original Article: Cars that learn how to drive themselves by watching other cars
More from: Boston University
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Training autonomous vehicles
- Chinese Car Giant Using Israeli Tech To Test Autonomous Vehicles
An Israeli startup that tests the behavior of driverless cars has embarked on a strategic partnership with major Chinese car maker Geely ...
- Wrong way Waymo: A viral video shows a driverless car turning into oncoming traffic
A video shared thousands of times on social media shows the car driving into oncoming traffic in Tempe. However, an ASU professor says the cars are still safe.
- Exclusive: Wayve co-founder Alex Kendall on the autonomous future for cars and robots
U.K.-based autonomous vehicle startup Wayve started life as a software platform ... about how the company has been training the model, the new fundraise, licensing plans, and the wider self-driving ...
- Interested in Self-Driving Cars? This Company Will Be the Biggest Winner (Hint: It's Not Tesla).
Tesla, Alphabet, and General Motors are all pursuing self-driving cars, but another company is playing a major role in the development of autonomous vehicles.
- AI Is Gathering a Growing Amount of Training Data Inside Virtual Worlds
To anyone living in a city where autonomous vehicles operate, it would seem they need a lot of practice. Robotaxis travel millions of miles a year on public roads in an effort to gather data from ...
Go deeper with Google Headlines on:
Training autonomous vehicles
[google_news title=”” keyword=”training autonomous vehicles” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Self-driving cars
- Geely, Foretellix partner to jump-start self driving car development
Chinese automaker Geely and Israeli auto safety technology startup Foretellix formed a strategic partnership to accelerate safe large-scale development of self-driving vehicles, the two companies said on Tuesday.
- Interested in Self-Driving Cars? This Company Will Be the Biggest Winner (Hint: It's Not Tesla).
Tesla, Alphabet, and General Motors are all pursuing self-driving cars, but another company is playing a major role in the development of autonomous vehicles.
Go deeper with Google Headlines on:
Self-driving cars
[google_news title=”” keyword=”self-driving cars” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]