Researchers from CMU, the University of Sao Paulo and Facebook AI Research developed a model that enables a drone to shoot a video based on a desired emotion or viewer reaction.
A model that maps emotions to robot behavior
The pros make it look easy, but making a movie with a drone can be anything but.
First, it takes skill to fly the often expensive pieces of equipment smoothly and without crashing. And once you’ve mastered flying, there are camera angles, panning speeds, trajectories and flight paths to plan.
With all the sensors and processing power onboard a drone and embedded in its camera, there must be a better way to capture the perfect shot.
Bonatti was part of a team from CMU, the University of Sao Paulo and Facebook AI Research that developed a model that enables a drone to shoot a video based on a desired emotion or viewer reaction. The drone uses camera angles, speeds and flight paths to generate a video that could be exciting, calm, enjoyable or nerve-wracking — depending on what the filmmaker tells it.
The team presented their paper on the work at the 2021 International Conference on Robotics and Automation this month. The presentation can be viewed on YouTube.
“We are learning how to map semantics, like a word or emotion, to the motion of the camera,” Bonatti said.
But before “Lights! Camera! Action!” the researchers needed hundreds of videos and thousands of viewers to capture data on what makes a video evoke a certain emotion or feeling. Bonatti and the team collected a few hundred diverse videos. A few thousand viewers then watched 12 pairs of videos and gave them scores based on how the videos made them feel.
The researchers then used the data to train a model that directed the drone to mimic the cinematography corresponding to a particular emotion. If fast moving, tight shots created excitement, the drone would use those elements to make an exciting video when the user requested it. The drone could also create videos that were calm, revealing, interesting, nervous and enjoyable, among other emotions and their combinations, like an interesting and calm video.
“I was surprised that this worked,” said Bonatti. “We were trying to learn something incredibly subjective, and I was surprised that we obtained good quality data.”
The team tested their model by creating sample videos, like a chase scene or someone dribbling a soccer ball, and asked viewers for feedback on how the videos felt. Bonatti said that not only did the team create videos intended to be exciting or calming that actually felt that way, but they also achieved different degrees of those emotions.
The team’s work aims to improve the interface between people and cameras, whether that be helping amateur filmmakers with drone cinematography or providing on-screen directions on a smartphone to capture the perfect shot.
“This opens the door to many other applications, even outside filming or photography,” Bonatti said. “We designed a model that maps emotions to robot behavior.”
Original Article: Shoot Better Drone Videos With a Single Word
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Drone video AI
- Al Qaeda leader Ayman al-Zawahri killed in drone strike: 9/11 families react
National security correspondent Jennifer Griffin reports on successful U.S. operation in Afghanistan on ‘Special Report.’ 9/11 groups and families are cheering the death of al Qaeda leader Ayman ...
- CIA DRONE STRIKE KABUL
Get latest Cia Drone Strike Kabul news and updates. Explore Cia Drone Strike Kabul photos, videos and information on Times Now ...
- Drones pose new threats to data centre security
A new threat has emerged in the form of unmanned drones, and a different type of perimeter is necessary to protect data centre operations.
- 10 Terrifying War Drones That Give Us Chills
Unmanned Aerial Vehicles (UAV) have changed the face of warfare, from stealth reconnaissance missions to terrifying strike attacks.
- Seeing The Unseen: How Photo AI Turns Night Into Day
True Night Vision technology, developed by visionary.ai, penetrates fog, copes with glare and can handle scenes with what photographers call a “wide dynamic range” – where some parts are very bright ...
Go deeper with Google Headlines on:
Drone video AI
Go deeper with Bing News on:
- Drone Market Size In 2022 : Top Countries Data, Analysis of Key Trends, Top Manufactures, Industry Dynamics, Insights and Future Growth 2028
Aug 01, 2022 (The Expresswire) -- "Drone Market" Insights 2022 By Types, Applications, Regions and Forecast to 2028. The global Drone market size ...
- Live Updates: U.S. Drone Strike Kills Top Qaeda Leader
Ayman al-Zawahri took over leadership of the group after the death of Osama bin Laden. President Biden addressed the nation, saying, “Justice has been delivered, and this terrorist leader is no more.” ...
- DJI Mini 3 Pro review: The best pick for a small drone
The first generation Mavic Mini was a great drone in its time, packing DJI’s smart design and technology into a tiny body that falls just under the weight limit that would require registration in many ...
- Virginia from above: Our new drone feature
There are many beautiful spots in the Hampton Roads area for photographers, such as beaches, rivers and state and national parks. But there are not many places available for drone ...
- QuadAir Drone Reviews (Australia): Is Quad Air Drone Legit? Read This USA Report
The Quad Air Drone is a highly innovative and fun drone to fly. It contains some incredible features, but it also has its drawbacks that this article will discuss in-depth for users' convenience.