A new system combines video of a scene from multiple cameras to created 4D visualizations. This makes it possible to view the scene from a variety of angles, place people into new scenes or, in this case, remove someone from a scene.
Carnegie Mellon Approach Requires Neither Studio nor Specialized Cameras
Researchers at Carnegie Mellon University have demonstrated that they can combine iPhone videos shot “in the wild” by separate cameras to create 4D visualizations that allow viewers to watch action from various angles, or even erase people or objects that temporarily block sight lines.
Imagine a visualization of a wedding reception, where dancers can be seen from as many angles as there were cameras, and the tipsy guest who walked in front of the bridal party is nowhere to be seen.
The videos can be shot independently from variety of vantage points, as might occur at a wedding or birthday celebration, said Aayush Bansal, a Ph.D. student in CMU’s Robotics Institute. It also is possible to record actors in one setting and then insert them into another, he added.
Bansal and his colleagues worked around that limitation by using convolutional neural nets (CNNs), a type of deep learning program that has proven adept at analyzing visual data. They found that scene-specific CNNs could be used to compose different parts of the scene.
The CMU researchers demonstrated their method using up to 15 iPhones to capture a variety of scenes — dances, martial arts demonstrations and even flamingos at the National Aviary in Pittsburgh.
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
4D visualization
- Digital Maps - A $47.8 Billion Market Opportunity by 2029: Increase in Focus on SDKs and APIs, Empowering Indoor Mapping Solutions
Some of the significant vendors offering digital map solutions across the globe include Google (US), Apple (US), TomTom (Netherlands), Esri (US), Here Technologies (Netherlands), Nearmap (Australia), ...
- Medical Illustration Bachelor of Fine Arts Degree
A medical illustrator is a professional artist with advanced education in the sciences (biology, human anatomy, physiology) and in art and design (illustration, 2D/3D/4D digital design, animation, ...
- How to Visualize Job Interview Success
Golf superstar Tiger Woods incorporates visualization into his pre-swing routine. Phil Jackson, head coach of the Los Angeles Lakers, implores his players to visualize victory before games.
- The Best Games That Work In 4D
Titles like 4D Toys, Magic 120-Cell, and 4D Chess allow players to engage with the complexities of the fourth dimension through puzzles and gameplay. The inclusion of 4D elements in games like 4D ...
- Cinema 4D: everything you need to know
Getting started in Cinema 4D can feel daunting, as this 3D software can do it all, and does it all so well. This long-standing 3D modelling, animation and simulation program sits alongside the ...
Go deeper with Google Headlines on:
4D visualization
[google_news title=”” keyword=”4D visualization” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Convolutional neural nets
- A Psychologist’s Guide To ‘Baby Language’—Decoding The 5 Baby Cries
Not knowing what your baby wants or needs can be incredibly overwhelming. Here’s how you can learn their language.
- AI model identifies over 500 toxic chemicals in e-liquids, revealing vaping’s hidden dangers
In a recent review published in the Scientific Reports, a group of authors used a graph-convolutional neural network (NN) to predict and analyze the thermal decomposition products of e-liquid flavors, ...
- Degradation-adaptive neural network for jointly single image dehazing and desnowing
In harsh winter scenes, the captured images often suffer from haze and snow degradations simultaneously, which significantly affect the performance of high-level computer vision tasks. Most existing ...
- Feds fund research into how AI can help monitor the marbled murrelet
() - Artificial intelligence analysis of data gathered by acoustic recording devices offers promise in monitoring the marbled murrelet and other difficult-to-study species, a research paper by Oregon ...
- PV module fault detection technique based on convolutional neural network
An international research team has used the convolutional neural network (CNN) deep learning algorithm to identify faults in solar panels. Its work showed the proposed technique has a high degree of ...
Go deeper with Google Headlines on:
Convolutional neural nets
[google_news title=”” keyword=”convolutional neural nets” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]