A new system combines video of a scene from multiple cameras to created 4D visualizations. This makes it possible to view the scene from a variety of angles, place people into new scenes or, in this case, remove someone from a scene.
Carnegie Mellon Approach Requires Neither Studio nor Specialized Cameras
Researchers at Carnegie Mellon University have demonstrated that they can combine iPhone videos shot “in the wild” by separate cameras to create 4D visualizations that allow viewers to watch action from various angles, or even erase people or objects that temporarily block sight lines.
Imagine a visualization of a wedding reception, where dancers can be seen from as many angles as there were cameras, and the tipsy guest who walked in front of the bridal party is nowhere to be seen.
The videos can be shot independently from variety of vantage points, as might occur at a wedding or birthday celebration, said Aayush Bansal, a Ph.D. student in CMU’s Robotics Institute. It also is possible to record actors in one setting and then insert them into another, he added.
Bansal and his colleagues worked around that limitation by using convolutional neural nets (CNNs), a type of deep learning program that has proven adept at analyzing visual data. They found that scene-specific CNNs could be used to compose different parts of the scene.
The CMU researchers demonstrated their method using up to 15 iPhones to capture a variety of scenes — dances, martial arts demonstrations and even flamingos at the National Aviary in Pittsburgh.
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
4D visualization
- Advanced Visualization Market Size, Industry Share, Competitive Analysis, Upcoming Trend, SWOT Analysis, Development Growth And Opportunity Until 2031
Kenneth Research has examined the statistical and analytical approach that is required for the growth of Advanced Visualization Market ...
- Advanced Visualization Market 2022 Research Consumption, Companies, Industry Report Analysis and Future Demand 2030
For example, the advances in the 3D and 4D ultrasound technology now offer capabilities ranging from better visualization of congenital birth defects to dynamic and multi-planar view of the fetal ...
- SAAGA SmartKids, a new learning Edtech App for children in the K to 12 segments
New Delhi [India] July 28 ANISRV SAAGA SmartKids introduces its unique and affordable learning app in the K to 12 segments Being an advanced learning tool SAAGA SmartKids helps and guides children in ...
- Medical Image Analysis Software Market worth $4.5 billion by 2027 – Exclusive Report by MarketsandMarkets™
According to the new market research report “Medical Image Analysis Software Market by Type (Integrated), Images (2D, 3D, 4D), Modality ... and accurate real-time visualization of the human ...
- Can Holograms Change 3D Medical Imaging?
“There's a great need in the world of medical imaging to have 3D/4D holographic images that are accurate and ... “With currently available 3D stereoscopic visualization solutions, including augmented ...
Go deeper with Google Headlines on:
4D visualization
Go deeper with Bing News on:
Convolutional neural nets
- Siberian Federal University: Russian Scientists Have Taught a neural network to read handwritten Letters of the Russian Alphabet
With the development of IT, the importance of fast and high-quality conversion of handwritten text into a digital printed version is growing in order to make it easier to copy, edit or extract data ...
- PhD Oral Exam - Abdullah Al-Amaren, Electrical & Computer Engineering
The proposed network is experimented on different datasets and is ... With this objective in mind, in the second part, we develop deep residual convolutional neural networks based on the VGG-16 ...
- ‘Artificial synapse’ could make neural networks work more like brains
Networks of nanoscale resistors that work in a similar way to nerve cells in the body could offer advantages over digital machine learning ...
- Google & DeepMind Study the Interactions Between Scaling Laws and Neural Network Architectures
State-of-the-art AI models have ballooned to billions of parameters in recent years. Although the machine learning (ML) community has shown keen interest in the scaling properties of transformer-based ...
- Researchers Use Machine Learning for Photo-Based Roast Analysis App
A new study from researchers in Thailand presents a future in which precise roast levels may be obtained in real time through the snap of a smartphone photo. For the research project, a team at ...
