Mathematical image processing creates a 3D movie of any scene, using just two frames from a stationary camera or microscope
Researchers at the Harvard School of Engineering and Applied Sciences (SEAS) have developed a way for photographers and microscopists to create a 3D image through a single lens, without moving the camera.
Published in the journal Optics Letters, this improbable-sounding technology relies only on computation and mathematics—no unusual hardware or fancy lenses. The effect is the equivalent of seeing a stereo image with one eye closed.
That’s easier said than done, as principal investigator Kenneth B. Crozier, John L. Loeb Associate Professor of the Natural Sciences, explains.
“If you close one eye, depth perception becomes difficult. Your eye can focus on one thing or another, but unless you also move your head from side to side, it’s difficult to gain much sense of objects’ relative distances,” Crozier says. “If your viewpoint is fixed in one position, as a microscope would be, it’s a challenging problem.”
Offering a workaround, Crozier and graduate student Antony Orth essentially compute how the image would look if it were taken from a different angle. To do this, they rely on the clues encoded within the rays of light entering the camera.
“Arriving at each pixel, the light’s coming at a certain angle, and that contains important information,” explains Crozier. “Cameras have been developed with all kinds of new hardware—microlens arrays and absorbing masks—that can record the direction of the light, and that allows you to do some very interesting things, such as take a picture and focus it later, or change the perspective view. That’s great, but the question we asked was, can we get some of that functionality with a regular camera, without adding any extra hardware?”
The key, they found, is to infer the angle of the light at each pixel, rather than directly measuring it (which standard image sensors and film would not be able to do). The team’s solution is to take two images from the same camera position but focused at different depths. The slight differences between these two images provide enough information for a computer to mathematically create a brand-new image as if the camera had been moved to one side.
By stitching these two images together into an animation, Crozier and Orth provide a way for amateur photographers and microscopists alike to create the impression of a stereo image without the need for expensive hardware. They are calling their computational method “light-field moment imaging”—not to be confused with “light field cameras” (like the Lytro), which achieve similar effects using high-end hardware rather than computational processing.
Importantly, the technique offers a new and very accessible way to create 3D images of translucent materials, such as biological tissues.
Biologists can use a variety of tools to create 3D optical images, including light-field microscopes, which are limited in terms of spatial resolution and are not yet commercially available; confocal microscopes, which are expensive; and a computational method called “shape from focus,” which uses a stack of images focused at different depths to identify at which layer each object is most in focus. That’s less sophisticated than Crozier and Orth’s new technique because it makes no allowance for overlapping materials, such as a nucleus that might be visible through a cell membrane, or a sheet of tissue that’s folded over on itself. Stereo microscopes may be the most flexible and affordable option right now, but they are still not as common in laboratories as traditional, monocular microscopes.
“This method devised by Orth and Crozier is an elegant solution to extract depth information with only a minimum of information from a sample,” says Conor L. Evans, an assistant professor at Harvard Medical School and an expert in biomedical imaging, who was not involved in the research. “Depth measurements in microscopy are usually made by taking many sequential images over a range of depths; the ability to glean depth information from only two images has the potential to accelerate the acquisition of digital microscopy data.”
“As the method can be applied to any image pair, microscopists can readily add this approach to our toolkit,” Evans adds. “Moreover, as the computational method is relatively straightforward on modern computer hardware, the potential exists for real-time rendering of depth-resolved information, which will be a boon to microscopists who currently have to comb through large data sets to generate similar 3D renders. I look forward to using their method in the future.”
The new technology also suggests an alternative way to create 3D movies for the big screen.
The Latest Bing News on:
Light-field moment imaging
- TECNO Elevates Photography with Latest CAMON 30 Series Featuring Sony IMX890 Lenson April 25, 2024 at 4:58 am
In the present day, we are fortunate not to be limited in our options when it comes to excellent camera quality, stunning designs, and high-performance ...
- SONY x TECNO – is this for real?on April 25, 2024 at 12:30 am
Sony x Tecno, Tecno has redefined camera technology by collaborating with SONY, the biggest industry leader in imaging technology.
- Flat optics revolutionize quantum light sources for enhanced communication and sensingon April 24, 2024 at 5:00 pm
(Nanowerk Spotlight) Quantum light sources are a fundamental building block for many quantum technologies, enabling secure communication, powerful computing, and precise sensing and imaging ... In ...
- Check out Some of the Mind-Blowing Visuals as Phish Bounced Around the Vegas Sphereon April 22, 2024 at 5:38 am
The latest from the world's largest LED screen in our running blog. Don't miss a story from inside (and outside) the Sphere.
- Ricoh’s big bet on a film renaissance: We interview the team behind the upcoming Pentax film cameraon April 20, 2024 at 6:14 am
A few weeks ago in Japan, we had the opportunity to interview the team at Ricoh behind the new Pentax film camera that's expected to arrive later this year. Find out why the designers settled on a ...
- OPPO Reno11F 5G Smartphone launches in Kenyaon April 17, 2024 at 7:57 am
OPPO Kenya Wednesday announced the launch of the OPPO Reno11F 5G smartphone. It comes with vibrant, eye-catching style, a 64MP Ultra-Clear Triple Camera and a 120Hz AMOLED Borderless display, Reno11F ...
- Dr. Mary Branch: A cardiologist empowering women in medicineon April 16, 2024 at 5:49 pm
Dr. Mary Branch, a cardiologist, is a fourth-generation African American physician who has broken new ground in her journey and unwavering commitment ...
- The horrors of TMJ: Chronic pain, metal jaws and futile treatmentson April 16, 2024 at 7:12 am
Among its many findings, the national academies said it has been widely assumed in the field of dentistry that TMJ disorders ... “If there was one moment in my life I could take back and do over again ...
- Filming in extreme conditions: Mammals production team reveal allon April 15, 2024 at 12:15 am
Producer/directors Stuart Armstrong and Will Lawson detail the specialist cameras used to capture the footage for the series' Dark and Cold episodes ...
- How Air Pollution Damages the Brainon April 12, 2024 at 9:22 am
The new science of "exposomics" shows how air pollution contributes to Alzheimer’s, Parkinson’s, bipolar disorder and other brain diseases ...
The Latest Google Headlines on:
Light-field moment imaging
[google_news title=”” keyword=”light-field moment imaging” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
The Latest Bing News on:
Mathematical image processing
- Samsung S95D QD-OLED TV review: Stunning in any settingon April 26, 2024 at 10:00 am
You can’t get away from AI in the gadget world and this TV is no exception. The S95D comes toting Samsung’s latest image processing chip, which puts a heavy emphasis on AI. Multiple neural networks ...
- Mastering AI Powerhouse: Unleashing C++ for Machine Learning and AI Programmingon April 25, 2024 at 10:10 pm
Why is C++ the preferred language for AI development? Explore emerging trends, essential tools, and prospects within this dynamic landscape.
- Fiber Orientation and Distribution Measurement in a Composite Polymeron April 17, 2024 at 5:50 am
The determination of fiber orientation within composite polymers is a critical parameter for the prediction of a material’s behavior. Over time, different methods have been developed to obtain an ...
- AMD Reveals Ryzen Pro 8000 Series for High-Performance Computing Needs, Including AIon April 16, 2024 at 1:42 pm
AMD said its Ryzen AI chip with the Ryzen Pro 8000 series can perform at 16 mobile dedicated NPU TOPS (i.e., TOPS is a measurement of how many mathematical operations a chip can perform in a second, ...
- Univ.-Prof. Dr. rer. nat.on April 12, 2024 at 9:19 am
Research interests: mathematical image processing, inverse problems, regularization techniques, motion compensation, blood vessel and leukocyte imaging Deputy Spokesperson for the Cells in Motion ...
- Language doesn’t perfectly describe consciousness. Can math?on April 10, 2024 at 6:00 am
“My view is that mathematical language is a way for us ... including all the neural processing that goes on beneath conscious awareness. The output state could be the words you produce to ...
- How photos of the April 8 solar eclipse will help us understand the sun's atmosphereon March 31, 2024 at 5:00 pm
The researchers hope that from this enormous data set, Druckmüller's expert image processing will be able ... An expert in mathematical image analysis, Druckmüller spent months perfecting ...
- Mathematical Methods in Image Reconstructionon November 7, 2023 at 7:06 am
This book describes the state of the art of the mathematical theory and numerical analysis of imaging. The authors survey and provide a unified view of imaging techniques, provide the necessary ...
- Artificial Intelligence and Machine Learning based Image Processingon December 15, 2022 at 6:47 am
Image processing is the process of converting an image to a digital ... Picture restoration, as opposed to image augmentation, is carried out utilising specific mathematical or probabilistic models. A ...
- Signal and Image Processing—Graduate Certificateon April 9, 2021 at 9:17 pm
Mathematical modeling and computar programming. Fundamentals of image processing are covered including image representation, geometric transformations, binary image processing, compression, space and ...
The Latest Google Headlines on:
Mathematical image processing
[google_news title=”” keyword=”mathematical image processing” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]