via UCLA Henry Samueli School of Engineering and Applied Science
A pair of UCLA bioengineers and a former postdoctoral scholar have developed a new class of bionic 3D camera systems that can mimic flies’ multiview vision and bats’ natural sonar sensing, resulting in multidimensional imaging with extraordinary depth range that can also scan through blind spots.
Powered by computational image processing, the camera can decipher the size and shape of objects hidden around corners or behind other items. The technology could be incorporated into autonomous vehicles or medical imaging tools with sensing capabilities far beyond what is considered state of the art today. This research has been published in Nature Communications.
In the dark, bats can visualize a vibrant picture of their surroundings by using a form of echolocation, or sonar. Their high-frequency squeaks bounce off their surroundings and are picked back up by their ears. The minuscule differences in how long it takes for the echo to reach the nocturnal animals and the intensity of the sound tell them in real time where things are, what’s in the way and the proximity of potential prey.
Many insects have geometric-shaped compound eyes, in which each “eye” is composed of hundreds to tens of thousands of individual units for sight — making it possible to see the same thing from multiple lines of sight. For example, flies’ bulbous compound eyes give them a near-360-degree view even though their eyes have a fixed focus length, making it difficult for them to see anything far away, such as a flyswatter held aloft.
Inspired by these two natural phenomena found in flies and bats, the UCLA-led team set out to design a high-performance 3D camera system with advanced capabilities that leverage these advantages but also address nature’s shortcomings.
“While the idea itself has been tried, seeing across a range of distances and around occlusions has been a major hurdle,” said study leader Liang Gao, an associate professor of bioengineering at the UCLA Samueli School of Engineering. “To address that, we developed a novel computational imaging framework, which for the first time enables the acquisition of a wide and deep panoramic view with simple optics and a small array of sensors.”
The researchers also use a type of LiDAR, or “Light Detection And Ranging,” in which a laser scans the surroundings to create a 3D map of the area.
Conventional LiDAR, without CLIP, would take a high-resolution snapshot of the scene but miss hidden objects, much like our human eyes would.
Using seven LiDAR cameras with CLIP, the array takes a lower-resolution image of the scene, processes what individual cameras see, then reconstructs the combined scene in high- resolution 3D imaging. The researchers demonstrated the camera system could image a complex 3D scene with several objects, all set at different distances.
“If you’re covering one eye and looking at your laptop computer, and there’s a coffee mug just slightly hidden behind it, you might not see it, because the laptop blocks the view,” explained Gao, who is also a member of the California NanoSystems Institute. “But if you use both eyes, you’ll notice you’ll get a better view of the object. That’s sort of what’s happening here, but now imagine seeing the mug with an insect’s compound eye. Now multiple views of it are possible.”
According to Gao, CLIP helps the camera array make sense of what’s hidden in a similar manner. Combined with LiDAR, the system is able to achieve the bat echolocation effect so one can sense a hidden object by how long it takes for light to bounce back to the camera.
The Latest Updates from Bing News
Go deeper with Bing News on:
Bionic Super 3D Cameras
- Best Selling Phones (March 2024) in India
A ToF (Time-of-Flight) 3D ... LTPO Super Retina XDR OLED display with HDR10 certification. At its core is Apple’s in-house 4nm A16 Bionic SoC coupled with 6GB of RAM. There is a triple-camera ...
- top 10 Apple mobiles (February 2024) in India
A ToF (Time-of-Flight) 3D ... 120Hz Super Retina XDR OLED display with HDR10. The guts of the phone pack Apple’s 5nm A15 Bionic chipset, coupled with 6GB of RAM. There is a triple-camera array ...
- Best Buy Presidents Day sale 2024: Shop early deals now
Appliances aside, Best Buy's Presidents Day sale typically offers fantastic February deals on laptops, tablets, monitors, headphones, video games, and more. So if you're upgrading your gadgets on a ...
- Super 16 is back with this pocket-sized cinema camera!
The Octopus16 is a cinema camera designed with a nod to the visual storytelling of Super 16 film cameras, created with a Super 16 format UHD-4K CMOS sensor with a true 16-bit sensor readout.
- How many cameras will be used on the Super Bowl and how much will they cost?
Super Bowl LVIII will likely be the most-watched single sporting event of 2024. Have you ever wondered how many cameras will be used to capture it and how much they would cost to buy? We have the ...
Go deeper with Bing News on:
Bionic 3D camera systems
- The vivo V30 Pro is announced with a battery that’s to retain 80% health after 1600 charging cycles
Apple was quite proud to announce that the iPhone 15’s battery is to retain 80% health after 1000 cycles, doubling the stats of the iPhone 14’s battery (expected 80% battery after 500 full charging ...
- Vivo V30 Pro official with four 50MP cameras, sleek design
The Pro model is focused on performance and photography, with the company partnering with Zeiss for its imaging system ... The main camera comes with a Vivo-exclusive Camera-Bionic Spectrum ...
- Innovations in depth from focus/defocus pave the way to more capable computer vision systems
In an image, estimating the distance between objects and the camera by using the blur in the images as clue, also known as depth from focus/defocus, is essential in computer vision. However, ...
- Get Acer's Predator A770 Video Card for $299.99
The custom-engineered cooling system includes a blower ... The 5th Gen AeroBlade 3D fan features custom-engineered, ultra-thin blades for fast frame rates, while the FrostBlade 2.0 fan uses ...
- The Best Outdoor Security Camera
We also discovered that the system automatically downgrades video resolution to 1080p if you opt to use cloud storage. Battery life is phenomenal. Eufy claims its cameras can last 365 days on a ...