Metalens sensor could be used for microrobotics, augmented reality, wearable devices
For all our technological advances, nothing beats evolution when it comes to research and development. Take jumping spiders. These small arachnids have impressive depth perception despite their tiny brains, allowing them to accurately pounce on unsuspecting targets from several body lengths away.
Inspired by these spiders, researchers at the Harvard John A. Paulson School of Engineering and Applied Sciences (SEAS) have developed a compact and efficient depth sensor that could be used on board microrobots, in small wearable devices, or in lightweight virtual and augmented reality headsets. The device combines a multifunctional, flat metalens with an ultra-efficient algorithm to measure depth in a single shot.
“Evolution has produced a wide variety of optical configurations and vision systems that are tailored to different purposes,” said Zhujun Shi, a Ph.D. candidate in the Department of Physics and co-first author of the paper. “Optical design and nanotechnology are finally allowing us to explore artificial depth sensors and other vision systems that are similarly diverse and effective.”
The research is published in Proceedings of the National Academy of Sciences (PNAS).
Many of today’s depth sensors, such as those in phones, cars and video game consoles, use integrated light sources and multiple cameras to measure distance. Face ID on a smartphone, for example, uses thousands of laser dots to map the contours of the face. This works for large devices with room for batteries and fast computers, but what about small devices with limited power and computation, like smart watches or microrobots?
Evolution, as it turns out, provides a lot of options.
Humans measure depth using stereo vision, meaning when we look at an object, each of our two eyes is collecting a slightly different image. Try this: hold a finger directly in front of your face and alternate opening and closing each of your eyes. See how your finger moves? Our brains take those two images, examine them pixel by pixel and, based on how the pixels shift, calculates the distance to the finger.
“That matching calculation, where you take two images and perform a search for the parts that correspond, is computationally burdensome,” said Todd Zickler, the William and Ami Kuan Danoff Professor of Electrical Engineering and Computer Science at SEAS and co-senior author of the study. “Humans have a nice, big brain for those computations but spiders don’t.”
Jumping spiders have evolved a more efficient system to measure depth. Each principal eye has a few semi-transparent retinae arranged in layers, and these retinae measure multiple images with different amounts of blur. For example, if a jumping spider looks at a fruit fly with one of its principal eyes, the fly will appear sharper in one retina’s image and blurrier in another. This change in blur encodes information about the distance to the fly.
In computer vision, this type of distance calculation is known as depth from defocus. But so far, replicating Nature has required large cameras with motorized internal components that can capture differently-focused images over time. This limits the speed and practical applications of the sensor.
That’s where the metalens comes in.
Federico Capasso, the Robert L. Wallace Professor of Applied Physics and Vinton Hayes Senior Research Fellow in Electrical Engineering at SEAS and co-senior author of the paper, and his lab have already demonstrated metalenses that can simultaneously produce several images containing different information. Building off that research, the team designed a metalens that can simultaneously produce two images with different blur.
“Instead of using layered retina to capture multiple simultaneous images, as jumping spiders do, the metalens splits the light and forms two differently-defocused images side-by-side on a photosensor,” said Shi, who is part of Capasso’s lab.
An ultra-efficient algorithm, developed by Zickler’s group, then interprets the two images and builds a depth map to represent object distance.
“Being able to design metasurfaces and computational algorithms together is very exciting,” said Qi Guo, a Ph.D. candidate in Zickler’s lab and co-first author of the paper. “This is new way of creating computational sensors, and it opens the door to many possibilities.”
“Metalenses are a game changing technology because of their ability to implement existing and new optical functions much more effciently, faster and with much less bulk and complexity than existing lenses,” said Capasso. “Fusing breakthroughs in optical design and computational imaging has led us to this new depth camera that will open up a broad range of opportunities in science and technology.”
Learn more: Compact depth sensor inspired by spiders
The Latest on: Metalens sensor
[google_news title=”” keyword=”metalens sensor” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Metalens sensor
- Air quality sensorson February 29, 2024 at 4:00 pm
Ever wanted an indoor environment sensor that’s dead simple yet a complete package? That’s the anotter-sensor-hub project from [Jana Marie], designed for the Sensirion SEN05x series sensors ...
- Sensors Bolster Army Prowesson February 27, 2024 at 4:00 pm
The Terrain Commander from Textron Corporation provides the basis for the U.S. Army's unattended ground sensor (UGS) Future Combat Systems. The sensor assembly is equipped with a variety of optical, ...
- Wearable face sensors add to the evolution of tech that "gets" uson February 23, 2024 at 4:00 pm
And yes, it is as weird as it sounds. The wearable consists of a set of thin, clear, flexible sensors that adhere to the face on the left and right side of the head. The bulk of each sensor sticks ...
- Potato plant radiation sensors could one day monitor radiation in areas surrounding power plantson February 20, 2024 at 4:00 pm
Our team of plant scientists at the University of Tennessee wanted to figure out alternatives to these mechanical radiation sensors to help address their historic failures, so we decided to build a ...
- How to Use the Temperature and Humidity Sensors Inside Your Smart Speakerson February 12, 2024 at 4:00 pm
Your smart speakers have more built-in functionality than you might have realized if you've just been using them to queue up playlists and get weather forecasts. Dig a bit deeper into their ...
- The best outdoor motion sensor lights for your home or business in 2024on February 11, 2024 at 3:59 pm
So is convenience. Easy to install with good waterproofing at a really strong price point, you can get all you need from the LEONLITE LED Motion Sensor Flood Light. A solar-powered model at a ...
- Engineers make the largest metalens everon February 8, 2024 at 3:59 pm
They controlled focus by changing the distance between the metalens and the sensor. Because they propose using this metalens in aircraft and spacecraft, the researchers wanted to make sure it was ...
- This Nix Mini 2 Color Sensor Is on Sale for $70 Right Nowon February 7, 2024 at 4:00 pm
This Nix Mini 2 Color Sensor can scan and read the color of just about any surface—great for matching paint colors, like having a color-dropping tool in real life—and it’s on sale for $69.96 ...
- Metalens Enables Higher Resolution Microscopes and Telescopeson February 6, 2024 at 10:29 am
Now, Harvard researchers have turned the metalens towards space. Researchers at the Harvard John A. Paulson School of Engineering and Applied Sciences (SEAS) have developed a 10-centimeter-diameter ...
- Best Outdoor Motion Sensor Porch Lights for Home Security and Convenienceon February 2, 2024 at 4:01 pm
Outdoor motion sensor porch lights are a convenient and practical addition to any home. They offer a sense of security by illuminating the area around your house when motion is detected ...
via Bing News