Facial expression reading based on MLP classification from 3D depth maps and 2D images obtained by NIR-LFC
Machine-learned, light-field camera reads facial expressions from high-contrast illumination invariant 3D facial images
A joint research team led by Professors Ki-Hun Jeong and Doheon Lee from the KAIST Department of Bio and Brain Engineering reported the development of a technique for facial expression detection by merging near-infrared light-field camera techniques with artificial intelligence (AI) technology.
Unlike a conventional camera, the light-field camera contains micro-lens arrays in front of the image sensor, which makes the camera small enough to fit into a smart phone, while allowing it to acquire the spatial and directional information of the light with a single shot. The technique has received attention as it can reconstruct images in a variety of ways including multi-views, refocusing, and 3D image acquisition, giving rise to many potential applications.
However, the optical crosstalk between shadows caused by external light sources in the environment and the micro-lens has limited existing light-field cameras from being able to provide accurate image contrast and 3D reconstruction.
The joint research team applied a vertical-cavity surface-emitting laser (VCSEL) in the near-IR range to stabilize the accuracy of 3D image reconstruction that previously depended on environmental light. When an external light source is shone on a face at 0-, 30-, and 60-degree angles, the light field camera reduces 54% of image reconstruction errors. Additionally, by inserting a light-absorbing layer for visible and near-IR wavelengths between the micro-lens arrays, the team could minimize optical crosstalk while increasing the image contrast by 2.1 times.
Through this technique, the team could overcome the limitations of existing light-field cameras and was able to develop their NIR-based light-field camera (NIR-LFC), optimized for the 3D image reconstruction of facial expressions. Using the NIR-LFC, the team acquired high-quality 3D reconstruction images of facial expressions expressing various emotions regardless of the lighting conditions of the surrounding environment.
The facial expressions in the acquired 3D images were distinguished through machine learning with an average of 85% accuracy – a statistically significant figure compared to when 2D images were used. Furthermore, by calculating the interdependency of distance information that varies with facial expression in 3D images, the team could identify the information a light-field camera utilizes to distinguish human expressions.
Professor Ki-Hun Jeong said, “The sub-miniature light-field camera developed by the research team has the potential to become the new platform to quantitatively analyze the facial expressions and emotions of humans.” To highlight the significance of this research, he added, “It could be applied in various fields including mobile healthcare, field diagnosis, social cognition, and human-machine interactions.”
Original Article: AI Light-Field Camera Reads 3D Facial Expressions?
More from: Korea Advanced Institute of Science and Technology
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Facial expression detection
- Facial Recognition at Airports vs. Facial Analysis at Events: What to Know
As Congress debates the use of facial identification for airport security, planners should know how that technology differs from the one that measures attendee engagement during sessions.
- These AI avatars now come with human-like expressions
Synthesia's Expressive Avatars are powered by its Express-1 AI model. While the company uses open-source LLMs for the text elements of the product, Express-1 was trained entirely on content Synthesia ...
- How Facial Recognition Technology Works
By combining all three templates, FaceIt® offered an advantage over other facial recognition systems. It was relatively insensitive to changes in expression — including blinking, frowning or ...
- Zoloz enters the war on deepfakes with biometric detection software
The deepfake detection software features upgraded defenses against evolving infiltration tactics including AI face swapping attacks on face recognition systems.
- How Facial Recognition Technology Works
How unique is your face? Learn how facial recognition systems can pick a face out of a crowd, extract it from the rest of the scene and compare it to a database of stored images.
Go deeper with Google Headlines on:
Facial expression detection
[google_news title=”” keyword=”facial expression detection” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Sub-miniature light-field camera
- Blink Mini 2: The cheap security camera gets a bundle of upgrades!
Amazon-owned Blink's celebrated Mini camera is low-cost, but stuck indoors – until now. It's going weatherproof.
- This is one of the toughest smartphone camera comparisons I’ve ever done
This shows how much of a fine line the Xiaomi camera treads when it comes to exposure, brightness, and dynamism. The first photo of the field and tree highlights ... you can see how much light the ...
- DJI Mini 4K – beginner's drone gets a big boost in quality
The new Mini 4K will support 4K video resolution at 24, 25, and 30fps - and 2.7K at up to 60fps. Other features which represent an improvement over the Mini 2 SE that DJI has announced include digital ...
- Tata AutoComp’s ‘Make in India’ push for EVs
As part of their ‘One Tata’ approach to manufacturing electric vehicles, Pune-based Tata AutoComp has played a pivotal role in the localisation of components for Tata Motors. Autocar Professional ...
- Technology News
Get Latest and Breaking News about Technology. Todays Top News Headlines about Technology, News on Mobile Devices, TVs and Laptops. News about Apple, Google, Microsoft, OPPO, Vivo, Xiaomi, Samsung, ...
Go deeper with Google Headlines on:
Sub-miniature light-field camera
[google_news title=”” keyword=”sub-miniature light-field camera” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]