A diffractive camera design performs class-specific imaging of target objects with instantaneous all-optical erasure of other classes of objects. This diffractive camera consists of transmissive surfaces structured using deep learning to perform selective imaging of target classes of objects positioned at its input field-of-view. Using the same framework, the authors also demonstrated the design of class-specific permutation and class-specific linear transformation cameras, where the objects of a target data class are pixel-wise permuted or linearly transformed following an arbitrarily selected transformation matrix for all-optical class-specific encryption, while the other classes of objects are irreversibly erased from the output image. The success of class-specific diffractive cameras was experimentally demonstrated using terahertz (THz) waves and 3D-printed diffractive layers that selectively imaged only one class (2) of the MNIST handwritten digit dataset, all-optically erasing the other handwritten digits.
CREDIT: by Bijie Bai, Yi Luo, Tianyi Gan, Jingtian Hu, Yuhang Li, Yifan Zhao, Deniz Mengu, Mona Jarrahi, and Aydogan Ozcan
Over the past decade, digital cameras have been widely adopted in various aspects of our society, and are being massively used in mobile phones, security surveillance, autonomous vehicles, and facial recognition.
Through these cameras, enormous amounts of image data are being generated constantly, which raises growing concerns about privacy protection.
Some existing methods address these concerns by applying algorithms to conceal sensitive information from the acquired images, such as image blurring or encryption. However, such methods still risk sensitive data exposure because the raw images are already captured before they undergo digital processing to hide or encrypt the sensitive information. Also, the computation of these algorithms requires additional power consumption. Other efforts were also made to seek solutions using customized cameras to downgrade the image quality so that identifiable information can be concealed. However, these approaches sacrifice the overall image quality for all the objects of interest, which is undesired, and they are still vulnerable to adversarial attacks to retrieve the sensitive information that is recorded.
A new research paper published in eLight demonstrated a new paradigm to achieve privacy-preserving imaging by building a fundamentally new type of imager designed by AI. In their paper, UCLA researchers, led by Professor Aydogan Ozcan, presented a smart camera that images only certain types of desired objects, while instantaneously erasing other types of objects from its images without requiring any digital processing.
This new camera design consists of successive transmissive surfaces, each composed of tens of thousands of diffractive features at the scale of the wavelength of light. The structure of these transmissive surfaces is optimized using deep learning to modulate the phase of the transmitted optical fields such that the camera only images certain types/classes of desired objects and erases the others. After its deep learning-based design (training), the resulting layers are fabricated and assembled in 3D, forming the smart camera. After its assembly, when the input objects from the target classes of objects appear in front of it, they form high-quality images at the camera’s output. In contrast, when the input objects in front of the same camera belong to other undesired classes, they are optically erased, forming non-informative and low-intensity patterns similar to random noise.
Since the characteristic information of undesired classes of objects is all-optically erased at the output through light diffraction, this AI-designed camera never records their direct images. Therefore, the protection of privacy is maximized since an adversarial attack that has access to the recorded images of this camera cannot bring the information back. This feature can also reduce cameras’ image storage and transmission load since the images of undesired objects are not recorded.
To experimentally demonstrate this unique data-specific camera, the UCLA research team designed it to specifically and selectively image only one class of handwritten digits, and fabricated the designed camera using 3D printing. This 3D fabricated camera was tested using terahertz waves illuminating handwritten digits. Following the core principles of its design, the smart camera was able to selectively image the input objects only if they were handwritten digits “2”, while instantaneously erasing all the other handwritten digits from the output images, yielding low-intensity noise-like features. Furthermore, the research team rigorously tested their camera design under varying lighting conditions that were never included in its training, and showed that this smart camera is robust to such variations in illumination.
Beyond data class-specific imaging, this AI-based camera design can be used to build encryption cameras, providing an additional layer of security and privacy protection. Such an encryption camera, designed using AI-optimized diffractive layers, optically performs a selected linear transformation exclusively for the target objects of interest. Only those with access to the decryption key (i.e., the inverse linear transformation in this case) can recover the original image of the target objects. On the other hand, the information of the other undesired objects is irreversibly lost since the AI-designed camera all-optically erases them at the output. Therefore, even if the decryption key is applied to the recorded images, it yields noise-like features for other classes of undesired objects.
Except for the illumination light, this smart camera does not require any external power for its computation and operates at the speed of light. Therefore, it is fast, data- and energy-efficient, making it especially suitable for task-specific, privacy-aware, and power-limited imaging applications. The core teachings of this diffractive camera design can inspire future imaging systems that consume orders of magnitude less computing and data transmission power.
Original Article: AI-designed camera only records objects of interest while being blind to others
More from: University of California Los Angeles
The Latest Updates from Bing News
Go deeper with Bing News on:
Privacy-preserving imaging
- iOS 18 AI to Preserve Privacy, Will Use On-Device Processing vs Server-Side Processing
Apple is focusing on privacy in its iOS 18 artificial intelligence efforts, doing the required processing on the user's device, not in the cloud ...
- Apple's iOS 18 AI will be on-device preserving privacy, and not server-side
A new report on Sunday again reiterates that Apple's AI push in iOS 18 is rumored to focus on privacy with processing done directly on the iPhone, that won't connect to cloud services. Over the ...
- New privacy-preserving robotic cameras obscure images beyond human recognition
In a bid to restore privacy, researchers at the Australian Centre for Robotics at the University of Sydney and the Centre for Robotics (QCR) at Queensland University of Technology have created a ...
- New privacy-preserving robotic cameras obscure images beyond human recognition
The research, "Inherently privacy-preserving vision for trustworthy autonomous systems: Needs and solutions," was published by the Journal of Responsible Technology. More information: Adam K.
- New privacy-preserving robotic cameras obscure images beyond human recognition
New privacy-preserving robotic cameras obscure images beyond human recognition. ScienceDaily . Retrieved April 25, 2024 from www.sciencedaily.com / releases / 2024 / 04 / 240404113314.htm ...
Go deeper with Bing News on:
Privacy protection
- Nebraska Enacts Comprehensive Data Privacy Law
On 17 April, 2024, Nebraska Governor Jim Pillen signed into law omnibus Legislative Bill 1074, which includes the Nebraska Data Privacy Act, making Nebraska the ...
- Data Privacy Guide - Argentina
In Argentina, data protection is governed by comprehensive legislation aimed at safeguarding individuals' personal data. Below you will find an outline of the key aspects including governing ...
- Dashboard confessions: unveiling the privacy issues in connected cars
Sara H. Jodka of Dickinson Wright PLLC discusses the privacy risks posed by connected cars, vehicles with internet connectivity allowing for collection of data on drivers' behaviors.
- Who’s selling your digital data? California offers tools to protect online privacy
About 450 companies are on the data broker registry in California, and a law passed last year will make it easier to delete the data they collect about people.
- Dating apps criticized for poor privacy protection
Recent studies have revealed that dating apps are not adequately securing user privacy and are gathering a large amount of user data. This data is primarily utilized to appeal to Gen Z consumers. The ...