
The prototype of the high-resolution multi-spectral camera developed by a research team at the Chair of Multimedia Communications and Signal Processing at FAU: 5×5 cameras combine spatial, temporal and spectral resolution. (Image: FAU/Nils Genser)
FAU team develops cost-efficient and high-resolution multi-spectral camera
Intelligent cameras are the next milestone in image and video processing A team of researchers at the Chair of Multimedia Communications and Signal Processing at FAU has developed an intelligent camera that achieves not only high spatial and temporal but also spectral resolution. The camera has a wide range of applications that can improve environmental protection and resource conservation measures as well as autonomous driving or modern agriculture. The findings of the research have been published as an open access publication.
‘Research up to now has mainly focused on increasing spatial and temporal resolution, which means the number of megapixels or images per second,’ explains lecturer Dr. Jürgen Seiler. ‘Spectral resolution – the wavelength and thus the perception of colours – has largely been adjusted to match human sight during the development of cameras, which merely corresponds to measuring the colours red, green, and blue. However, much more information is hidden in the light spectrum that can be used for a wide range of tasks. For example, we know that some animals use additional light spectra for hunting and searching for food.’
Three resolutions in one camera
Seiler, who is an electrical engineer, has therefore developed a high-resolution multi-spectral camera that enhances human perception with his team at the Chair of Multimedia Communications and Signal Processing (LMS) led by Prof. Dr. Kaup at FAU. It combines all three resolutions – spatial, temporal and spectral – in a cost-efficient solution. ‘Up to now, there were only extremely expensive and complex methods for measuring the ultraviolet or infrared ranges of light or individual spectral bands for special industrial applications,’ says Seiler. ‘We looked for a cost-efficient model and we were able to develop a very cost-effective multi-spectral camera.’
The researchers connected several inexpensive standard cameras with various spectral filters to form a multi-spectral camera array. ‘We then calculated an image in order to combine the various spectral information from each sensor,’ explains Nils Genser, research associate at LMS. ‘This new concept enables us to precisely determine the materials of each object captured using just one single image.’
At the same time, the new camera is greatly superior to existing systems in terms of its spatial, temporal and spectral resolution. As the surroundings are recorded by several ‘eyes’ as is the case with human sight, the system also provides a precise indication of depth. This means that the system not only precisely determines the colour and certain material properties of objects it captures, but also the distance between them and the camera.
Ideal for autonomous driving and environmental technology
Autonomous driving is a potential application for these new intelligent cameras. ‘A whole range of solutions to various problems has now opened up thanks to our new technology,’ says Seiler. ‘In the infrared range, for example, we can differentiate between real people and signposts using the thermal signature. For night driving, we can detect animals crossing the road with sufficient warning.’
The high-resolution multi-spectral cameras could also be used for protecting the environment and conserving resources. ‘Several plastics differ significantly from each other in various ranges of the spectrum, which is something the new intelligent camera can reliably detect,’ Genser emphasises. ‘Large amounts of plastics are simply burned instead of separated for recycling as they have a similar appearance. We can now separate them reliably.’
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Intelligent cameras
- Lantronix Expands Open-Q Family With New SIP Modules That Deliver Powerful Performance, Vivid Graphics, Dynamic Camera Capabilities
The SIP modules are based on the Qualcomm® QCS2290 and QCS4290 System-on-Chip (SoC), utilizing Qualcomm Technologies’ heterogenous compute expertise with multiple specialized processing cores. The new ...
- Luxonis Creates OAK Camera Line to Support AI Devices
Luxonis' OAK camera line aims to enhance monitoring for humans using real-time AI along with depth perception.
- The best cameras in 2023
If you're looking for the best cameras you can buy right now but without ... clear photos no matter the situation; its intelligent, fast autofocus certainly helped, as did its 11fps shooting ...
- Orbbec Debuts Femto Mega at CES 2023, the Industry's Highest Resolution 3D Vision Camera with Integrated Depth and AI Processing
"We're excited to introduce this new category-leading intelligent camera as part of Orbbec's new depth vision platform". The Orbbec team will be demonstrating Femto Mega and other 3D camera ...
- How RGB-IR Cameras can enhance medical devices
In this article, e-con discusses how vision-enabled medical devices can be enhanced with the help of RGB-IR cameras.
Go deeper with Google Headlines on:
Intelligent cameras
[google_news title=”” keyword=”intelligent cameras” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
High-resolution multi-spectral cameras
- This tiny sensor is about to change your phone camera forever
“In terms of overall cost, the complete module will be the same cost as a high-volume standard camera.” A graphic showing the difference between an RGB sensor and the Spectricity S1 spectral ...
- Multispectral Imaging System Built With Raspberry Pi
The project is built inside a dark box which keeps outside light from polluting the results. A camera is mounted at the top to image specimens installed below, which the Pi uses to take photos ...
- Imec demonstrates combined VIS & NIR spectral camera system
This year's SPIE Photonics West will see imec showcase the world’s first multi-sensor hyperspectral camera system that covers both the visual and red/near infrared spectral ranges. With a ...
- UAV Remote Sensing for Smart Agriculture
Smart agriculture’, i.e. the efficient use of Earth's resources to feed the world, requires accurate and advanced data acquisition, ...
- CES 2023: This sensor claims to fix smartphone cameras' poor colour reproduction
Telecom service providers have launched the service in select cities and plan to cover the entire nation by the end of 2023 or early 2024. 'Make in India' smartphone shipments down 8 percent as ...
Go deeper with Google Headlines on:
High-resolution multi-spectral cameras
[google_news title=”” keyword=”high-resolution multi-spectral cameras” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]