
The prototype of the high-resolution multi-spectral camera developed by a research team at the Chair of Multimedia Communications and Signal Processing at FAU: 5×5 cameras combine spatial, temporal and spectral resolution. (Image: FAU/Nils Genser)
FAU team develops cost-efficient and high-resolution multi-spectral camera
Intelligent cameras are the next milestone in image and video processing A team of researchers at the Chair of Multimedia Communications and Signal Processing at FAU has developed an intelligent camera that achieves not only high spatial and temporal but also spectral resolution. The camera has a wide range of applications that can improve environmental protection and resource conservation measures as well as autonomous driving or modern agriculture. The findings of the research have been published as an open access publication.
‘Research up to now has mainly focused on increasing spatial and temporal resolution, which means the number of megapixels or images per second,’ explains lecturer Dr. Jürgen Seiler. ‘Spectral resolution – the wavelength and thus the perception of colours – has largely been adjusted to match human sight during the development of cameras, which merely corresponds to measuring the colours red, green, and blue. However, much more information is hidden in the light spectrum that can be used for a wide range of tasks. For example, we know that some animals use additional light spectra for hunting and searching for food.’
Three resolutions in one camera
Seiler, who is an electrical engineer, has therefore developed a high-resolution multi-spectral camera that enhances human perception with his team at the Chair of Multimedia Communications and Signal Processing (LMS) led by Prof. Dr. Kaup at FAU. It combines all three resolutions – spatial, temporal and spectral – in a cost-efficient solution. ‘Up to now, there were only extremely expensive and complex methods for measuring the ultraviolet or infrared ranges of light or individual spectral bands for special industrial applications,’ says Seiler. ‘We looked for a cost-efficient model and we were able to develop a very cost-effective multi-spectral camera.’
The researchers connected several inexpensive standard cameras with various spectral filters to form a multi-spectral camera array. ‘We then calculated an image in order to combine the various spectral information from each sensor,’ explains Nils Genser, research associate at LMS. ‘This new concept enables us to precisely determine the materials of each object captured using just one single image.’
At the same time, the new camera is greatly superior to existing systems in terms of its spatial, temporal and spectral resolution. As the surroundings are recorded by several ‘eyes’ as is the case with human sight, the system also provides a precise indication of depth. This means that the system not only precisely determines the colour and certain material properties of objects it captures, but also the distance between them and the camera.
Ideal for autonomous driving and environmental technology
Autonomous driving is a potential application for these new intelligent cameras. ‘A whole range of solutions to various problems has now opened up thanks to our new technology,’ says Seiler. ‘In the infrared range, for example, we can differentiate between real people and signposts using the thermal signature. For night driving, we can detect animals crossing the road with sufficient warning.’
The high-resolution multi-spectral cameras could also be used for protecting the environment and conserving resources. ‘Several plastics differ significantly from each other in various ranges of the spectrum, which is something the new intelligent camera can reliably detect,’ Genser emphasises. ‘Large amounts of plastics are simply burned instead of separated for recycling as they have a similar appearance. We can now separate them reliably.’
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Intelligent cameras
- This New Partnership is Turning Store Security Cameras Into Customer Data Insightson January 25, 2021 at 3:24 pm
Click here to read the full article. A new strategic partnership is aiming to improve retailers’ oversight of their stores – literally. Interface Security Systems will become the exclusive provider of ...
- Firefly dual-lens AI camera module now available from $89on January 25, 2021 at 5:17 am
Firefly as recently launched their new dual-lens AI camera module and is available with either the Rockchip RV1109 or RV1126 processor in the CAM-C1109S2U ...
- An Intelligent And Portable Telescope To Observe Stars Directly From Your Mobileon January 24, 2021 at 5:58 am
Vespera portable telescope aims to revolutionize home astronomy by allowing you to observe the stars directly from your mobile.
- Peachtree Corners installs cameras to monitor use of masks, social distancingon January 20, 2021 at 8:38 pm
Peachtree Corners is the first city in the country to use cameras to slow the spread of the coronavirus. White inverted domes in Peachtree Corners City Hall lobby look like typical security cameras, ...
- Canon Close to Releasing PowerShot Camera Powered by AI: Reporton January 20, 2021 at 2:18 pm
Canon has publicly stated that it plans to put notable effort behind specialized cameras as it prepares for the future of the digital camera industry.
Go deeper with Google Headlines on:
Intelligent cameras
Go deeper with Bing News on:
High-resolution multi-spectral cameras
- Aspirin for the Prevention of Cognitive Decline in the Elderlyon January 17, 2021 at 4:00 pm
First, a volumetric 3D T1-weighted sequence is used to obtain high resolution anatomical information ... segmentation: a multi-spectral segmentation utilizing all acquired data types will provide ...
- ISRO to launch 31 satellites in a single mission on board Polar Satellite Launch Vehicleon January 9, 2021 at 3:59 pm
It carries Panchromatic and Multi-spectral cameras operating in Time Delay Integration mode and is capable of delivering high-resolution data. This would be the third satellite in the Cartosat-2 ...
- Building A Full-Spectrum Digital Camera On The Cheapon January 1, 2021 at 4:00 pm
The sensor on your digital camera picks up a lot more than just the light that’s visible to the human eye. Camera manufacturers go out of their way to reduce this to just the visible spectrum in ...
- PD2000/FP Passport Scanner - Ultra HD Images in Secondson December 22, 2020 at 4:00 pm
The fully integrated system includes a high quality digital camera, a selection of high intensity multi-spectral light sources, and PC with large high resolution monitor Once document images have ...
- Resources, Infrastructure Systems and built Environments Disciplineon November 25, 2020 at 5:08 am
The Multi-spectral Advanced Research Vehicle (MARVel) has multi-sensor capture, comprising visual cameras for radial capture of visible ... and full LiDAR coverage to build high-resolution 3-D point ...