Scientists from Nanyang Technological University, Singapore (NTU Singapore) have developed an ultrafast high-contrast camera that could help self-driving cars and drones see better in extreme road conditions and in bad weather.
Unlike typical optical cameras, which can be blinded by bright light and unable to make out details in the dark, NTU’s new smart camera can record the slightest movements and objects in real time.
The new camera records the changes in light intensity between scenes at nanosecond intervals, much faster than conventional video, and it stores the images in a data format that is many times smaller as well.
With a unique in-built circuit, the camera can do an instant analysis of the captured scenes, highlighting important objects and details.
Developed by Assistant Professor Chen Shoushun from NTU’s School of Electrical and Electronic Engineering, the new camera named Celex® is now in its final prototype phase.
“Our new camera can be a great safety tool for autonomous vehicles, since it can see very far ahead like optical cameras but without the time lag needed to analyse and process the video feed,” explained Asst Prof Chen.
“With its continuous tracking feature and instant analysis of a scene, it complements existing optical and laser cameras and can help self-driving vehicles and drones avoid unexpected collisions that usually happens within seconds.”
Asst Prof Chen unveiled the prototype of Celex® last month at the 2017 IS&T International Symposium on Electronic Imaging (EI 2017) held in the United States.
It received positive feedback from the conference attendees, many of whom are academia and top industry players.
How it works
A typical camera sensor has several millions pixels, which are sensor sites that record light information and are used to form a resulting picture.
High-speed video cameras that record up to 120 frames or photos per second generate gigabytes of video data, which are then processed by a computer in order for self-driving vehicles to “see” and analyse their environment.
The more complex the environment, the slower the processing of the video data, leading to lag times between “seeing” the environment and the corresponding actions that the self-driving vehicle has to take.
To enable an instant processing of visual data, NTU’s patent-pending camera records the changes between light intensity of individual pixels at its sensor, which reduces the data output. This avoids the needs to capture the whole scene like a photograph, thus increasing the camera’s processing speed.
The camera sensor also has a built-in processor that can analyse the flow of data instantly to differentiate between the foreground objects and the background, also known as optical flow computation. This innovation allows self-driving vehicles more time to react to any oncoming vehicles or obstacles.
The research into the sensor technology started in 2009 and it has received $500,000 in funding from the Ministry of Education Tier 1 research grant and the Singapore-MIT Alliance for Research and Technology (SMART) Proof-of-Concept grant.
The technology was also published in two academic journals published by the Institute of Electrical and Electronics Engineers (IEEE), the world’s largest technical professional organisation for the advancement of technology.
Commercialisation potential
With keen interest from the industry, Asst Prof Chen and his researchers have spun off a start-up company named Hillhouse Tech to commercialise the new camera technology. The start-up is incubated by NTUitive, NTU’s innovation and enterprise company.
Asst Prof Chen expects that the new camera will be commercially ready by the end of this year, as they are already in talks with global electronic manufacturers.
Learn more: NTU invents ultrafast camera for self-driving vehicles and drones
[osd_subscribe categories=’smart-camera’ placeholder=’Email Address’ button_text=’Subscribe Now for any new posts on the topic “SMART CAMERA”‘]
Receive an email update when we add a new SMART CAMERA article.
The Latest on: Smart camera
[google_news title=”” keyword=”smart camera” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Smart camera
- Settlement payments starting to go out for Ring camera ownerson April 25, 2024 at 1:54 pm
The Federal Trade Commission will begin sending more than $5.6 million in refunds to Ring customers as part of a settlement with the company that allowed employees and contractors access to customers' ...
- Samsung Spring Sale: Get up to $915 off smart ranges todayon April 25, 2024 at 6:46 am
You can get discounts of up to $915 if you buy a smart range from Samsung's Spring Black Friday sale, but you need to hurry as the offers will likely end soon.
- Enhanced Home Security: 24/7 Protection with Xiaomi Smart Camerason April 25, 2024 at 1:44 am
Xiaomi, a leading innovator of smart home devices, offers a range of smart cameras designed to provide round-the-clock surveillance and peace of mind.
- Smart Camera Market Innovation Surges: Envisioned to Hit US$ 1,93,496.8 Million by 2033, Boasting a Remarkable 26.1% CAGRon April 15, 2024 at 7:06 pm
The smart camera market is expected to experience significant growth, with a strong CAGR of 26.1% projected during the forecast period. By the year 2033, it is estimated that the market will be valued ...
- Honor 90 Smart with 108MP Camera Launchedon April 10, 2024 at 11:30 pm
The HONOR 90 Smart is not just another smartphone; it's a photographic powerhouse. With a 108MP main camera, you can capture life's moments with ...
- Xiaomi’s New Smart Camera is Perfect for Parents with Crying Babieson April 7, 2024 at 5:00 pm
The latest addition is the Xiaomi Smart Camera “Baby Care Edition”, available for 749 yuan. This camera detects cries, coughs, and more, helping to ease the lives of new parents. Here are the ...
- The Xiaomi 14 Ultra is a photography nerd’s dreamon March 28, 2024 at 6:01 am
Can’t have everything, I guess. The Xiaomi 14 Ultra uses a 1-inch-type main camera sensor — that’s about as big as they come on smartphone cameras, and all things being equal, a bigger ...
- The Xiaomi 14 Ultra has the best smartphone camera I’ve ever usedon March 26, 2024 at 5:00 pm
The Xiaomi 14 Ultra is a big, powerful smartphone. When you start using ... I’m going to talk about the camera first. It’s what makes the Xiaomi 14 Ultra special, and it’s so good that ...
- The Best Camera Phones You Can Buy in 2024on March 8, 2024 at 5:05 am
This is the Coolest Galaxy S24 AI Feature That Few Are Talking About For most users, the best smartphone camera has to be ample enough that its photos are shareable on social media or printed out ...
via Bing News