New research aims to open the ‘black box’ of computer vision
It can take years of birdwatching experience to tell one species from the next. But using an artificial intelligence technique called deep learning, Duke University researchers have trained a computer to identify up to 200 species of birds from just a photo.
The real innovation, however, is that the A.I. tool also shows its thinking, in a way that even someone who doesn’t know a penguin from a puffin can understand.
The team trained their deep neural network — algorithms based on the way the brain works — by feeding it 11,788 photos of 200 bird species to learn from, ranging from swimming ducks to hovering hummingbirds.
The researchers never told the network “this is a beak” or “these are wing feathers.” Given a photo of a mystery bird, the network is able to pick out important patterns in the image and hazard a guess by comparing those patterns to typical species traits it has seen before.
Along the way it spits out a series of heat maps that essentially say: “This isn’t just any warbler. It’s a hooded warbler, and here are the features — like its masked head and yellow belly — that give it away.”
Duke computer science Ph.D. student Chaofan Chen and undergraduate Oscar Li led the research, along with other team members of the Prediction Analysis Lab directed by Duke professor Cynthia Rudin.
They found their neural network is able to identify the correct species up to 84% of the time — on par with some of its best-performing counterparts, which don’t reveal how they are able to tell, say, one sparrow from the next.
Rudin says their project is about more than naming birds. It’s about visualizing what deep neural networks are really seeing when they look at an image.
Similar technology is used to tag people on social networking sites, spot suspected criminals in surveillance cameras, and train self-driving cars to detect things like traffic lights and pedestrians.
The problem, Rudin says, is that most deep learning approaches to computer vision are notoriously opaque. Unlike traditional software, deep learning software learns from the data without being explicitly programmed. As a result, exactly how these algorithms ‘think’ when they classify an image isn’t always clear.
Rudin and her colleagues are trying to show that A.I. doesn’t have to be that way. She and her lab are designing deep learning models that explain the reasoning behind their predictions, making it clear exactly why and how they came up with their answers. When such a model makes a mistake, its built-in transparency makes it possible to see why.
For their next project, Rudin and her team are using their algorithm to classify suspicious areas in medical images like mammograms. If it works, their system won’t just help doctors detect lumps, calcifications and other symptoms that could be signs of breast cancer. It will also show which parts of the mammogram it’s homing in on, revealing which specific features most resemble the cancerous lesions it has seen before in other patients.
In that way, Rudin says, their network is designed to mimic the way doctors make a diagnosis. “It’s case-based reasoning,” Rudin said. “We’re hoping we can better explain to physicians or patients why their image was classified by the network as either malignant or benign.”
The Latest on: Deep learning
via Google News
The Latest on: Deep learning
- Deep-learning algorithm spots carotid calcium on CT examson July 1, 2021 at 9:31 am
A deep-learning algorithm performs comparably to human readers when it comes to identifying intracranial carotid artery calcification (ICAC) on noncontrast CT images, according to a study published ...
- 2021 Deep Learning in Machine Vision Market, Business Growth, Current Trends, Rules, Challenge, and Interaction, Goals, Key Components, Forecast 2027on July 1, 2021 at 4:23 am
Global Deep Learning in Machine Vision Market 2021 is an all-inclusive, proficient report provides an in-detail analysis of extensive drivers, challenges, restraints, opportunities, present market ...
- A Deep Learning Tool for Faster, Better Heart Disease Diagnoseson June 30, 2021 at 7:00 am
A new deep learning tool could help slash the time it takes to interpret cardiology scans to diagnose obstructive coronary artery disease by 75 percent. Th | Clinical And Molecular Dx ...
- Here’s how deep learning helps computers detect objectson June 28, 2021 at 8:30 am
Today, many applications use object-detection networks as one of their main components. It’s in your phone, computer, car, camera, and more.
- Deep Instinct: AI, deep learning tools can help prevent cyberattackson June 23, 2021 at 10:35 pm
In Deep Instinct's Voice of SecOps report, 86% of respondents said tools driven by AI, ML, and deep learning would help fight cyberattacks.
- Deep Learning Is Our Best Hope for Cybersecurity, Deep Instinct Sayson June 22, 2021 at 1:05 pm
Thanks to the exponential growth of malware, traditional heuristics-based detection regimes have been overwhelmed, leaving computers at risk. Machine ...
- Global Deep Learning Markets to 2025 - Increasing Demand for Big Data Analytics Due to Huge Unstructured Data Generation at End-Use Industry Siteson June 21, 2021 at 1:51 pm
The report provides an overview of the global market for deep learning and analyzes market trends. Using 2019 as the base year, the report provides estimated market data for the forecast period of ...
- Deep learning application to MRI could cut scan time in halfon June 21, 2021 at 12:19 pm
Magnetic resonance imaging (MRI) is a non-invasive diagnostic tool used to detect and evaluate brain disease, musculoskeletal damage, cardiovascular disease and cancer. Though MRI has many advantages ...
- Microscopy deep learning predicts viral infectionson June 21, 2021 at 7:37 am
When viruses infect a cell, changes in the cell nucleus occur, and these can be observed through fluorescence microscopy. Using fluoresence images made in live cells, researchers at the University of ...
via Bing News