
A Duke team trained a computer to identify up to 200 species of birds from just a photo. Given a photo of a mystery bird (top), the A.I. spits out heat maps showing which parts of the image are most similar to typical species features it has seen before
New research aims to open the ‘black box’ of computer vision
It can take years of birdwatching experience to tell one species from the next. But using an artificial intelligence technique called deep learning, Duke University researchers have trained a computer to identify up to 200 species of birds from just a photo.
The real innovation, however, is that the A.I. tool also shows its thinking, in a way that even someone who doesn’t know a penguin from a puffin can understand.
The team trained their deep neural network — algorithms based on the way the brain works — by feeding it 11,788 photos of 200 bird species to learn from, ranging from swimming ducks to hovering hummingbirds.
The researchers never told the network “this is a beak” or “these are wing feathers.” Given a photo of a mystery bird, the network is able to pick out important patterns in the image and hazard a guess by comparing those patterns to typical species traits it has seen before.
Along the way it spits out a series of heat maps that essentially say: “This isn’t just any warbler. It’s a hooded warbler, and here are the features — like its masked head and yellow belly — that give it away.”
Duke computer science Ph.D. student Chaofan Chen and undergraduate Oscar Li led the research, along with other team members of the Prediction Analysis Lab directed by Duke professor Cynthia Rudin.
They found their neural network is able to identify the correct species up to 84% of the time — on par with some of its best-performing counterparts, which don’t reveal how they are able to tell, say, one sparrow from the next.
Rudin says their project is about more than naming birds. It’s about visualizing what deep neural networks are really seeing when they look at an image.
Similar technology is used to tag people on social networking sites, spot suspected criminals in surveillance cameras, and train self-driving cars to detect things like traffic lights and pedestrians.
The problem, Rudin says, is that most deep learning approaches to computer vision are notoriously opaque. Unlike traditional software, deep learning software learns from the data without being explicitly programmed. As a result, exactly how these algorithms ‘think’ when they classify an image isn’t always clear.
Rudin and her colleagues are trying to show that A.I. doesn’t have to be that way. She and her lab are designing deep learning models that explain the reasoning behind their predictions, making it clear exactly why and how they came up with their answers. When such a model makes a mistake, its built-in transparency makes it possible to see why.
For their next project, Rudin and her team are using their algorithm to classify suspicious areas in medical images like mammograms. If it works, their system won’t just help doctors detect lumps, calcifications and other symptoms that could be signs of breast cancer. It will also show which parts of the mammogram it’s homing in on, revealing which specific features most resemble the cancerous lesions it has seen before in other patients.
In that way, Rudin says, their network is designed to mimic the way doctors make a diagnosis. “It’s case-based reasoning,” Rudin said. “We’re hoping we can better explain to physicians or patients why their image was classified by the network as either malignant or benign.”
Learn more: THIS A.I. BIRDWATCHER LETS YOU ‘SEE’ THROUGH THE EYES OF A MACHINE
The Latest on: Deep learning
via Google News
The Latest on: Deep learning
- Predicts the onset of Alzheimer's Disease (AD) using deep learning-based Splice-AIon February 26, 2021 at 9:02 pm
This study reported for the first time, which identified the gene mutations and abnormal splicing of PLCg1 gene in AD using both high-throughput screening data and a deep learning-based prediction (Sp ...
- Deep Learning Market Share, Development by Companies Outlook, Growth Prospects and Key Opportunities by 2030on February 26, 2021 at 8:51 am
The Deep Learning Market Share is expected to exceed more than US$ 18 Billion by 2024 at a CAGR of 42% in the given ...
- Improved protein structure refinement guided by deep learning based accuracy estimationon February 26, 2021 at 2:52 am
Here the authors present DeepAccNet, a deep learning framework that estimates per-residue accuracy and residue-residue distance signed error in protein models, which are used to guide Rosetta protein ...
- DeepCube’s suite of products drives enterprise adoption of deep learningon February 25, 2021 at 7:01 pm
DeepCube offerings enable up to 10x boost for deep learning deployments on intelligent edge devices and in data centers.
- Deep learning market is expected to grow at a CAGR of around 51.1% over the forecast period 2019 to 2026on February 25, 2021 at 4:03 pm
The global deep learning market is expected to grow at a CAGR of around 51.1% over the forecast period 2019 to 2026 and reach the market value of over US$ 56,427.2 million by 2026. North America held ...
- Deep learning identification for citizen science surveillance of tiger mosquitoes | Scientific Reportson February 25, 2021 at 6:10 am
There are more than 3600 known species of mosquitoes 1, 2. The majority are harmless to humans but a few dozen transmit diseases. Because of these species, mosquitoes are often referred to as the ...
- Interested In AI? Master Deep Learning & Get NLP Certifiedon February 24, 2021 at 9:21 am
The world of artificial intelligence (AI) is revolutionizing the way we live, though it has become something of an acronym soup. From DL to ML, SSD to CN ...
- 3-D holographic microscopy powered by deep-learning deciphers cancer immunotherapyon February 24, 2021 at 7:35 am
Live tracking and analyzing of the dynamics of chimeric antigen receptor (CAR) T-cells targeting cancer cells can open new avenues for the development of cancer immunotherapy. However, imaging via ...
- DeepCube Launches Product Suite to Accelerate Enterprise Adoption of Deep Learningon February 24, 2021 at 6:08 am
DeepCube, the award-winning deep learning pioneer, today announced the launch of a new suite of products and services to help drive enterprise adoption of deep learning, at scale, on intelligent edge ...
- AI: IBM showcases new energy-efficient chip to power deep learningon February 18, 2021 at 7:35 am
IBM researchers have designed an AI accelerator chip that boosts performance, but not energy bills. By Daphne Leprince-Ringuet | February 18, 2021 -- 15:00 GMT (07:00 PST) | Topic: Innovation IBM's ...
via Bing News