New research aims to open the ‘black box’ of computer vision
It can take years of birdwatching experience to tell one species from the next. But using an artificial intelligence technique called deep learning, Duke University researchers have trained a computer to identify up to 200 species of birds from just a photo.
The real innovation, however, is that the A.I. tool also shows its thinking, in a way that even someone who doesn’t know a penguin from a puffin can understand.
The team trained their deep neural network — algorithms based on the way the brain works — by feeding it 11,788 photos of 200 bird species to learn from, ranging from swimming ducks to hovering hummingbirds.
The researchers never told the network “this is a beak” or “these are wing feathers.” Given a photo of a mystery bird, the network is able to pick out important patterns in the image and hazard a guess by comparing those patterns to typical species traits it has seen before.
Along the way it spits out a series of heat maps that essentially say: “This isn’t just any warbler. It’s a hooded warbler, and here are the features — like its masked head and yellow belly — that give it away.”
Duke computer science Ph.D. student Chaofan Chen and undergraduate Oscar Li led the research, along with other team members of the Prediction Analysis Lab directed by Duke professor Cynthia Rudin.
They found their neural network is able to identify the correct species up to 84% of the time — on par with some of its best-performing counterparts, which don’t reveal how they are able to tell, say, one sparrow from the next.
Rudin says their project is about more than naming birds. It’s about visualizing what deep neural networks are really seeing when they look at an image.
Similar technology is used to tag people on social networking sites, spot suspected criminals in surveillance cameras, and train self-driving cars to detect things like traffic lights and pedestrians.
The problem, Rudin says, is that most deep learning approaches to computer vision are notoriously opaque. Unlike traditional software, deep learning software learns from the data without being explicitly programmed. As a result, exactly how these algorithms ‘think’ when they classify an image isn’t always clear.
Rudin and her colleagues are trying to show that A.I. doesn’t have to be that way. She and her lab are designing deep learning models that explain the reasoning behind their predictions, making it clear exactly why and how they came up with their answers. When such a model makes a mistake, its built-in transparency makes it possible to see why.
For their next project, Rudin and her team are using their algorithm to classify suspicious areas in medical images like mammograms. If it works, their system won’t just help doctors detect lumps, calcifications and other symptoms that could be signs of breast cancer. It will also show which parts of the mammogram it’s homing in on, revealing which specific features most resemble the cancerous lesions it has seen before in other patients.
In that way, Rudin says, their network is designed to mimic the way doctors make a diagnosis. “It’s case-based reasoning,” Rudin said. “We’re hoping we can better explain to physicians or patients why their image was classified by the network as either malignant or benign.”
Learn more: THIS A.I. BIRDWATCHER LETS YOU ‘SEE’ THROUGH THE EYES OF A MACHINE
The Latest on: Deep learning
[google_news title=”” keyword=”deep learning” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Deep learning
- Scientists use deep learning algorithms to predict political ideology based on facial characteristicson May 27, 2023 at 8:30 am
A new study in Denmark used machine learning techniques on photographs of faces of Danish politicians to predict whether their political ideology is left- or right-wing. The accuracy of predictions ...
- Deep Learning Aids Development of Super-Resolution Ultrasoundon May 26, 2023 at 8:03 am
Researchers at the Beckman Institute for Advanced Science and Technology used deep learning to develop a new framework for super-resolution ultrasound.
- How AI and Machine Learning Will Transform Your Legal Departmenton May 25, 2023 at 8:18 am
With 80% of executives believing that automation can be applied to any business decision, AI and ML tools are currently the most popular area where business IT departments will invest in 2023.
- Deep learning–based computer-aided diagnosis for breast lesion classificationon May 24, 2023 at 9:51 pm
According to an accepted manuscript published in ARRS' own American Journal of Roentgenology (AJR), deep learning–based computer-aided diagnosis (CAD) for breast lesion classification on ultrasound ...
- Fighting off pests with deep learning and droneson May 22, 2023 at 8:56 am
Early detection of pest infestation is an important first step in the adoption of control measures that can be tailored to specific local conditions. Remote sensing technology can be a helpful tool, ...
- Deep learning system can analyze images to protect deep-sea coral reefs much faster than humanson May 18, 2023 at 9:10 am
Hundreds of meters below the ocean's surface, where the sunlight gives way to darkness, coral reefs play host to a remarkable range of bottom-dwelling species. These deep-sea reefs are home to squat ...
- Machine Learning vs. Deep Learningon May 17, 2023 at 4:30 pm
Machine learning and deep learning are both core technologies of artificial intelligence. Yet there are key differences between them. Machine learning and deep learning are both core technologies ...
- What Is Deep Learning?on May 14, 2023 at 11:39 pm
Deep learning, an advanced artificial intelligence technique, has become increasingly popular in the past few years, thanks to abundant data and increased computing power. It's the main technology ...
- The 7 Must-Know Deep Learning Algorithmson May 9, 2023 at 11:37 am
The field of artificial intelligence (AI) has grown rapidly in recent times, leading to the development of deep learning algorithms. With the launch of AI tools such as DALL-E and OpenAI ...
- What is Deep Learning?on May 7, 2023 at 2:13 am
Deep learning is a subset of machine learning that uses artificial neural networks to learn in a hierarchical fashion, similar to the way the brain works. Deep learning algorithms can ...
via Bing News