via AIs.Nonymous
Researchers are developing a way to incorporate one of the most human of characteristics – uncertainty – into machine learning systems.
Human error and uncertainty are concepts that many artificial intelligence systems fail to grasp, particularly in systems where a human provides feedback to a machine learning model. Many of these systems are programmed to assume that humans are always certain and correct, but real-world decision-making includes occasional mistakes and uncertainty.
Researchers from the University of Cambridge, along with The Alan Turing Institute, Princeton, and Google DeepMind, have been attempting to bridge the gap between human behaviour and machine learning, so that uncertainty can be more fully accounted for in AI applications where humans and machines are working together. This could help reduce risk and improve trust and reliability of these applications, especially where safety is critical, such as medical diagnosis.
Uncertainty is central in how humans reason about the world but many AI models fail to take this into account
Katherine Collins
The team adapted a well-known image classification dataset so that humans could provide feedback and indicate their level of uncertainty when labelling a particular image. The researchers found that training with uncertain labels can improve these systems’ performance in handling uncertain feedback, although humans also cause the overall performance of these hybrid systems to drop. Their results will be reported at the AAAI/ACM Conference on Artificial Intelligence, Ethics and Society (AIES 2023) in Montréal.
‘Human-in-the-loop’ machine learning systems – a type of AI system that enables human feedback – are often framed as a promising way to reduce risks in settings where automated models cannot be relied upon to make decisions alone. But what if the humans are unsure?
“Uncertainty is central in how humans reason about the world but many AI models fail to take this into account,” said first author Katherine Collins from Cambridge’s Department of Engineering. “A lot of developers are working to address model uncertainty, but less work has been done on addressing uncertainty from the person’s point of view.”
We are constantly making decisions based on the balance of probabilities, often without really thinking about it. Most of the time – for example, if we wave at someone who looks just like a friend but turns out to be a total stranger – there’s no harm if we get things wrong. However, in certain applications, uncertainty comes with real safety risks.
“Many human-AI systems assume that humans are always certain of their decisions, which isn’t how humans work – we all make mistakes,” said Collins. “We wanted to look at what happens when people express uncertainty, which is especially important in safety-critical settings, like a clinician working with a medical AI system.”
“We need better tools to recalibrate these models, so that the people working with them are empowered to say when they’re uncertain,” said co-author Matthew Barker, who recently completed his MEng degree at Gonville & Caius College, Cambridge. “Although machines can be trained with complete confidence, humans often can’t provide this, and machine learning models struggle with that uncertainty.”
For their study, the researchers used some of the benchmark machine learning datasets: one was for digit classification, another for classifying chest X-rays, and one for classifying images of birds. For the first two datasets, the researchers simulated uncertainty, but for the bird dataset, they had human participants indicate how certain they were of the images they were looking at: whether a bird was red or orange, for example. These annotated ‘soft labels’ provided by the human participants allowed the researchers to determine how the final output was changed. However, they found that performance degraded rapidly when machines were replaced with humans.
“We know from decades of behavioural research that humans are almost never 100% certain, but it’s a challenge to incorporate this into machine learning,” said Barker. “We’re trying to bridge the two fields so that machine learning can start to deal with human uncertainty where humans are part of the system.”
The researchers say their results have identified several open challenges when incorporating humans into machine learning models. They are releasing their datasets so that further research can be carried out and uncertainty might be built into machine learning systems.
“As some of our colleagues so brilliantly put it, uncertainty is a form of transparency, and that’s hugely important,” said Collins. “We need to figure out when we can trust a model and when to trust a human and why. In certain applications, we’re looking at probability over possibilities. Especially with the rise of chatbots, for example, we need models that better incorporate the language of possibility, which may lead to a more natural, safe experience.”
“In some ways, this work raised more questions than it answered,” said Barker. “But even though humans may be miscalibrated in their uncertainty, we can improve the trustworthiness and reliability of these human-in-the-loop systems by accounting for human behaviour.”
Original Article: How sure is sure? Incorporating human error into machine learning
More from: University of Cambridge | Alan Turing Institute | Princeton University
The Latest Updates from Bing News
Go deeper with Bing News on:
Uncertainty in machine learning systems
- MIT Technology Review
In many high-stakes situations, large language models are not worth the risk. Knowing which outputs to throw out might fix that.
- How AI Can Help You in Life & Business
Upwork research shows that business leaders are split on the exact impact generative AI, also known as GenAI, will have on job disruption. 42% say that the technology is primarily an augmentation tool ...
- Machine learning and experiment
For more than 20 years in experimental particle physics and astrophysics, machine learning has been accelerating the pace of science, helping scientists tackle problems of greater and greater ...
- Dealing With AI/ML Uncertainty
How neural network-based AI systems perform under the hood is currently unknown, but the industry is finding ways to live with a black box.
- Randomised controlled trials evaluating artificial intelligence in clinical practice: a scoping review
This scoping review of randomised controlled trials on artificial intelligence (AI) in clinical practice reveals an expanding interest in AI across clinical specialties and locations. The USA and ...
Go deeper with Bing News on:
Uncertainty in artificial intelligence
- What If a Client Asks ChatGPT About the Elections?
A veteran advisor asked ChatGPT to emulate a financial advisor. The AI program gave a pretty good answer. Part of the advice: The users should talk to someone like you. With it being an election year, ...
- Economic uncertainty clouds AI’s potential to drive a tech supercycle
This high-pitched inquiry makes us wonder if Artificial Intelligence will cause a tablet “and laptop” supercycle within the next year or two. The AI supercycle debate A supercycle era sees a ...
- U.S. Bank CFO Survey: Corporate Finance Leaders Tighten Belts Amid Uncertainty
U.S. corporate finance leaders have increased focus on cutting costs to prepare their firms for potential economic and geopolitical uncertainty, according to the fourth annual U.S. Bank CFO Insights ...
- Artificial intelligence (AI): The 'new employee' - Its impact on work and workforce
As businesses embrace the adoption and integrate Artificial Intelligence (AI) technologies in the business operations, it will certainly bring about various changes, including impacts on employees, ...
- Why BigBear.ai, Super Micro Computer, Arm Holdings, and Other Artificial Intelligence (AI) Stocks Surged on Tuesday
Investing in the latest developments in artificial intelligence (AI) has been a wild ride over the past year or so. However, over the past few weeks, investors have had that sinking feeling as many of ...