“Humans and machine algorithms have complementary strengths and weaknesses,” says study co-author Mark Steyvers (right), UCI professor of cognitive sciences, here with fellow co-author Padhraic Smyth, UCI Chancellor’s Professor of computer science.
“Each uses different sources of information and strategies to make predictions and decisions.” Steve Zylius / UCI
From chatbots that answer tax questions to algorithms that drive autonomous vehicles and dish out medical diagnoses, artificial intelligence undergirds many aspects of daily life. Creating smarter, more accurate systems requires a hybrid human-machine approach, according to researchers at the University of California, Irvine. In a study published this month in Proceedings of the National Academy of Sciences, they present a new mathematical model that can improve performance by combining human and algorithmic predictions and confidence scores.
“Humans and machine algorithms have complementary strengths and weaknesses. Each uses different sources of information and strategies to make predictions and decisions,” said co-author Mark Steyvers, UCI professor of cognitive sciences. “We show through empirical demonstrations as well as theoretical analyses that humans can improve the predictions of AI even when human accuracy is somewhat below [that of] the AI – and vice versa. And this accuracy is higher than combining predictions from two individuals or two AI algorithms.”
To test the framework, researchers conducted an image classification experiment in which human participants and computer algorithms worked separately to correctly identify distorted pictures of animals and everyday items – chairs, bottles, bicycles, trucks. The human participants ranked their confidence in the accuracy of each image identification as low, medium or high, while the machine classifier generated a continuous score. The results showed large differences in confidence between humans and AI algorithms across images.
“In some cases, human participants were quite confident that a particular picture contained a chair, for example, while the AI algorithm was confused about the image,” said co-author Padhraic Smyth, UCI Chancellor’s Professor of computer science. “Similarly, for other images, the AI algorithm was able to confidently provide a label for the object shown, while human participants were unsure if the distorted picture contained any recognizable object.”
When predictions and confidence scores from both were combined using the researchers’ new Bayesian framework, the hybrid model led to better performance than either human or machine predictions achieved alone.
“While past research has demonstrated the benefits of combining machine predictions or combining human predictions – the so-called ‘wisdom of the crowds’ – this work forges a new direction in demonstrating the potential of combining human and machine predictions, pointing to new and improved approaches to human-AI collaboration,” Smyth said.
This interdisciplinary project was facilitated by the Irvine Initiative in AI, Law, and Society. The convergence of cognitive sciences – which are focused on understanding how humans think and behave – with computer science – in which technologies are produced – will provide further insight into how humans and machines can collaborate to build more accurate artificially intelligent systems, the researchers said.
Original Article: UCI researchers develop hybrid human-machine framework for building smarter AI
More from: University of California Irvine
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Human-AI collaboration
- From data literacy to AI skills: Vital traits you need in today's workforce
Leveraging that data requires collaboration, said Cindi Howson ... Comfortable working with AI and robots Most experts agree the future of artificial intelligence is the future of work.
- A.I. joins Louisville Orchestra for musical collaboration of human and machine
Audiences at this weekend’s Louisville Orchestra performance will be treated to one live soloist, and one appearing in the form of a hologram – both given sound by cellist Yves Dhar. The hologram ...
- Using human-centered design to power AI for contract analysis
Advances in AI have allowed for innovative uses in a variety of industries, including law, regulatory compliance, tax & accounting, and other corporate work ...
- Advanced online biometrics applications explored by Humans.ai, Digital Domain, Kakao
Several developers in the biometrics space have made new announcements related to advanced applications powered by artificial intelligence.
- USA – Geoffrey Vance On The AI-Human Partnership, Collaboration, And Compassion.
The most promising potential in artificial intelligence comes not from what it can do in a vacuum, but how it can work side-by-side with human collaborators to deliver insights neither could’ve ...
Go deeper with Google Headlines on:
Human-AI collaboration
Go deeper with Bing News on:
Combining machine and human predictions
- AI Detects Cancer and Preserves Privacy With Blockchain
Artificial intelligence (AI) machine learning is emerging as a useful tool to assist cancer clinicians. A new study published in Nature Medicine shows how combining AI edge computing with swarm ...
- Artificial Intelligence
Our research efforts aim to understand the nature of visual perception so that we can create more visually intelligent machines. This is enabled via fundamental concepts in reasoning, prediction ...
- Programming agility
It’s about programming the robots to comprehend the complexities of their environment and act accordingly so that they don’t fall over an ant hill or get tripped up by the dog. “It’s like a weird ...
- How to compete with robots
By combining the scientific and technical literature on robotic abilities with employment and wage statistics, they have developed a method to calculate which of the currently existing jobs are more ...
- Explainable AI for Fraud Prevention
Artificial intelligence has evolved rapidly during the last few years and is being applied across industries for endless use cases as a powerful and innovative tool. However, great responsibility ...