“Humans and machine algorithms have complementary strengths and weaknesses,” says study co-author Mark Steyvers (right), UCI professor of cognitive sciences, here with fellow co-author Padhraic Smyth, UCI Chancellor’s Professor of computer science.
“Each uses different sources of information and strategies to make predictions and decisions.” Steve Zylius / UCI
From chatbots that answer tax questions to algorithms that drive autonomous vehicles and dish out medical diagnoses, artificial intelligence undergirds many aspects of daily life. Creating smarter, more accurate systems requires a hybrid human-machine approach, according to researchers at the University of California, Irvine. In a study published this month in Proceedings of the National Academy of Sciences, they present a new mathematical model that can improve performance by combining human and algorithmic predictions and confidence scores.
“Humans and machine algorithms have complementary strengths and weaknesses. Each uses different sources of information and strategies to make predictions and decisions,” said co-author Mark Steyvers, UCI professor of cognitive sciences. “We show through empirical demonstrations as well as theoretical analyses that humans can improve the predictions of AI even when human accuracy is somewhat below [that of] the AI – and vice versa. And this accuracy is higher than combining predictions from two individuals or two AI algorithms.”
To test the framework, researchers conducted an image classification experiment in which human participants and computer algorithms worked separately to correctly identify distorted pictures of animals and everyday items – chairs, bottles, bicycles, trucks. The human participants ranked their confidence in the accuracy of each image identification as low, medium or high, while the machine classifier generated a continuous score. The results showed large differences in confidence between humans and AI algorithms across images.
“In some cases, human participants were quite confident that a particular picture contained a chair, for example, while the AI algorithm was confused about the image,” said co-author Padhraic Smyth, UCI Chancellor’s Professor of computer science. “Similarly, for other images, the AI algorithm was able to confidently provide a label for the object shown, while human participants were unsure if the distorted picture contained any recognizable object.”
When predictions and confidence scores from both were combined using the researchers’ new Bayesian framework, the hybrid model led to better performance than either human or machine predictions achieved alone.
“While past research has demonstrated the benefits of combining machine predictions or combining human predictions – the so-called ‘wisdom of the crowds’ – this work forges a new direction in demonstrating the potential of combining human and machine predictions, pointing to new and improved approaches to human-AI collaboration,” Smyth said.
This interdisciplinary project was facilitated by the Irvine Initiative in AI, Law, and Society. The convergence of cognitive sciences – which are focused on understanding how humans think and behave – with computer science – in which technologies are produced – will provide further insight into how humans and machines can collaborate to build more accurate artificially intelligent systems, the researchers said.
Original Article: UCI researchers develop hybrid human-machine framework for building smarter AI
More from: University of California Irvine
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Human-AI collaboration
- Fostering team collaboration in the age of generative AI
Generative AI is already having a profound impact on the corporate landscape and is set to revolutionise how we work. Accenture's research indicates that 45% of working hours in Australia are in scope ...
- Navigating the AI Frontier: Moknia's Human-Centric Approach to Audio Creation
Moknia's Human-Centric Approach to Audio Creation New York, United States - April 27, 2024 — The landscape of audio creation is undergoing a transformative shift, propelled by the rapid advancements ...
- Interview: AI can be friendly force in human-machine collaboration era, says Siemens senior official
HANNOVER, Germany, April 26 (Xinhua) -- Artificial Intelligence (AI) can become man's best friend in the industrial world in the new era of human-machine collaboration, a senior official at Siemens ...
- The Human-AI Partnership: Tomedes and MachineTranslation.com's Collaborative Approach to Translation
In today's increasingly interconnected world, the demand for accurate and culturally sensitive translations has skyrocketed.
- The Future of Workspace Collaboration: How Businesses Can Optimise Operations
The dynamics of workspace collaboration are evolving rapidly, driven in part by the adoption of transformation solutions. This evolution is not just a trend but a critical shift towards enhancing ...
Go deeper with Google Headlines on:
Human-AI collaboration
[google_news title=”” keyword=”human-AI collaboration” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Combining machine and human predictions
- Crypto Trader Jacob Bury Invests In New Meme Coin Crypto Presale Project With High Staking APY – $WAI
Some meme coins offer passive income through yield farming. Jacob Bury recently reviewed WienerAI, boasting a high staking APY over 1500%. WienerAI offers a unique and profitable crypto opportunity, ...
- Latrine removal operation on Smith River ushers in new era of human waste management
Starting this year, floaters are now required to carry with them something they have always been able to leave behind — their excrement.
- Human Vs. Machine: Will AI Replace Content Creators?
The creator economy is booming, with more people than ever monetizing their passions, but could AI reshape the landscape and replace creators altogether?
- 2024 NFL Draft: Day 1 quick-snap grades for all 32 teams
Chad Reuter reveals his quick-snap grades for all 32 teams based on their decisions from Day 1 of the 2024 NFL Draft.
- Health Intelligent Virtual Assistant Market Predictions: CAGR of 36.8%, Reaching USD 20,901.0 Mn by 2032 | Insights by Dimension Market Research
In the coming years, the Global Health Intelligent Virtual Assistant Market is expected to show significant growth driven by development in AI, automation, and natural language processing. Integration ...
Go deeper with Google Headlines on:
Combining machine and human predictions
[google_news title=”” keyword=”combining machine and human predictions” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]