“Humans and machine algorithms have complementary strengths and weaknesses,” says study co-author Mark Steyvers (right), UCI professor of cognitive sciences, here with fellow co-author Padhraic Smyth, UCI Chancellor’s Professor of computer science.
“Each uses different sources of information and strategies to make predictions and decisions.” Steve Zylius / UCI
From chatbots that answer tax questions to algorithms that drive autonomous vehicles and dish out medical diagnoses, artificial intelligence undergirds many aspects of daily life. Creating smarter, more accurate systems requires a hybrid human-machine approach, according to researchers at the University of California, Irvine. In a study published this month in Proceedings of the National Academy of Sciences, they present a new mathematical model that can improve performance by combining human and algorithmic predictions and confidence scores.
“Humans and machine algorithms have complementary strengths and weaknesses. Each uses different sources of information and strategies to make predictions and decisions,” said co-author Mark Steyvers, UCI professor of cognitive sciences. “We show through empirical demonstrations as well as theoretical analyses that humans can improve the predictions of AI even when human accuracy is somewhat below [that of] the AI – and vice versa. And this accuracy is higher than combining predictions from two individuals or two AI algorithms.”
To test the framework, researchers conducted an image classification experiment in which human participants and computer algorithms worked separately to correctly identify distorted pictures of animals and everyday items – chairs, bottles, bicycles, trucks. The human participants ranked their confidence in the accuracy of each image identification as low, medium or high, while the machine classifier generated a continuous score. The results showed large differences in confidence between humans and AI algorithms across images.
“In some cases, human participants were quite confident that a particular picture contained a chair, for example, while the AI algorithm was confused about the image,” said co-author Padhraic Smyth, UCI Chancellor’s Professor of computer science. “Similarly, for other images, the AI algorithm was able to confidently provide a label for the object shown, while human participants were unsure if the distorted picture contained any recognizable object.”
When predictions and confidence scores from both were combined using the researchers’ new Bayesian framework, the hybrid model led to better performance than either human or machine predictions achieved alone.
“While past research has demonstrated the benefits of combining machine predictions or combining human predictions – the so-called ‘wisdom of the crowds’ – this work forges a new direction in demonstrating the potential of combining human and machine predictions, pointing to new and improved approaches to human-AI collaboration,” Smyth said.
This interdisciplinary project was facilitated by the Irvine Initiative in AI, Law, and Society. The convergence of cognitive sciences – which are focused on understanding how humans think and behave – with computer science – in which technologies are produced – will provide further insight into how humans and machines can collaborate to build more accurate artificially intelligent systems, the researchers said.
Original Article: UCI researchers develop hybrid human-machine framework for building smarter AI
More from: University of California Irvine
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Human-AI collaboration
- Optimize AI Outputs With a Repeatable, Scalable Human QC Process
By sharing what's worked for us, I aim to arm you with practical tips to enhance your processes and start to view gen AI as a must-have tool in your toolbox.
- TCS to Open Human-Centric AI Centre of Excellence in Paris
TCS announces the launch of a unique AI Centre of Excellence in Paris, focusing on societal benefits and business efficiencies.
- Cat collaboration demonstrates what it takes to trust robots
Would you trust a robot to look after your cat? New research suggests it takes more than a carefully designed robot to care for your cat, the environment in which they operate is also vital, as well ...
- Google to Showcase AI Advancement at Annual Developer Conference
Explore Google's cutting-edge AI developments at I/O conference! From generative AI to Gemini integration, discover the future of tech innovation.
- LuminAI puts human dancers and AI on the same stage
Dance and computers are having a moment with LuminAI, a collaboration between Kennesaw State University Dance Department and Georgia Tech.
Go deeper with Google Headlines on:
Human-AI collaboration
[google_news title=”” keyword=”human-AI collaboration” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Combining machine and human predictions
- AI Helps to Predict Avalanches in Switzerland
The Swiss Institute for Snow & Avalanche Research has been using Artificial Intelligence in a three-year research projec ...
- This is how product designers can thrive when AI augmentation is everywhere
Product designers will move away from making decisions about particular visuals and UI elements and toward understanding of CX.
- The Best Nespresso Pods You Can Buy at the Grocery Store
When you buy through our links, we may earn a commission. Learn more› By Ciara Murray Jordan Ciara Murray Jordan is a writer covering kitchen gear. She has meticulously tested a range of things, from ...
- Why Collaborative Intelligence Is the Future of AI
Remarkable outcomes were only achieved in organizations that embraced collaborative intelligence—the harmonious collaboration between humans and machines. By combining AI and human intelligence, we ...
- RPA, Machine Learning, AI: What's the Difference and How to Combine?
The current strong digital transformation has brought businesses closer to concepts such as AI, RPA and Machine Learnin ...
Go deeper with Google Headlines on:
Combining machine and human predictions
[google_news title=”” keyword=”combining machine and human predictions” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]