Achieving accuracy and fairness in machine learning systems intended for use in social decision making is possible but designing those systems requires venturing off the simple and obvious paths.
Image credit: Falaah Arif Khan
CMU Researchers Dispel Theoretical Assumption About ML Trade-Offs in Policy Decisions
Carnegie Mellon University researchers are challenging a long-held assumption that there is a trade-off between accuracy and fairness when using machine learning to make public policy decisions.
As the use of machine learning has increased in areas such as criminal justice, hiring, health care delivery and social service interventions, concerns have grown over whether such applications introduce new or amplify existing inequities, especially among racial minorities and people with economic disadvantages. To guard against this bias, adjustments are made to the data, labels, model training, scoring systems and other aspects of the machine learning system. The underlying theoretical assumption is that these adjustments make the system less accurate.
A CMU team aims to dispel that assumption in a new study, recently published in Nature Machine Intelligence. Rayid Ghani, a professor in the School of Computer Science’s Machine Learning Department and the Heinz College of Information Systems and Public Policy; Kit Rodolfa, a research scientist in ML; and Hemank Lamba, a post-doctoral researcher in SCS, tested that assumption in real-world applications and found the trade-off was negligible in practice across a range of policy domains.
“You actually can get both. You don’t have to sacrifice accuracy to build systems that are fair and equitable,” Ghani said. “But it does require you to deliberately design systems to be fair and equitable. Off-the-shelf systems won’t work.”
Ghani and Rodolfa focused on situations where in-demand resources are limited, and machine learning systems are used to help allocate those resources. The researchers looked at systems in four areas: prioritizing limited mental health care outreach based on a person’s risk of returning to jail to reduce reincarceration; predicting serious safety violations to better deploy a city’s limited housing inspectors; modeling the risk of students not graduating from high school in time to identify those most in need of additional support; and helping teachers reach crowdfunding goals for classroom needs.
In each context, the researchers found that models optimized for accuracy — standard practice for machine learning — could effectively predict the outcomes of interest but exhibited considerable disparities in recommendations for interventions. However, when the researchers applied adjustments to the outputs of the models that targeted improving their fairness, they discovered that disparities based on race, age or income — depending on the situation — could be removed without a loss of accuracy.
Ghani and Rodolfa hope this research will start to change the minds of fellow researchers and policymakers as they consider the use of machine learning in decision making.
“We want the artificial intelligence, computer science and machine learning communities to stop accepting this assumption of a trade-off between accuracy and fairness and to start intentionally designing systems that maximize both,” Rodolfa said. “We hope policymakers will embrace machine learning as a tool in their decision making to help them achieve equitable outcomes.”
Original Article: Machine Learning Can Be Fair and Accurate
More from: Carnegie Mellon University
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Machine learning fairness
- Ensuring the fairness of algorithms that predict patient disease risk
"To treat or not to treat?" is the question continually faced by clinicians. To help with their decision making, some turn to disease risk prediction models. These models forecast which patients are ...
- Stanford University: Ensuring the Fairness of Algorithms that Predict Patient Disease Risk
To help with their decision making, some turn to disease risk prediction models. These models forecast which patients are more or less likely to develop disease and thus could benefit from treatment, ...
- Algorithmic Fairness: Mitigating Bias in Healthcare AI
AI models that are "fairness-aware" attempt to equalize ... where you adjust the outputs of the machine learning model to be more fair. One preprocessing approach is "re-weighting" data from ...
- Technical Perspective: Can Data Structures Treat Us Fairly?
In "Sampling Near Neighbors in Search for Fairness," Aumüller et al. investigate a basic problem in similarity search called near neighbor in the context of fair data structures.
- New Governance Course from Amii and CIOSC charts path toward responsible AI in business
The Alberta Machine Intelligence Institute (Amii) and the CIO Strategy Council (CIOSC) have launched a new Artificial Intelligence (AI) Governance course to empower startups and small and medium ...
Go deeper with Google Headlines on:
Machine learning fairness
Go deeper with Bing News on:
- FeatureByte Raises $5.7M to Fix the Weakest Link in AI
FeatureByte, the developer of a feature engineering platform, has launched from stealth with a $5.7 million seed round. The Boston-based startup bills its ...
- A New Learning Method Could Help People With Autism Improve Visual Perception Capabilities
A newly proposed learning method for those on the autism spectrum accelerates the learning process and can help to improve visual perception.
- Why AI and machine learning are drifting away from the cloud
Cloud computing isn’t going anywhere, but some companies are shifting their machine learning data and models to their own machines they manage in-house. Adopters are spending less money and getting ...
- Detroit’s Waymark Launches Machine Learning Platform to Speed Video Creation
Waymark in Detroit announced the next generation of its platform to allow to scripting, production, and customization of videos in minutes.
- Viewpoint: How machine learning is revolutionizing e-commerce
The retail landscape is rapidly changing due to the consumer’s desire for speed and instant gratification. Machine learning is removing friction from the process.