“In most cases, companies do not offer any explanation about how they gain access to users’ profiles, from where they collect the data, and with whom they trade their data. It’s not just fairness that’s at stake; it’s also trust.”
Tae Wan Kim
Associate Professor of Business Ethics
Increasingly, businesses rely on algorithms that use data provided by users to make decisions that affect people. For example, Amazon, Google, and Facebook use algorithms to tailor what users see, and Uber and Lyft use them to match passengers with drivers and set prices. Do users, customers, employees, and others have a right to know how companies that use algorithms make their decisions?
In a new analysis, researchers explore the moral and ethical foundations to such a right. They conclude that the right to such an explanation is a moral right, then address how companies might do so.
The analysis, by researchers at Carnegie Mellon University, appears in Business Ethics Quarterly, a publication of the Society for Business Ethics.
“In most cases, companies do not offer any explanation about how they gain access to users’ profiles, from where they collect the data, and with whom they trade their data,” explains Tae Wan Kim, Associate Professor of Business Ethics at Carnegie Mellon University’s Tepper School of Business, who co-wrote the analysis. “It’s not just fairness that’s at stake; it’s also trust.”
In response to the rise of autonomous decision-making algorithms and their reliance on data provided by users, a growing number of computer scientists and governmental bodies have called for transparency under the broad concept of algorithmic accountability. For example, the European Parliament and the Council of the European Union adopted the General Data Protection Regulation (GDPR) in 2016, part of which regulates the use of automatic algorithmic decision systems. The GDPR, which launched in 2018, affects businesses that process the personally identifiable information of residents of the European Union.
But the GDPR is ambiguous about whether it involves a right to explanation regarding how businesses’ automated algorithmic profiling systems reach decisions. In this analysis, the authors develop a moral argument that can serve as a foundation for a legally recognized version of this right.
In the digital era, the authors write, some say that informed consent—obtaining prior permission for disclosing information with full knowledge of the possible consequences—is no longer possible because many digital transactions are ongoing. Instead, the authors conceptualize informed consent as an assurance of trust for incomplete algorithmic processes.
Obtaining informed consent, especially when companies collect and process personal data, is ethically required unless overridden for specific, acceptable reasons, the authors argue. Moreover, informed consent in the context of algorithmic decision-making, especially for non-contextual and unpredictable uses, is incomplete without an assurance of trust.
In this context, the authors conclude, companies have a moral duty to provide an explanation not just before automated decision making occurs, but also afterward, so the explanation can address both system functionality and the rationale of a specific decision.
The authors also delve into how companies that run businesses based on algorithms can provide explanations of their use in a way that attracts clients while maintaining trade secrets. This is an important decision for many modern start-ups, including such questions as to how much code should be open source, and how extensive and exposed the application program interface should be.
Many companies are already tackling these challenges, the authors note. Some may choose to hire “data interpreters,” employees who bridge the work of data scientists and the people affected by the companies’ decisions.
“Will requiring an algorithm to be interpretable or explainable hinder businesses’ performance or lead to better results?” asks Bryan R. Routledge, Associate Professor of Finance at Carnegie Mellon’s Tepper School of Business, who co-wrote the analysis. “That is something we’ll see play out in the near future, much like the transparency conflict of Apple and Facebook. But more importantly, the right to explanation is an ethical obligation apart from bottom-line impact.”
More from: Carnegie Mellon University
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
- Using algorithms to see the world differently
I like the technical side of programming algorithms to find the sweet spot to apply the latest and greatest research to real problems,” said Voisin. “I can immediately see if changes to my algorithm ...
- YouTube Shorts Algorithm Explained In Q&A Format
YouTube explains how its Shorts recommendation algorithm works in a new video answering common questions from creators.
- 'Make Instagram Instagram Again': The Update in Algorithm & Backlash – Explained
On 25 July, influencer and entrepreneur Kylie Jenner kicked up a storm when she posted a – 'Make Instagram Instagram Again. (stop trying to be TikTok, I just want to see cute photos of my friends.) ...
- Cloud-Based Algorithms Are Transforming the Stethoscope
All subjects underwent echocardiography for gold-standard evaluation and all echocardiograms were conducted within 28 days of the corresponding stethoscope recordings. All recordings were ...
- Kylie Jenner and the Instagram Algorithm Are Fighting
Sincerely, Everyone.” Bruening also created a Change.org petition on July 22 calling to “BRING BACK CHRONOLOGICAL TIMELINES!” which at the time of this post reached over 163,000 online signatures. The ...
Go deeper with Google Headlines on:
Go deeper with Bing News on:
- BCCDC removes data on COVID-19 infection outcomes by vaccination status from dashboard
The B.C. Centre for Disease Control has stopped reporting case outcomes by vaccination status on its COVID-19 Surveillance Dashboard because the data had become "hard to interpret," according to the ...
- Introduction to data journalism
This two-day online course will give you all the information you need to start harnessing the power of data for your investigative stories ...
- 3 Ways Thinking Like a Data Scientist Helps to Make Better Business Decisions
In this special guest feature, Sanjay Vyas, CTO at Planful, discusses how tech departments can interpret data to steer company trajectory. Business leaders will need to encourage their teams to think ...
- TDWI Releases Updated Data Literacy Assessment and Guide
Online survey and guide help organizations evaluate their level of data literacy, offer best practices for improving literacy for enterprises at all stages. TDWI Releases Updated Data Literacy ...
- Simultaneous Interpreter Market 2022 Report Examines Latest Trends and Key Drivers Supporting Growth till 2030
The global Simultaneous Interpreter market is segregated on the basis of Type as Online Translation and Offline ...