Autonomous systems — like driverless cars — perform tasks that previously could only be performed by humans. In a new IEEE Intelligent Systems Expert Opinion piece, Carnegie Mellon University artificial intelligence ethics experts David Danks and Alex John London argue that current safety regulations do not plan for these systems and are therefore ill-equipped to ensure that autonomous systems will perform safely and reliably.
“Currently, we ensure safety on the roads by regulating the performance of the various mechanical systems of vehicles and by licensing drivers,” said London, professor of philosophy and director of the Center for Ethics and Policy in the Dietrich College of Humanities and Social Sciences. “When cars drive themselves we have no comparable system for evaluating the safety and reliability of their autonomous driving systems.”
Danks and London point to the Department of Transportation’s recent attempt to develop safety regulations for driverless cars as an example of traditional guidelines that do not adequately test and monitor the novel capabilities of autonomous systems. Instead, they suggest creating a staged, dynamic system that resembles the regulatory and approval process for drugs and medical devices, including a robust system for post-approval monitoring.
“Self-driving cars and autonomous systems are rapidly spreading through every part of society, but their successful use depends on whether we can trust and understand them,” said Danks, the L.L. Thurstone Professor of Philosophy and Psychology and head of the Department of Philosophy. “We, as a society, need to find new ways to monitor and guide the development and implementation of these autonomous systems.”
The phased process Danks and London propose would begin with “pre-clinical trials,” or testing in simulated environments, such as self-driving cars navigating varied landscapes and climates. This would provide information about how the autonomous system makes decisions in a wide range of contexts, so that we can understand how they might act in future, new situations.
Acceptable performance would permit the system to move on to “in-human” studies through a limited introduction into real-world environments with trained human “co-pilots.” Successful trials in these targeted environments would then lead to monitored, permit-based testing, and further easing of restrictions as performance goals were met.
Danks and London propose that this regulatory system should be modeled and managed similarly to how the Food and Drug Administration regulates the drug approval process.
“Autonomous vehicles have the potential to save lives and increase economic productivity. But these benefits won’t be realized unless the public has credible assurance that such systems are safe and reliable,” London said.
Receive an email update when we add a new ARTIFICIAL INTELLIGENCE ETHICS article.
The Latest on: Artificial intelligence ethics
via Google News
The Latest on: Artificial intelligence ethics
- Lenovo Joins Commitment to Responsible and Gender-Equitable Artificial Intelligence With Cercle InterElleson July 1, 2021 at 8:01 am
BL Media/ - Lenovo reinforces its commitment to accountable and gender fair artificial intelligence (AI) practices by joining the ‘Women and AI’ Charter from Cercle ...
- Artificial intelligence in health: watch the round table of the Mutualité française Auvergne-Rhône-Alpeson July 1, 2021 at 4:33 am
On July 2, the Mutualité Française Auvergne-Rhône-Alpes and the Espace de Réflexion Ethique Régional Auvergne-Rhône-Alpes will organize a round table on artificial intelligence. This event, which ...
- Unesco agrees draft text for ethical AIon July 1, 2021 at 3:16 am
After months of constructive dialogue and negotiation, representatives from UNESCO’s member states have agreed on the draft text of an ambitious and wide-ranging new template for the ethical ...
- WHO outlines principles for ethics in health AIon June 30, 2021 at 9:50 am
The World Health Organization released a guidance document outlining six key principles for the ethical use of artificial intelligence in health. Twenty experts spent two years developing the guidance ...
- Artificial Intelligence Hold Potential for Improving Delivery of Healthcare Worldwide: WHOon June 29, 2021 at 12:44 am
Artificial Intelligence (AI) holds great promise for improving the delivery of healthcare and medicine worldwide.
- Department of Defense AI ethics principles still lack implementation guidanceon June 28, 2021 at 2:19 pm
Despite progress on making committees and working groups on AI ethics, the department still lacks its promised implementation guidance.
- WHO guidance on Artificial Intelligence to improve healthcare, mitigate risks worldwideon June 28, 2021 at 7:50 am
Artificial Intelligence (AI) holds "enormous potential" for improving the health of millions around the world if ethics and human rights are at the ...
- DeepMind AGI paper adds urgency to ethical AIon June 26, 2021 at 1:50 pm
DeepMind expects reinforcement learning will lead to replicating human cognitive abilities, achieving artificial general intelligence (AGI).
- Why Ethical AI Won't Catch On Anytime Soonon June 24, 2021 at 5:00 pm
When asked whether AI systems being used by organizations will employ ethical principles focused primarily on the public good by 2030, 68% said they will not. The research added that “ethical” implies ...
via Bing News