
Image: @cvbe
Picture yourself driving on a narrow road in the near future when suddenly another car emerges from a bend ahead. It is a self-driving car with no passengers inside. Will you push forth and assert your right of way, or give way to let it pass? At present, most of us behave kindly in such situations involving other humans. Will we show that same kindness towards autonomous vehicles?
Do we compromise for an AI?
Using methods from behavioural game theory, an international team of researchers at the Ludwig Maximilian University of Munich (LMU) and the Institute of Philosophy at the School of Advanced Study, University of London, have conducted large-scale online studies to see whether people would behave as cooperatively with artificial intelligence (AI) systems as they do with fellow humans.
Cooperation holds a society together. It often requires us to compromise with others and to accept the risk that they let us down. Traffic is a good example. We lose a bit of time when we let other people pass in front of us and are outraged when others fail to reciprocate our kindness. Will we do the same with machines?
Researchers and the public tend to think about human interactions with AI as competition. Take the rivalry between chess grandmaster Gary Kasparov and the IBM computer Deep Blue, or Lee Sedol and Google’s AlphaGo program, or, for a more hostile version, the chase between Sarah Connor and the Terminator. Cooperation remains the dark matter: can humans and AI work together for mutual gains, and not just see who wins?
Exploiting the machine without guilt
The study, ‘Algorithm exploitation: humans are keen to exploit benevolent AI’, which was published on 3 June in the journal iScience, found that, upon first encounter, people have the same level of trust toward an AI as for human: most expect to meet someone who is ready to cooperate.
The difference comes afterwards. People are much less ready to reciprocate with an AI, and instead exploit its benevolence to their own benefit. Going back to the traffic example, a human driver would give way to another human but not to a driverless car.
The study identifies this unwillingness to compromise with machines as a new challenge to the future of human-AI interactions.
‘We put people in the shoes of someone who interacts with an artificial agent for the first time, as it could happen on the road,’ explains Dr Jurgis Karpus, a behavioural game theorist and a philosopher at LMU and the first author of the study. ‘We modelled different types of social encounters and found a consistent pattern. People expected artificial agents to be as cooperative as fellow humans. However, they did not return their benevolence as much and exploited the AI more than humans.’
With perspectives from game theory, cognitive science, and philosophy, the researchers found that ‘algorithm exploitation’ is a robust phenomenon. They replicated their findings across nine experiments with nearly 2,000 human participants.
Each experiment examines different kinds of social interactions and allows the human to decide whether to compromise and cooperate or act selfishly. Expectations of the other players were also measured. In a well-known game, the Prisoner’s Dilemma, people must trust that the other characters will not let them down. They embraced risk with humans and AI alike, but betrayed the trust of the AI much more often, to gain more money.
‘Cooperation is sustained by a mutual bet: I trust you will be kind to me, and you trust I will be kind to you. The biggest worry in our field is that people will not trust the machines. But we show that they do!’ notes Professor Bahador Bahrami, a social neuroscientist at the LMU, and one of the senior researchers in the study. ‚They are fine with letting the machine down, though, and that is the big difference. People even do not report much guilt when they do,’ he adds.
Benevolent AI can backfire
Biased and unethical AI has made many headlines – from the 2020 exams fiasco to justice systems – but this new research brings up a novel caution. The industry and legislators strive to ensure that artificial intelligence is benevolent. But benevolence may backfire.
If people think that AI is programmed to be benevolent towards them, they will be less tempted to cooperate. Some of the accidents involving self-driving cars may already show real-life examples: drivers recognise an autonomous vehicle on the road and expect it to give way. The driverless vehicle meanwhile expects for normal compromises between drivers to hold.
‘Algorithm exploitation has further consequences down the line. If humans are reluctant to let a polite self-driving car join from a side road, should the self-driving car be less polite and more aggressive in order to be useful?’ asks Dr Karpus.
‘Benevolent and trustworthy AI is a buzzword that everyone is excited about. But fixing the AI is not the whole story. If we realise that the robot in front of us will be cooperative no matter what, we will use it to our selfish interest,’ says Professor Ophelia Deroy, philosopher at the LMU and University of London, and senior author on the study.
‘Compromises are the oil that make society work. For each of us, it looks only like a small act of self-interest,’ continues Professor Deroy, who also works with Norway’s Peace Research Institute Oslo on the ethical implications of integrating autonomous robot soldiers along with human soldiers. ‘For society, it could have much bigger repercussions.’
One thing is for sure, our competing drives to treat machines as partners, and as tools, will continue to run and run, and Algorithm Exploitation is a fascinating look at where we are on that journey.
Original Article: Humans are ready to take advantage of benevolent AI
More from: Ludwig Maximilian University of Munich | University of London
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Benevolent AI
- AI in Southeast Asia: Balancing Regulation with Innovation
As the global race to regulate Artificial Intelligence (AI) accelerates, Southeast Asia is not far behind. Concerns over AI’s impact on jobs, safety, and privacy are prompting nations to draft rules ...
- Is AI too Smart to be Evil?
In this light, AI presents an opportunity to embody the unique form of intelligence—one that is unfettered by human weaknesses and is inherently inclined towards rationality and, potentially, ...
- 41 Top AI Startups to Watch in 2023
Artificial intelligence (AI) is at the cutting edge of innovation and progress. As more AI startups flood the market, the future of how our world functions changes. With advancements in machine ...
- Benevolent AI BAIVF
Morningstar analysts do not currently cover BAIVF, but with our powerful screener, you can find stocks in the same sector, industry, or style and filter on our unbiased ratings and valuation metrics.
- Boehringer bets $509M on Phenomic’s tumor-targeting tech, as AI biotech plans for busy year
Phenomic AI has been keeping a low profile since launching in October 2020 with $6 million. But that’s set to change, with a new partnership jumpstarting what’s expected to be a busy 2024.
Go deeper with Google Headlines on:
Benevolent AI
[google_news title=”” keyword=”benevolent AI” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Algorithm exploitation
- Meta's apps are still promoting child predation content, report finds
Meta is failing to stop vast networks of people using its platform to promote child abuse content, a new report in The Wall Street Journal says.
- Meta responds to claims it's 'struggling' to keep child predators off Facebook and Instagram
Meta responded to a Wall Street Journal story that claimed the social media giant struggles to remove child predators and child exploitation content from its platform.
- Meta Says It’s Stepping Up Fight Against Online Predators Amid Reports Of Child Exploitation
Meta CEO Mark Zuckerberg will testify before the Senate Judiciary Committee on Jan. 31 along with other tech executives, including X CEO Linda Yaccarino and TikTok CEO Shou Zi Chew, about how their ...
- Meta Is Struggling to Boot Pedophiles Off Facebook and Instagram
The social-media company has stepped up enforcement, but its algorithms continue to promote problematic content ...
- The 10 most outrageous, offensive, and absurd Elon Musk tweets of 2023
Since Elon Musk's acquisition of Twitter, which he rebranded to X, his posts have become increasingly more absurd.
Go deeper with Google Headlines on:
Algorithm exploitation
[google_news title=”” keyword=”algorithm exploitation” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]