What does it take for a human to trust a robot? That is what Army researchers are uncovering in a new study into how humans and robots work together.
Research into human-agent teaming, or HAT, has examined how the transparency of agents–such as robots, unmanned vehicles or software agents–influences human trust, task performance, workload and perceptions of the agent. Agent transparency refers to its ability to convey to humans its intent, reasoning process and future plans.
New Army-led research finds that human confidence in robots decreases after the robot makes a mistake, even when it is transparent with its reasoning process. The paper, “Agent Transparency and Reliability in HumanRobot Interaction: The Influence on User Confidence and Perceived Reliability,” has been published in the August issue of IEEE-Transactions on Human-Machine Systems.
To date, research has largely focused on HAT with perfectly reliable intelligent agents–meaning the agents do not make mistakes–but this is one of the few studies that has explored how agent transparency interacts with agent reliability. In this latest study, humans witnessed a robot making a mistake, and researchers focused on whether the humans perceived the robot to be less reliable, even when the human was provided insight into the robot’s reasoning process.
“Understanding how the robot’s behavior influences their human teammates is crucial to the development of effective human-robot teams, as well as the design of interfaces and communication methods between team members,” said Dr. Julia Wright, principal investigator for this project and researcher at U.S. Army Combat Capabilities Development Command’s Army Research Laboratory, also known as ARL. “This research contributes to the Army’s Multi-Domain Operations efforts to ensure overmatch in artificial intelligence-enabled capabilities. But it is also interdisciplinary, as its findings will inform the work of psychologists, roboticists, engineers, and system designers who are working toward facilitating better understanding between humans and autonomous agents in the effort to make autonomous teammates rather than simply tools.
This research was a joint effort between ARL and the University of Central Florida Institute for Simulations and Training, and is the third and final study in the Autonomous Squad Member project, sponsored by the Office of Secretary of Defense’s Autonomy Research Pilot Initiative. The ASM is a small ground robot that interacts with and communicates with an infantry squad.
Prior ASM studies investigated how a robot would communicate with a human teammate. Using the Situation awareness-based Agent Transparency model as a guide, various visualization methods to convey the agent’s goals, intents, reasoning, constraints, and projected outcomes were explored and tested. An at-a-glance iconographic module was developed based on these early study findings, and then was used in subsequent studies to explore the efficacy of agent transparency in HAT.
Researchers conducted this study in a simulated environment, in which participants observed a human-agent Soldier team, which included the ASM, traversing a training course. The participants’ task was to monitor the team and evaluate the robot. The Soldier-robot team encountered various events along the course and responded accordingly. While the Soldiers always responded correctly to the event, occasionally the robot misunderstood the situation, leading to incorrect actions. The amount of information the robot shared varied between trials. While the robot always explained its actions, the reasons behind its actions and the expected outcome of its actions, in some trials the robot also shared the reasoning behind its decisions, its underlying logic. Participants viewed multiple Soldier-robot teams, and their assessments of the robots were compared.
The study found that regardless of the robot’s transparency in explaining its reasoning, the robot’s reliability was the ultimate determining factor in influencing the participants’ projections of the robot’s future reliability, trust in the robot and perceptions of the robot. That is, after participants witnessed an error, they continued to rate the robot’s reliability lower, even when the robot did not make any subsequent errors. While these evaluations slowly improved over time as long as the robot committed no further errors, participants’ confidence in their own assessments of the robot’s reliability remained lowered throughout the remainder of the trials, when compared to participants who never saw an error. Furthermore, participants who witnessed a robot error reported lower trust in the robot, when compared to those who never witnessed a robot error.
Increasing agent transparency was found to improve participants’ trust in the robot, but only when the robot was collecting or filtering information. This could indicate that sharing in-depth information may mitigate some of the effects of unreliable automation for specific tasks, Wright said. Additionally, participants rated the unreliable robot as less animate, likable, intelligent, and safe than the reliable robot.
“Earlier studies suggest that context matters in determining the usefulness of transparency information,” Wright said. “We need to better understand which tasks require more in-depth understanding of the agent’s reasoning, and how to discern what that depth would entail. Future research should explore ways to deliver transparency information based on the tasking requirements.”
Learn more: When it comes to robots, reliability may matter more than reasoning
The Latest on: Human-agent teaming
[google_news title=”” keyword=”human-agent teaming” num_posts=”10″ blurb_length=”0″ show_thumb=”left”]
via Google News
The Latest on: Human-agent teaming
- The Democrats’ depleted farm team: This election is Obama’s real legacy for his partyon May 10, 2024 at 5:16 am
Yet even then, this need not be a disaster for Democrats. There’s still the entire elected Democratic Party for them to draw upon. In theory, all they’d need to do is find some Democratic governor or ...
- Team compares robot-assisted language learning systems and human tutors in English conversation lessonson May 9, 2024 at 9:00 pm
Advancements in large language models, robotics, and software such as text-to-speech, have made it possible to develop robots that can understand language, interact physically, and communicate ...
- Top Small Workplace: CENTURY 21 Stein Posner gives its agents ‘wings’on May 9, 2024 at 4:27 am
Adam Stein leads his company’s Monday morning meetings with a prowess: He elevates his voice, peppers curse words into his presentation and poses quizzical inquiries and hypotheticals to his agents ...
- Kristin Rehler named special agent in charge of FBI Jacksonville Officeon May 8, 2024 at 9:00 pm
A special agent since 1996, she previously was in the Inspection Division at FBI Headquarters in Washington, D.C.
- Bye-bye bots: Altera’s game-playing AI agents get backing from Eric Schmidton May 8, 2024 at 10:28 am
Autonomous, AI-based players are coming to a gaming experience near you, and a new startup, Altera, is joining the fray to build this new guard of AI agents. The company announced Wednesday that it ...
- Altera Closes $9M Seed Round to Build Digital Human Beings and Redefine AI Agentson May 8, 2024 at 7:18 am
After shutting their MIT lab, founders raise $11.1 million in first five months of company's inception ...
- Flavor Flav Promises to Fund the U.S. Water Polo Team to the Paris Olympics: ‘Imma Sponsor the Whole Team’on May 7, 2024 at 11:41 am
Flavor Flav offered to support the U.S. Water Polo Team on their journey to the Paris Olympics after the team's captain, Maggie Steffens, posted on Instagram about needing financial help.
- SIMA: Scaling Up AI Agents Across Virtual Worlds for Diverse Applicationson May 7, 2024 at 7:19 am
Discover how Google DeepMind's Scalable Instructable Multiworld Agent (SIMA) revolutionizes AI technology, with human-like adaptability ...
- 3 Methods To Use Tech Without Losing Your Brand's Human Touchon May 5, 2024 at 4:00 am
Keep your brand's humanity amidst the digital age. Balance interactions for trust. Prioritize human connection, position tech as support, and train interpersonal skills.
- Chad Daybell trial day 16: FBI agent testifies about human remains on Daybell propertyon May 3, 2024 at 7:15 am
He's a special agent with the FBI and has worked there for roughly 26 years. He was previously assigned to the evidence response team or ERT, they do forensics for the FBI. Daniels has been on and off ...
via Bing News