via Army Research Laboratory
A team of Army and academic researchers are investigating how eye-pupil size changes can indicate a person’s cognitive state as a means to enable teaming with autonomous agents.
The future Army battlespace will require humans and AI agents to team effectively to accomplish mission-critical goals. Although AI agents can fill gaps in human performance, they are rigid and lack the flexibility inherent to human behavior, which could interfere with teaming.
“Humans’ brains are amazing, adaptable systems that automatically apply the right cognitive processes to complete a task and initiates each process at the right time,” said Dr. Russell Cohen Hoffing, a scientist at the U.S. Army Combat Capabilities Development Command’s Army Research Laboratory. “However, our brain’s resources are limited. Being able to predict a Soldier’s mental status before resources are maxed out is an opportunity for an autonomous agent to deploy capabilities to aid the Soldier. To make progress on enabling this technology, we wanted to better understand how physiological signals, such as pupil size changes, are related to performance and cognitive states.”
A joint effort between researchers from the Army and the Institute of Collaborative Biotechnologies at the University of California, Santa Barbara, the Cognitive Resilience and Sleep History, or CRASH, project seeks to understand how variations in state (as measured by physiological sensors) influence subsequent performance. PLoS One journal published the team’s research on a subset of the data set, “Dissociable mappings of tonic and phasic pupillary features onto cognitive processes involved in mental arithmetic.”
In this research, the team sought to understand the cognitive processes that affect pupil size changes–and the reliability of these relationships–as a foundation to estimate how human cognitive processes and performance can vary in real-world, cognitively challenging tasks, Cohen Hoffing said. The pupil is a unique data source, as it is the only internal organ of the body that brain networks directly modulate and is visible to the outside world.
“The potential of this research is exciting because eye tracking technologies are becoming universal in both commercial and military contexts,” Cohen Hoffing said. “Inherent to eye tracking algorithms, pupil size is estimated but rarely used for analytics. Our research program aims to generate knowledge products that enhance usability of this type of data to have greater insight into cognitive processes such as attention and decision making.”
The researchers collected repeated measurements from participants on eight separate occasions over four months. The data provided insights into the consistency of the pupil response and relationships to behavior both within and between individuals–with a unique glimpse into cognitive processes over time rather than in single-session studies, Cohen Hoffing said.
The findings of the study demonstrated that researchers can use pupil features to index both static and rapid-time varying aspects of cognition to understand how cognitive processes influence performance. Results indicated that at the trial-level, the time that each participant took to answer a mental arithmetic question correlated with the time to maximum pupil dilation and the size of the pupil. The relationship between performance and rapid pupil features indicated that a latent pupil response correlated with the process of reaching an answer, while pupil response increases correlated with the amount of attention applied to provide an answer. In contrast, average pupil size correlated with variability in how fast participants completed questions–suggesting that average pupil size indicates a readiness to perform the mental arithmetic task.
Results of the study confirm and extend previous research, showing that cognition reliably influences the pupil on at least two time-courses: a rapid, transient influence and a longer-lasting, sustained influence.
“These findings allow us to further understand in which cases pupil data may be useful for human and agent teaming,” said Dr. Steven Thurman, Army scientist and senior author on the manuscript. “For example, it may be the case that pupil size is most reliable in complex, real-world contexts only when averaging data over the course of several seconds or minutes. Such a case would enable the ability to track longer timescale changes in mental states, like vigilance, workload or fatigue, but potentially limit its use for tracking moment-to-moment decisions. It is important to employ longitudinal studies like this to understand the utility of pupil data on these varying timescales.”
Future studies will examine how to apply this research in real-world contexts, such as using virtual reality to test whether pupil size features can be exploited in dynamic contexts. This will be a steppingstone to test the efficacy of adaptive autonomous agents that use pupil size as an effective measure of hidden human states.
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Human and agent teaming
- What Thomas Tuchel has said about Chelsea stars Christian Pulisic and Thiago Silvaon January 26, 2021 at 6:33 am
Thomas Tuchel is set to arrive as Chelsea manager with an in-depth knowledge of two players in the squad especially, having worked with Christian Pulisic and Thiago Silva in previous jobs. Tuchel, who ...
- Integrity and CSG Actuarial Unite in Transformational Partnership to Provide Data and Software Solutions to Agents, Agencies, Carriers and Consumerson January 26, 2021 at 6:07 am
Integrity Marketing Group, LLC ("Integrity"), the nation's largest independent distributor of life and health insurance products, today announced it has acquired CSG Actuarial ("CSG"), the industry's ...
- Uniphore Appoints Industry Veterans to Board of Directors to Accelerate Innovation and Global Expansionon January 26, 2021 at 6:00 am
Their combined experience in building market leaders, driving innovation and scaling global companies will accelerate Uniphore’s growth and further advance the company’s leadership in utilizing AI and ...
- Navalny’s team calls for new protests in Russiaon January 26, 2021 at 3:26 am
Allies of jailed Russian opposition leader Alexei Navalny, who faces years in prison, are calling for new protests next weekend to demand his release, following a wave of demonstrations that turned ...
- Navalny’s team calls for protestson January 25, 2021 at 11:13 pm
Allies of jailed Russian opposition leader Alexei Navalny, who faces years in prison, called for new protests next weekend to demand his release, following a wave of demonstrations that turned out ...
Go deeper with Google Headlines on:
Human and agent teaming
Go deeper with Bing News on:
- PNP still looking for 9 ex-cops charged with killing 4 Army intel agentson January 25, 2021 at 1:48 pm
The hunt is still going on for nine former policemen accused of killing four Army intelligence agents in Jolo, Sulu province, last year. “The manhunt is in Jolo. According ...
- Kranot Hishtalmut Le Morim Ve Gananot Havera Menahelet LTD Has $1.40 Million Stock Holdings in Foresight Autonomous Holdings Ltd. (NASDAQ:FRSX)on January 25, 2021 at 5:48 am
Kranot Hishtalmut Le Morim Ve Gananot Havera Menahelet LTD increased its position in shares of Foresight Autonomous Holdings Ltd. (NASDAQ:FRSX) by 4.4% during the fourth quarter, according to the ...
- 3 caught in Cotabato City buy-buston January 21, 2021 at 7:26 pm
The suspects were arrested after selling 50 grams of shabu to undercover agents during a sting along a busy thoroughfare in Barangay Rosary Heights 9 past 5 p.m. on Thursday.
- iDenfy adopts Manu behavioral biometrics, Sumsub and Yoti each announce partnershipson January 21, 2021 at 11:06 am
Partnerships to ease onboarding and transactions with biometrics and digital ID credentials have been announced by iDenfy and Manu, Sumsub, and Yoti.
- Foresight Autonomous (NASDAQ:FRSX) Shares Gap Up to $7.82on January 19, 2021 at 8:25 pm
Foresight Autonomous Holdings Ltd. (NASDAQ:FRSX) gapped up before the market opened on Tuesday . The stock had previously closed at $7.82, but opened at $9.44. Foresight Autonomous shares last traded ...