A new approach to detecting a speaker’s intent to mislead

Dartmouth engineering researchers have developed a new approach for detecting a speaker’s intent to mislead.

The method’s framework, which could be applied toward evaluating “fake news,” among other uses, was recently published as part of a paper in Journal of Experimental & Theoretical Artificial Intelligence.

Although previous studies have examined deception, this is one of the first to look at a speaker’s intent. The researchers posit that while a true story can be manipulated into various deceiving forms, the intent, rather than the content of the communication, determines whether the communication is deceptive or not. For example, the speaker could be misinformed or make a wrong assumption, meaning the speaker made an unintentional error but did not attempt to deceive.

“Deceptive intent to mislead listeners on purpose poses a much larger threat than unintentional mistakes,” said Eugene Santos Jr., co-author and professor of engineering at Dartmouth. “To the best of our knowledge, our algorithm is the only method that detects deception and at the same time discriminates malicious acts from benign acts.”

The researchers developed a unique approach and resulting algorithm that can tell deception apart from all benign communications by retrieving the universal features of deceptive reasoning. However, the framework is currently limited by the amount of data needed to measure a speaker’s deviation from their past arguments; the study used data from a 2009 survey of 100 participants on their opinions on controversial topics, as well as a 2011 dataset of 800 real and 400 fictitious reviews of the same 20 hotels.

Santos believes the framework could be further developed to help readers distinguish and closely examine the intent of “fake news,” allowing the reader to determine if a reasonable, logical argument is used or if opinion plays a strong role. In further studies, Santos hopes to examine the ripple effect of misinformation, including its impacts.

In the study, the researchers use the popular 2001 film Ocean’s Eleven to illustrate how the framework can be used to examine a deceiver’s arguments, which in reality may go against his true beliefs, resulting in a falsified final expectation. For example, in the movie, a group of thieves break into a bank vault while simultaneously revealing to the owner that he is being robbed in order to negotiate. The thieves supply the owner with false information, namely that they will only take half the money if the owner doesn’t call police. However, the thieves expect the owner to call police, which he does, so the thieves then disguise themselves as police to steal the entirety of the vault contents.

Because Ocean’s Eleven is a scripted film, viewers can be sure of the thieves’ intent—to steal all of the money—and how it conflicts with what they tell the owner—that they will only take half. This illustrates how the thieves were able to deceive the owner and anticipate his actions due to the fact that the thieves and owner had different information and therefore perceived the scene differently.

“People expect things to work in a certain way,” said Santos, “just like the thieves knew that the owner would call police when he found out he was being robbed. So, in this scenario, the thieves used that knowledge to convince the owner to come to a certain conclusion and follow the standard path of expectations. They forced their deception intent so the owner would reach the conclusions the thieves desired.”

In popular culture, verbal and non-verbal behaviors such as facial expressions are often used to determine if someone is lying, but the co-authors note that those cues are not always reliable.

“We have found that models based on reasoning intent are more reliable than verbal changes and personal differences, and thus are better at distinguishing intentional lies from other types of information distortion,” said co-author Deqing Li Th’13, who worked on the paper as part of her engineering PhD thesis at Dartmouth.

Learn more: Dartmouth Engineers Develop New Way to Know Liars’ Intent