
First and second columns show the original im- ages and manipulated ones respectively. The black and white images in the third column are corresponding bi- nary GT masks. Predicted masks (column 4) and generated CAMs (column 5) for manipulated images from Face2Face (row 1,2,3) and Neural-Textures (row 4,5,6) dataset.
(Mazaheri & Roy-Chowdhury, 2022)
Two-pronged technique detects manipulated facial expressions and identity swaps
Computer scientists at UC Riverside can detect manipulated facial expressions in deepfake videos with higher accuracy than current state-of-the-art methods. The method also works as well as current methods in cases where the facial identity, but not the expression, has been swapped, leading to a generalized approach to detect any kind of facial manipulation. The achievement brings researchers a step closer to developing automated tools for detecting manipulated videos that contain propaganda or misinformation.
Developments in video editing software have made it easy to exchange the face of one person for another and alter the expressions on original faces. As unscrupulous leaders and individuals deploy manipulated videos to sway political or social opinions, the ability to identify these videos is considered by many essential to protecting free democracies. Methods exist that can detect with reasonable accuracy when faces have been swapped. But identifying faces where only the expressions have been changed is more difficult and to date, no reliable technique exists.
“What makes the deepfake research area more challenging is the competition between the creation and detection and prevention of deepfakes which will become increasingly fierce in the future. With more advances in generative models, deepfakes will be easier to synthesize and harder to distinguish from real,” said paper co-author Amit Roy-Chowdhury, a Bourns College of Engineering professor of electrical and computer engineering.
The UC Riverside method divides the task into two components within a deep neural network. The first branch discerns facial expressions and feeds information about the regions that contain the expression, such as the mouth, eyes, or forehead, into a second branch, known as an encoder-decoder. The encoder-decoder architecture is responsible for manipulation detection and localization.
The framework, called Expression Manipulation Detection, or EMD, can both detect and localize the specific regions within an image that have been altered.
“Multi-task learning can leverage prominent features learned by facial expression recognition systems to benefit the training of conventional manipulation detection systems. Such an approach achieves impressive performance in facial expression manipulation detection,” said doctoral student Ghazal Mazaheri, who led the research.
The benchmark datasets for facial manipulation are based on expression and identity swap. One transfers the expressions of a source video onto a target video without changing the identity of the person in the target video. The other swaps two identities in a single video.
Experiments on two challenging facial manipulation datasets show EMD has better performance in detection of not only facial expression manipulations but also identity swaps. EMD accurately detected 99% of the manipulated videos.
Original Article: New method detects deepfake videos with up to 99% accuracy
More from: University of California Riverside
The Latest Updates from Bing News & Google News
Go deeper with Bing News on:
Deepfake videos
- ChatGPT could increase 'threat vector' for cyberattacks and misinformation, experts warn: 'Deepfake generator'
AI and cybersecurity experts say deepfakes and cybercrimes could multiply if criminals take advantage of artificial intelligence technology like ChatGPT.
- Fact check: Deepfake video of Manhattan DA spreads false claims about Trump case
The video's audio is altered. The district attorney's office is still investigating former President Donald Trump.
- The Deepfake Revolution May Bring a Media Revival
This recording is a mix of phrases we said and those that were generated but never said.” Now that the world has seen realistic images of Putin apprehended and on trial in the Hague, Putin bending his ...
- Alvin Bragg didn’t say he would drop charges against Donald Trump; this video’s a deepfake
Social media users are circulating a video that supposedly shows Manhattan District Attorney Alvin Bragg making a notable announcement about former President Donald Trump. The vid ...
- Gal Gadot’s Wonder Woman in ‘Shazam 2’ Was Not a Deepfake, Director Says: She ‘Shot in England’ and ‘I Directed Remotely’
Shazam! Fury of the Gods” seemingly confused a lot of moviegoers with its surprise cameo featuring the return of Gal Gadot’s Wonder Woman. The character appears as a deus ex ...
Go deeper with Google Headlines on:
Deepfake videos
[google_news title=”” keyword=”deepfake videos” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]
Go deeper with Bing News on:
Expression Manipulation Detection
- Opinion: Free Expression
Gerry Baker is Editor at Large of The Wall Street Journal. His weekly column for the editorial page, “Free Expression,” appears in The Wall Street Journal each Tuesday. Mr. Baker is also host ...
- Linux Fu: Regular Expressions
But there are certain core skills like file manipulation and editing that will serve you no matter what you do. One of the pervasive skills that often gives people trouble is regular expressions.
- Breaking: Binance CEO CZ rejects allegations of market manipulation
“On information and belief, Binance has not subjected the trading activity of Merit Peak, Sigma Chain, or its approximately 300 house accounts to any anti-fraud or anti-manipulation surveillance ...
- Gene Expression Detection Kit Market 2023 Outlook By Product, Application, And End-Use | Trends and Forecast To 2030 MRI
Mar 20, 2023 (Heraldkeepers) -- The Gene Expression Detection Kit Market research report by Market Research Intellect provides in-depth insight into the key market drivers and challenges ...
- Understanding deepfakes and how to counter them
From Snapchat face swap filters to U.S. President Joe Biden singing Baby Shark, manipulated media has proliferated in recent years. Deepfakes and other forms of synthetic and AI-assisted media ...
Go deeper with Google Headlines on:
Expression Manipulation Detection
[google_news title=”” keyword=”Expression Manipulation Detection” num_posts=”5″ blurb_length=”0″ show_thumb=”left”]