Fake-buster: a lightweight solution for deepfake detection

Nathan Hubens; Matei Mancas; Bernard Gosselin; Marius Preda; Titus Zaharia

doi:10.1117/12.2596317

1 August 2021 Fake-buster: a lightweight solution for deepfake detection

Nathan Hubens, Matei Mancas, Bernard Gosselin, Marius Preda, Titus Zaharia

Proceedings Volume 11842, Applications of Digital Image Processing XLIV; 118420K (2021) https://doi.org/10.1117/12.2596317
Event: SPIE Optical Engineering + Applications, 2021, San Diego, California, United States

Abstract

Recent advances in video manipulation techniques have made synthetic media creation more accessible than ever before. Nowadays, video edition is so realistic that we cannot rely exclusively on our senses to assess the veracity of media content. With the amount of manipulated videos doubling every six months, we need sophisticated tools to process the huge amount of media shared all over the internet, to remove the related videos as fast as possible, thus reducing potential harm such as fueling disinformation or reducing trust in mainstream media. In this paper, we tackle the problem of face manipulation detection in video sequences targeting modern facial manipulation techniques. Our method involves two networks: (1) a face identification network, extracting the faces contained in a video, and (2) a manipulation recognition network, considering the face as well as its neighbouring context to find potential artifacts, indicating that the face was manipulated. More particularly, we propose to make use of neural network compression techniques such as pruning and knowledge distillation to create a lightweight solution, able to rapidly process streams of videos. Our approach is validated on the DeepFake Detection Dataset, consisting of videos coming from 5 different manipulation techniques, reflecting the organic content found on the internet, and compared to state-of-the-art deepfake detection approaches.

Conference Presentation

Citation Download Citation

Nathan Hubens, Matei Mancas, Bernard Gosselin, Marius Preda, and Titus Zaharia "Fake-buster: a lightweight solution for deepfake detection", Proc. SPIE 11842, Applications of Digital Image Processing XLIV, 118420K (1 August 2021); https://doi.org/10.1117/12.2596317

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available