Presentation
13 May 2019 Analysis of the efficacy of the use of subject face color analysis to detect fake videos (Conference Presentation)
Author Affiliations +
Abstract
Videos called ‘deep fakes’ are created by an algorithm, based on deep learning techniques, that matches one individual’s (the target) facial patterns to another’s (the source). These videos are compelling. In many cases they are visually indistinguishable from real recordings. Being able to identify fake videos is critical to refuting the misinformation that they may be used to promulgate. While some approaches have been proposed, they are largely based on exploiting temporary gaps in the video production algorithm (such as not introducing significant blinking) that may be fixed in the future. This paper proposes a prospective systematic way of evaluating the veracity of possible deep fake videos. The proposed approach is based on assessing the color patterns and variations of the target’s face. Videos produced by the construction algorithm are compared to a similar actual recording. Also, videos made using the construction algorithm based on using multiple sources are compared to each other and to the actual recording of the target and key differences between the different videos are discussed. The paper then proceeds to analyze whether the identified differences and patterns are suitable for differentiating fake videos from actual recordings, across multiple application areas. The paper concludes with a discussion of the impact of so-called ‘deep fakes’ technology on public trust in video recordings and the media. The impact of a technique, like the proposed, on multiple application areas is discussed. Its efficacy for multiple critical applications is considered and topics for next steps are discussed.
Conference Presentation
© (2019) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Jeremy Straub "Analysis of the efficacy of the use of subject face color analysis to detect fake videos (Conference Presentation)", Proc. SPIE 10993, Mobile Multimedia/Image Processing, Security, and Applications 2019, 109930H (13 May 2019); https://doi.org/10.1117/12.2520547
Advertisement
Advertisement
KEYWORDS
Video

Detection and tracking algorithms

Visualization

Back to Top