Measuring cues for stand-off deception detection based on full-body nonverbal features in body-worn cameras

Henri Bouma; Gertjan Burghouts; Richard den Hollander; Sophie van der Zee; Jan Baan; Johan-Martijn ten Hove; Sjaak van Diepen; Paul van den Haak; Jeroen van Rest

doi:10.1117/12.2241183

24 October 2016 Measuring cues for stand-off deception detection based on full-body nonverbal features in body-worn cameras

Henri Bouma, Gertjan Burghouts, Richard den Hollander, Sophie van der Zee, Jan Baan, Johan-Martijn ten Hove, Sjaak van Diepen, Paul van den Haak, Jeroen van Rest

Author Affiliations +

Proceedings Volume 9995, Optics and Photonics for Counterterrorism, Crime Fighting, and Defence XII; 99950N (2016) https://doi.org/10.1117/12.2241183
Event: SPIE Security + Defence, 2016, Edinburgh, United Kingdom

Abstract

Deception detection is valuable in the security domain to distinguish truth from lies. It is desirable in many security applications, such as suspect and witness interviews and airport passenger screening. Interviewers are constantly trying to assess the credibility of a statement, usually based on intuition without objective technical support. However, psychological research has shown that humans can hardly perform better than random guessing. Deception detection is a multi-disciplinary research area with an interest from different fields, such as psychology and computer science. In the last decade, several developments have helped to improve the accuracy of lie detection (e.g., with a concealed information test, increasing the cognitive load, or measurements with motion capture suits) and relevant cues have been discovered (e.g., eye blinking or fiddling with the fingers). With an increasing presence of mobile phones and bodycams in society, a mobile, stand-off, automatic deception detection methodology based on various cues from the whole body would create new application opportunities. In this paper, we study the feasibility of measuring these visual cues automatically on different parts of the body, laying the groundwork for stand-off deception detection in more flexible and mobile deployable sensors, such as body-worn cameras. We give an extensive overview of recent developments in two communities: in the behavioral-science community the developments that improve deception detection with a special attention to the observed relevant non-verbal cues, and in the computer-vision community the recent methods that are able to measure these cues. The cues are extracted from several body parts: the eyes, the mouth, the head and the fullbody pose. We performed an experiment using several state-of-the-art video-content-analysis (VCA) techniques to assess the quality of robustly measuring these visual cues.

Conference Presentation

Citation Download Citation

Henri Bouma, Gertjan Burghouts, Richard den Hollander, Sophie van der Zee, Jan Baan, Johan-Martijn ten Hove, Sjaak van Diepen, Paul van den Haak, and Jeroen van Rest "Measuring cues for stand-off deception detection based on full-body nonverbal features in body-worn cameras", Proc. SPIE 9995, Optics and Photonics for Counterterrorism, Crime Fighting, and Defence XII, 99950N (24 October 2016); https://doi.org/10.1117/12.2241183

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available