Automatic human action recognition in a scene from visual inputs

Henri Bouma; Patrick Hanckmann; Jan-Willem Marck; Leo Penning; Richard den Hollander; Johan-Martijn ten Hove; Sebastiaan van den Broek; Klamer Schutte; Gertjan Burghouts

doi:10.1117/12.918582

24 May 2012 Automatic human action recognition in a scene from visual inputs

Henri Bouma, Patrick Hanckmann, Jan-Willem Marck, Leo Penning, Richard den Hollander, Johan-Martijn ten Hove, Sebastiaan van den Broek, Klamer Schutte, Gertjan Burghouts

Author Affiliations +

Proceedings Volume 8388, Unattended Ground, Sea, and Air Sensor Technologies and Applications XIV; 83880L (2012) https://doi.org/10.1117/12.918582
Event: SPIE Defense, Security, and Sensing, 2012, Baltimore, Maryland, United States

Abstract

Surveillance is normally performed by humans, since it requires visual intelligence. However, this can be dull and dangerous, especially for military operations. Therefore, unmanned autonomous visual-intelligence systems are desired. In this paper, we present a novel system that can recognize human actions, which are relevant to detect operationally significant activity. Central to the system is a break-down of high-level perceptual concepts (verbs) in simpler observable events. The system is trained on 3482 videos and evaluated on 2589 videos from the DARPA Mind's Eye program, with for each video human annotations indicating the presence or absence of 48 different actions. The results show that our system reaches good performance approaching the human average response.

Citation Download Citation

Henri Bouma, Patrick Hanckmann, Jan-Willem Marck, Leo Penning, Richard den Hollander, Johan-Martijn ten Hove, Sebastiaan van den Broek, Klamer Schutte, and Gertjan Burghouts "Automatic human action recognition in a scene from visual inputs", Proc. SPIE 8388, Unattended Ground, Sea, and Air Sensor Technologies and Applications XIV, 83880L (24 May 2012); https://doi.org/10.1117/12.918582

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available