Collaborative real-time motion video analysis by human observer and image exploitation algorithms

Jutta Hild; Wolfgang Krüger; Stefan Brüstle; Patrick Trantelle; Gabriel Unmüßig; Norbert Heinze; Elisabeth Peinsipp-Byma; Jürgen Beyerer

doi:10.1117/12.2180453

19 May 2015 Collaborative real-time motion video analysis by human observer and image exploitation algorithms

Jutta Hild, Wolfgang Krüger, Stefan Brüstle, Patrick Trantelle, Gabriel Unmüßig, Norbert Heinze, Elisabeth Peinsipp-Byma, Jürgen Beyerer

Author Affiliations +

Proceedings Volume 9463, Motion Imagery: Standards, Quality, and Interoperability; 94630C (2015) https://doi.org/10.1117/12.2180453
Event: SPIE Defense + Security, 2015, Baltimore, MD, United States

Abstract

Motion video analysis is a challenging task, especially in real-time applications. In most safety and security critical applications, a human observer is an obligatory part of the overall analysis system. Over the last years, substantial progress has been made in the development of automated image exploitation algorithms. Hence, we investigate how the benefits of automated video analysis can be integrated suitably into the current video exploitation systems. In this paper, a system design is introduced which strives to combine both the qualities of the human observer’s perception and the automated algorithms, thus aiming to improve the overall performance of a real-time video analysis system. The system design builds on prior work where we showed the benefits for the human observer by means of a user interface which utilizes the human visual focus of attention revealed by the eye gaze direction for interaction with the image exploitation system; eye tracker-based interaction allows much faster, more convenient, and equally precise moving target acquisition in video images than traditional computer mouse selection. The system design also builds on prior work we did on automated target detection, segmentation, and tracking algorithms. Beside the system design, a first pilot study is presented, where we investigated how the participants (all non-experts in video analysis) performed in initializing an object tracking subsystem by selecting a target for tracking. Preliminary results show that the gaze + key press technique is an effective, efficient, and easy to use interaction technique when performing selection operations on moving targets in videos in order to initialize an object tracking function.

Citation Download Citation

Jutta Hild, Wolfgang Krüger, Stefan Brüstle, Patrick Trantelle, Gabriel Unmüßig, Norbert Heinze, Elisabeth Peinsipp-Byma, and Jürgen Beyerer "Collaborative real-time motion video analysis by human observer and image exploitation algorithms", Proc. SPIE 9463, Motion Imagery: Standards, Quality, and Interoperability, 94630C (19 May 2015); https://doi.org/10.1117/12.2180453

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available