Individual predictions of eye-movements with dynamic scenes

Erhardt Barth; Jan Drewes; Thomas Martinetz

doi:10.1117/12.477374

17 June 2003 Individual predictions of eye-movements with dynamic scenes

Erhardt Barth, Jan Drewes, Thomas Martinetz

Proceedings Volume 5007, Human Vision and Electronic Imaging VIII; (2003) https://doi.org/10.1117/12.477374
Event: Electronic Imaging 2003, 2003, Santa Clara, CA, United States

Abstract

We present a model that predicts saccadic eye-movements and can be tuned to a particular human observer who is viewing a dynamic sequence of images. Our work is motivated by applications that involve gaze-contingent interactive displays on which information is displayed as a function of gaze direction. The approach therefore differs from standard approaches in two ways: (1) we deal with dynamic scenes, and (2) we provide means of adapting the model to a particular observer. As an indicator for the degree of saliency we evaluate the intrinsic dimension of the image sequence within a geometric approach implemented by using the structure tensor. Out of these candidate saliency-based locations, the currently attended location is selected according to a strategy found by supervised learning. The data are obtained with an eye-tracker and subjects who view video sequences. The selection algorithm receives candidate locations of current and past frames and a limited history of locations attended in the past. We use a linear mapping that is obtained by minimizing the quadratic difference between the predicted and the actually attended location by gradient descent. Being linear, the learned mapping can be quickly adapted to the individual observer.

Citation Download Citation

Erhardt Barth, Jan Drewes, and Thomas Martinetz "Individual predictions of eye-movements with dynamic scenes", Proc. SPIE 5007, Human Vision and Electronic Imaging VIII, (17 June 2003); https://doi.org/10.1117/12.477374

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available