Quantifying the effect of disruptions to temporal coherence on the intelligibility of compressed American Sign Language video

Frank M. Ciaramello; Sheila S. Hemami

doi:10.1117/12.808229

10 February 2009 Quantifying the effect of disruptions to temporal coherence on the intelligibility of compressed American Sign Language video

Frank M. Ciaramello, Sheila S. Hemami

Author Affiliations +

Proceedings Volume 7240, Human Vision and Electronic Imaging XIV; 72400D (2009) https://doi.org/10.1117/12.808229
Event: IS&T/SPIE Electronic Imaging, 2009, San Jose, California, United States

Abstract

Communication of American Sign Language (ASL) over mobile phones would be very beneficial to the Deaf community. ASL video encoded to achieve the rates provided by current cellular networks must be heavily compressed and appropriate assessment techniques are required to analyze the intelligibility of the compressed video. As an extension to a purely spatial measure of intelligibility, this paper quantifies the effect of temporal compression artifacts on sign language intelligibility. These artifacts can be the result of motion-compensation errors that distract the observer or frame rate reductions. They reduce the the perception of smooth motion and disrupt the temporal coherence of the video. Motion-compensation errors that affect temporal coherence are identified by measuring the block-level correlation between co-located macroblocks in adjacent frames. The impact of frame rate reductions was quantified through experimental testing. A subjective study was performed in which fluent ASL participants rated the intelligibility of sequences encoded at a range of 5 different frame rates and with 3 different levels of distortion. The subjective data is used to parameterize an objective intelligibility measure which is highly correlated with subjective ratings at multiple frame rates.

Citation Download Citation

Frank M. Ciaramello and Sheila S. Hemami "Quantifying the effect of disruptions to temporal coherence on the intelligibility of compressed American Sign Language video", Proc. SPIE 7240, Human Vision and Electronic Imaging XIV, 72400D (10 February 2009); https://doi.org/10.1117/12.808229

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available