Temporal sub-sampling of depth maps in depth image-based rendering of stereoscopic image sequences

Wa James Tam; Filippo Speranza; Carlos Vázquez; Liang Zhang

doi:10.1117/12.807168

18 February 2009 Temporal sub-sampling of depth maps in depth image-based rendering of stereoscopic image sequences

Wa James Tam, Filippo Speranza, Carlos Vázquez, Liang Zhang

Proceedings Volume 7237, Stereoscopic Displays and Applications XX; 72371K (2009) https://doi.org/10.1117/12.807168
Event: IS&T/SPIE Electronic Imaging, 2009, San Jose, California, United States

Abstract

In depth image based rendering, video sequences and their associated depth maps are used to render new camera viewpoints for stereoscopic applications. In this study, we examined the effect of temporal downsampling of the depth maps on stereoscopic depth quality and visual comfort. The depth maps of four eight-second video sequences were temporally downsampled by dropping all frames, except the first, for every 2, 4, or 8 consecutive frames. The dropped frames were then replaced by the retained frame. Test stereoscopic sequences were generated by using the original image sequences for the left-eye view and the rendered image sequences for the right-eye view. The downsampled versions were compared to a reference version with full depth maps that were not downsampled. Based on the data from 21 viewers, ratings of depth quality for the downsampled versions were lower. Importantly, ratings depended on the content characteristics of the stereoscopic video sequences. Results were similar for visual comfort, except that the differences in ratings between sequences were larger. The present results suggest that more processing, such as interpolation of depth maps, might be required to counter the negative effects of temporal downsampling, especially beyond a downsampling of two.

Citation Download Citation

Wa James Tam, Filippo Speranza, Carlos Vázquez, and Liang Zhang "Temporal sub-sampling of depth maps in depth image-based rendering of stereoscopic image sequences", Proc. SPIE 7237, Stereoscopic Displays and Applications XX, 72371K (18 February 2009); https://doi.org/10.1117/12.807168

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available