Stereo vision–based depth of field rendering on a mobile device

Qiaosong Wang; Zhan Yu; Christopher Rasmussen; Jingyi Yu

doi:10.1117/1.JEI.23.2.023009

19 March 2014 Stereo vision–based depth of field rendering on a mobile device

Qiaosong Wang, Zhan Yu, Christopher Rasmussen, Jingyi Yu

Author Affiliations +

Journal of Electronic Imaging, Vol. 23, Issue 2, 023009 (March 2014). https://doi.org/10.1117/1.JEI.23.2.023009

Abstract

The depth of field (DoF) effect is a useful tool in photography and cinematography because of its aesthetic value. However, capturing and displaying dynamic DoF effect were until recently a quality unique to expensive and bulky movie cameras. A computational approach to generate realistic DoF effects for mobile devices such as tablets is proposed. We first calibrate the rear-facing stereo cameras and rectify the stereo image pairs through FCam API, then generate a low-res disparity map using graph cuts stereo matching and subsequently upsample it via joint bilateral upsampling. Next, we generate a synthetic light field by warping the raw color image to nearby viewpoints, according to the corresponding values in the upsampled high-resolution disparity map. Finally, we render dynamic DoF effect on the tablet screen with light field rendering. The user can easily capture and generate desired DoF effects with arbitrary aperture sizes or focal depths using the tablet only, with no additional hardware or software required. The system has been examined in a variety of environments with satisfactory results, according to the subjective evaluation tests.

Citation Download Citation

Qiaosong Wang, Zhan Yu, Christopher Rasmussen, and Jingyi Yu "Stereo vision–based depth of field rendering on a mobile device," Journal of Electronic Imaging 23(2), 023009 (19 March 2014). https://doi.org/10.1117/1.JEI.23.2.023009

Published: 19 March 2014

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available