Plenoptic depth map in the case of occlusions

Zhan Yu; Jingyi Yu; Andrew Lumsdaine; Todor Georgiev

doi:10.1117/12.2005847

7 March 2013 Plenoptic depth map in the case of occlusions

Zhan Yu, Jingyi Yu, Andrew Lumsdaine, Todor Georgiev

Proceedings Volume 8667, Multimedia Content and Mobile Devices; 86671S (2013) https://doi.org/10.1117/12.2005847
Event: IS&T/SPIE Electronic Imaging, 2013, Burlingame, California, United States

Abstract

Recent realizations of hand-held plenoptic cameras have given rise to previously unexplored effects in photography. Designing a mobile phone plenoptic camera is becoming feasible with the significant increase of computing power of mobile devices and the introduction of System on a Chip. However, capturing high numbers of views is still impractical due to special requirements such as ultra-thin camera and low costs. In this paper, we analyze a mobile plenoptic camera solution with a small number of views. Such a camera can produce a refocusable high resolution final image if a depth map is generated for every pixel in the sparse set of views. With the captured multi-view images, the obstacle to recovering a high-resolution depth is occlusions. To robustly resolve these, we first analyze the behavior of pixels in such situations. We show that even under severe occlusion, one can still distinguish different depth layers based on statistics. We estimate the depth of each pixel by discretizing the space in the scene and conducting plane sweeping. Specifically, for each given depth, we gather all corresponding pixels from other views and model the in-focus pixels as a Gaussian distribution. We show how it is possible to distinguish occlusion pixels, and in-focus pixels in order to find the depths. Final depth maps are computed in real scenes captured by a mobile plenoptic camera.

Citation Download Citation

Zhan Yu, Jingyi Yu, Andrew Lumsdaine, and Todor Georgiev "Plenoptic depth map in the case of occlusions", Proc. SPIE 8667, Multimedia Content and Mobile Devices, 86671S (7 March 2013); https://doi.org/10.1117/12.2005847

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available