Improved depth estimation with the light field camera

Huachun Wang; Xinzhu Sang; Duo Chen; Nan Guo; Peng Wang; Xunbo Yu; Binbin Yan; Kuiru Wang; Chongxiu Yu

doi:10.1117/12.2282897

24 October 2017 Improved depth estimation with the light field camera

Huachun Wang, Xinzhu Sang, Duo Chen, Nan Guo, Peng Wang, Xunbo Yu, Binbin Yan, Kuiru Wang, Chongxiu Yu

Proceedings Volume 10459, AOPC 2017: Optical Storage and Display Technology; 1045905 (2017) https://doi.org/10.1117/12.2282897
Event: Applied Optics and Photonics China (AOPC2017), 2017, Beijing, China

Abstract

Light-field cameras are used in consumer and industrial applications. An array of micro-lenses captures enough information that one can refocus images after acquisition, as well as shift one’s viewpoint within the sub-apertures of the main lens, effectively obtaining multiple views. Thus, depth estimation from both defocus and correspondence are now available in a single capture. And Lytro.Inc also provides a depth estimation from a single-shot capture with light field camera, like Lytro Illum. This Lytro depth estimation containing many correct depth information can be used for higher quality estimation. In this paper, we present a novel simple and principled algorithm that computes dense depth estimation by combining defocus, correspondence and Lytro depth estimations. We analyze 2D epipolar image (EPI) to get defocus and correspondence depth maps. Defocus depth is obtained by computing the spatial gradient after angular integration and correspondence depth by computing the angular variance from EPIs. Lytro depth can be extracted from Lyrto Illum with software. We then show how to combine the three cues into a high quality depth map. Our method for depth estimation is suitable for computer vision applications such as matting, full control of depth-of-field, and surface reconstruction, as well as light filed display

Citation Download Citation

Huachun Wang, Xinzhu Sang, Duo Chen, Nan Guo, Peng Wang, Xunbo Yu, Binbin Yan, Kuiru Wang, and Chongxiu Yu "Improved depth estimation with the light field camera", Proc. SPIE 10459, AOPC 2017: Optical Storage and Display Technology, 1045905 (24 October 2017); https://doi.org/10.1117/12.2282897

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available