Accurate and consistent depth estimation for light field camera arrays

Sang-Heon Shim; Jae Woo Kim; Sang-Eek Hyun; Do Hyung Kim; Jae-Pil Heo

doi:10.1117/12.2518581

14 May 2019 Accurate and consistent depth estimation for light field camera arrays

Sang-Heon Shim, Jae Woo Kim, Sang-Eek Hyun, Do Hyung Kim, Jae-Pil Heo

Proceedings Volume 10997, Three-Dimensional Imaging, Visualization, and Display 2019; 109970E (2019) https://doi.org/10.1117/12.2518581
Event: SPIE Defense + Commercial Sensing, 2019, Baltimore, MD, United States

Abstract

In this paper, we propose a depth estimation framework for light field camera arrays. The goal of the proposed framework is to compute consistent depth information over the multiple cameras which is hardly achieved by conventional approaches based on the pairwise stereo matching. We first perform stereo matchings on adjacent image pairs using a convolutional neural network-based correspondence scoring model. Once the local disparity maps are estimated, we consolidate the disparity values to make them globally sharable over the multiple views. We finally refine the depth values in the image domain by introducing a novel image segmentation method considering edges in the image to obtain a semantic-aware global depth map. The proposed framework is evaluated on three different real world scenarios, and the experimental results validate that our proposed method produces accurate and consistent depth maps for images captured by the light field camera arrays.

Citation Download Citation

Sang-Heon Shim, Jae Woo Kim, Sang-Eek Hyun, Do Hyung Kim, and Jae-Pil Heo "Accurate and consistent depth estimation for light field camera arrays", Proc. SPIE 10997, Three-Dimensional Imaging, Visualization, and Display 2019, 109970E (14 May 2019); https://doi.org/10.1117/12.2518581

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available