Depth map occlusion filling and scene reconstruction using modified exemplar-based inpainting

V. V. Voronin; V. I. Marchuk; A. V. Fisunov; S. V. Tokareva; K. O. Egiazarian

doi:10.1117/12.2076506

16 March 2015 Depth map occlusion filling and scene reconstruction using modified exemplar-based inpainting

V. V. Voronin, V. I. Marchuk, A. V. Fisunov, S. V. Tokareva, K. O. Egiazarian

Proceedings Volume 9399, Image Processing: Algorithms and Systems XIII; 93990S (2015) https://doi.org/10.1117/12.2076506
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

RGB-D sensors are relatively inexpensive and are commercially available off-the-shelf. However, owing to their low complexity, there are several artifacts that one encounters in the depth map like holes, mis-alignment between the depth and color image and lack of sharp object boundaries in the depth map. Depth map generated by Kinect cameras also contain a significant amount of missing pixels and strong noise, limiting their usability in many computer vision applications. In this paper, we present an efficient hole filling and damaged region restoration method that improves the quality of the depth maps obtained with the Microsoft Kinect device. The proposed approach is based on a modified exemplar-based inpainting and LPA-ICI filtering by exploiting the correlation between color and depth values in local image neighborhoods. As a result, edges of the objects are sharpened and aligned with the objects in the color image. Several examples considered in this paper show the effectiveness of the proposed approach for large holes removal as well as recovery of small regions on several test images of depth maps. We perform a comparative study and show that statistically, the proposed algorithm delivers superior quality results compared to existing algorithms.

Citation Download Citation

V. V. Voronin, V. I. Marchuk, A. V. Fisunov, S. V. Tokareva, and K. O. Egiazarian "Depth map occlusion filling and scene reconstruction using modified exemplar-based inpainting", Proc. SPIE 9399, Image Processing: Algorithms and Systems XIII, 93990S (16 March 2015); https://doi.org/10.1117/12.2076506

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available