Depth map upscaling through edge-weighted optimization

Sebastian Schwarz; Mårten Sjöström; Roger Olsson

doi:10.1117/12.903921

Translator Disclaimer

30 January 2012 Depth map upscaling through edge-weighted optimization

Sebastian Schwarz, Mårten Sjöström, Roger Olsson

Author Affiliations +

Proceedings Volume 8290, Three-Dimensional Image Processing (3DIP) and Applications II; 829008 (2012) https://doi.org/10.1117/12.903921
Event: IS&T/SPIE Electronic Imaging, 2012, Burlingame, California, United States

Abstract

Accurate depth maps are a pre-requisite in three-dimensional television, e.g. for high quality view synthesis, but this information is not always easily obtained. Depth information gained by correspondence matching from two or more views suffers from disocclusions and low-texturized regions, leading to erroneous depth maps. These errors can be avoided by using depth from dedicated range sensors, e.g. time-of-flight sensors. Because these sensors only have restricted resolution, the resulting depth data need to be adjusted to the resolution of the appropriate texture frame. Standard upscaling methods provide only limited quality results. This paper proposes a solution for upscaling low resolution depth data to match high resolution texture data. We introduce We introduce the Edge Weighted Optimization Concept (EWOC) for fusing low resolution depth maps with corresponding high resolution video frames by solving an overdetermined linear equation system. Similar to other approaches, we take information from the high resolution texture, but additionally validate this information with the low resolution depth to accentuate correlated data. Objective tests show an improvement in depth map quality in comparison to other upscaling approaches. This improvement is subjectively confirmed in the resulting view synthesis.

Citation Download Citation

Sebastian Schwarz, Mårten Sjöström, and Roger Olsson "Depth map upscaling through edge-weighted optimization", Proc. SPIE 8290, Three-Dimensional Image Processing (3DIP) and Applications II, 829008 (30 January 2012); https://doi.org/10.1117/12.903921

ACCESS THE FULL ARTICLE