Depth inloop resampling using dilation filter for free viewpoint video system

Seok Lee; Seungsin Lee; Hocheon Wey; Jaejoon Lee; Dusik Park

doi:10.1117/12.2008424

Translator Disclaimer

12 March 2013 Depth inloop resampling using dilation filter for free viewpoint video system

Seok Lee, Seungsin Lee, Hocheon Wey, Jaejoon Lee, Dusik Park

Author Affiliations +

Proceedings Volume 8648, Stereoscopic Displays and Applications XXIV; 864822 (2013) https://doi.org/10.1117/12.2008424
Event: IS&T/SPIE Electronic Imaging, 2013, Burlingame, California, United States

Abstract

A depth dilation filter is proposed for free viewpoint video system based on mixed resolution multi-view video plus depth (MVD). By applying gray scale dilation filter to depth images, foreground regions are extended to background region, and synthesis artifacts occur out of boundary edge. Thus, objective and subjective quality of view synthesis result is improved. A depth dilation filter is applied to inloop resampling part in encoding/decoding, and post processing part after decoding. Accurate view synthesis is important in virtual view generation for autostereoscopic display, moreover there are many coding tools which use view synthesis to reduce interview redundancy in 3D video coding such as view synthesis prediction (VSP) and depth based motion vector prediction (DMVP), and compression efficiency can be improved by accurate view synthesis. Coding and synthesis experiments are performed for performance evaluation of a dilation filter with MPEG test sequences. Dilation filter was implemented on the top of the MPEG reference software for AVC based 3D video coding. By applying a depth dilation filter, BD-rate gains of 0.5% and 6.0% in terms of PSNR of decoded views and synthesized views, respectively.

Citation Download Citation

Seok Lee, Seungsin Lee, Hocheon Wey, Jaejoon Lee, and Dusik Park "Depth inloop resampling using dilation filter for free viewpoint video system", Proc. SPIE 8648, Stereoscopic Displays and Applications XXIV, 864822 (12 March 2013); https://doi.org/10.1117/12.2008424

ACCESS THE FULL ARTICLE