Adaptive hole filling for 3D warping-based virtual view synthesis

Tatsuro Mori; Mehrdad Panahpour Tehrani; Toshiaki Fujii; Masayuki Tanimoto

doi:10.1117/12.2002830

12 March 2013 Adaptive hole filling for 3D warping-based virtual view synthesis

Tatsuro Mori, Mehrdad Panahpour Tehrani, Toshiaki Fujii, Masayuki Tanimoto

Proceedings Volume 8648, Stereoscopic Displays and Applications XXIV; 864823 (2013) https://doi.org/10.1117/12.2002830
Event: IS&T/SPIE Electronic Imaging, 2013, Burlingame, California, United States

Abstract

In this paper, we discuss a Free viewpoint synthesis with View + Depth format for Multiview applications such as 3DTV and Free View-point Television(FTV)¹.When generating a virtual image, 3D warping is used with view and depth of a reference camera. This process includes the problem that holes appear in the virtual image. In conventional method, the holes were dealt with collectively by median filter. There are some different reasons why holes appear through this process. So, it is improper that they are not distinguished particularly and treated all at once like conventional method. We analyze the factors, and recognize that two ones exist, boundary between foreground and background, and reduction of resolution. In this paper, we propose a new hole filling method considering these factors. In the first step, we classify nearby pixels into boundary or same object area according to the gradient of depth value. For boundary case, we hold them and refer to other two real cameras. For another case of same object area, we set up sub-pixels between nearby pixels and warp them if the depth is gradually changing or virtual viewpoint of the warped image is closer to the object than the original view position because they probably cause holes from reduction of resolution. We implement these methods in the simulation. As a result, we prevent boundary in the virtual image from being ambiguous, and confirm the availability of proposed method.

Citation Download Citation

Tatsuro Mori, Mehrdad Panahpour Tehrani, Toshiaki Fujii, and Masayuki Tanimoto "Adaptive hole filling for 3D warping-based virtual view synthesis", Proc. SPIE 8648, Stereoscopic Displays and Applications XXIV, 864823 (12 March 2013); https://doi.org/10.1117/12.2002830

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Image processing

3D image processing

3D vision

Image filtering

Digital filtering

3D displays

Show All Keywords

Keywords/Phrases

Search In:

Publication Years