Free-viewpoint video synthesis from mixed resolution multi-view images and low resolution depth maps

Takaaki Emori; Mehrdad Panahpour Tehrani; Keita Takahashi; Toshiaki Fujii

doi:10.1117/12.2078853

17 March 2015 Free-viewpoint video synthesis from mixed resolution multi-view images and low resolution depth maps

Takaaki Emori, Mehrdad Panahpour Tehrani, Keita Takahashi, Toshiaki Fujii

Proceedings Volume 9391, Stereoscopic Displays and Applications XXVI; 93911C (2015) https://doi.org/10.1117/12.2078853
Event: SPIE/IS&T Electronic Imaging, 2015, San Francisco, California, United States

Abstract

Streaming application of multi-view and free-viewpoint video is potentially attractive but due to the limitation of bandwidth, transmitting all multi-view video in high resolution may not be feasible. Our goal is to propose a new streaming data format that can be adapted to the limited bandwidth and capable of free-viewpoint video streaming using multi-view video plus depth (MVD). Given a requested free-viewpoint, we use the two closest views and corresponding depth maps to perform free-viewpoint video synthesis. We propose a new data format that consists of all views and corresponding depth maps in a lowered resolution, and the two closest views to the requested viewpoint in the high resolution. When the requested viewpoint changes, the two closest viewpoints will change, but one or both of views are transmitted only in the low resolution during the delay time. Therefore, the resolution compensation is required. In this paper, we investigated several cases where one or both of the views are transmitted only in the low resolution. We proposed adequate view synthesis method for multi resolution multi-view video plus depth. Experimental results show that our framework achieves view synthesis quality close to high resolution multi-view video plus depth.

Citation Download Citation

Takaaki Emori, Mehrdad Panahpour Tehrani, Keita Takahashi, and Toshiaki Fujii "Free-viewpoint video synthesis from mixed resolution multi-view images and low resolution depth maps", Proc. SPIE 9391, Stereoscopic Displays and Applications XXVI, 93911C (17 March 2015); https://doi.org/10.1117/12.2078853

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available