Low-delay cloud-based rendering of free viewpoint video for mobile devices

Dan Miao; Wenwu Zhu; Chang Wen Chen

doi:10.1117/12.2023177

26 September 2013 Low-delay cloud-based rendering of free viewpoint video for mobile devices

Dan Miao, Wenwu Zhu, Chang Wen Chen

Proceedings Volume 8856, Applications of Digital Image Processing XXXVI; 88560C (2013) https://doi.org/10.1117/12.2023177
Event: SPIE Optical Engineering + Applications, 2013, San Diego, California, United States

Abstract

Free viewpoint video (FVV) provides immersive experiences in a truly seamless environment. Cloud computing facilitates the possibility to watch the FVV on mobile devices through the remote rendering in which the synthesis view is rendered in cloud server and transmitted to mobile devices. However, how to reduce the interaction delay during the viewpoint switching is a challenging problem in the remote rendering. In this paper, we propose a low-delay cloud-based FVV rendering framework to support FVV on mobile devices with satisfactory video quality and low interaction delay. In our framework, the rendering allocation scheme is proposed in which the local rendering is introduced on mobile devices during the viewpoint switching to conceal the interaction delay. To support the local rendering, the side information is generated based on the viewpoint prediction and 3D warping rule in cloud and then compressed by standard video codec. The experiment results show that the proposed remote rendering framework can improve the quality of experience substantially with improved free viewpoint video quality and low interaction delay on mobile devices.

Citation Download Citation

Dan Miao, Wenwu Zhu, and Chang Wen Chen "Low-delay cloud-based rendering of free viewpoint video for mobile devices", Proc. SPIE 8856, Applications of Digital Image Processing XXXVI, 88560C (26 September 2013); https://doi.org/10.1117/12.2023177

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available