A depth video processing algorithm for high encoding and rendering performance

Mingsong Guo; Fen Chen; Chengkai Sheng; Zongju Peng; Gangyi Jiang

doi:10.1117/12.2073478

4 November 2014 A depth video processing algorithm for high encoding and rendering performance

Mingsong Guo, Fen Chen, Chengkai Sheng, Zongju Peng, Gangyi Jiang

Proceedings Volume 9273, Optoelectronic Imaging and Multimedia Technology III; 92730O (2014) https://doi.org/10.1117/12.2073478
Event: SPIE/COS Photonics Asia, 2014, Beijing, China

Abstract

In free viewpoint video system, the color and the corresponding depth video are utilized to synthesize the virtual views by depth image based rendering (DIBR) technique. Hence, high quality of depth videos is a prerequisite for high quality of virtual views. However, depth variation, caused by scene variance and limited depth capturing technologies, may increase the encoding bitrate of depth videos and decrease the quality of virtual views. To tackle these problems, a depth preprocess method based on smoothing the texture and abrupt changes of depth videos is proposed to increase the accuracy of depth videos in this paper. Firstly, a bilateral filter is adopted to smooth the whole depth videos and protect the edge of depth videos at the same time. Secondly, abrupt variation is detected by a threshold calculated according to the camera parameter of each video sequence. Holes of virtual views occur when the depth values of left view change obviously from low to high in horizontal direction or the depth values of right view change obviously from high to low. So for the left view, depth value difference in left side gradually becomes smaller where it is greater than the thresholds. And then, in right side of right view is processed likewise. Experimental results show that the proposed method can averagely reduce the encoding bitrate by 25% while the quality of the synthesized virtual views can be improve by 0.39dB on average compared with using original depth videos. The subjective quality improvement is also achieved.

Citation Download Citation

Mingsong Guo, Fen Chen, Chengkai Sheng, Zongju Peng, and Gangyi Jiang "A depth video processing algorithm for high encoding and rendering performance", Proc. SPIE 9273, Optoelectronic Imaging and Multimedia Technology III, 92730O (4 November 2014); https://doi.org/10.1117/12.2073478

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Video processing

Video coding

Computer programming

Video compression

Cameras

Gaussian filters

Show All Keywords

Keywords/Phrases

Search In:

Publication Years