3D from compressed 2D video

Ianir A. Ideses; Leonid P. Yaroslavsky; Barak Fishbain; Roni Vistuch

doi:10.1117/12.703416

5 March 2007 3D from compressed 2D video

Ianir A. Ideses, Leonid P. Yaroslavsky, Barak Fishbain, Roni Vistuch

Proceedings Volume 6490, Stereoscopic Displays and Virtual Reality Systems XIV; 64901C (2007) https://doi.org/10.1117/12.703416
Event: Electronic Imaging 2007, 2007, San Jose, CA, United States

Abstract

In this paper, we present an efficient method to synthesize 3D video from compressed 2D video. The 2D video is analyzed by computing frame-by-frame motion maps. For this computation, MPEG motion vectors extraction was performed. Using the extracted motion vector maps, the video undergoes analysis and the frames are segmented to provide object-wise depth ordering. The frames are then used to synthesize stereo pairs. This is performed by resampling the video frames on a grid that is governed by a corresponding depth-map. In order to improve the quality of the synthetic video, as well as to enable 2D viewing where 3D visualization is not possible, several techniques for image enhancement are used. In our test case, anaglyph projection was selected as the 3D visualization method, as the method is mostly suited to standard displays. The drawback of this method is ghosting artifacts. In our implementation we minimize these unwanted artifacts by modifying the computed depth-maps using non-linear transformations. Defocusing of one anaglyph color component was also used to counter such artifacts. Our results show that the suggested methods enable synthesis of high quality 3D videos in real-time.

Citation Download Citation

Ianir A. Ideses, Leonid P. Yaroslavsky, Barak Fishbain, and Roni Vistuch "3D from compressed 2D video", Proc. SPIE 6490, Stereoscopic Displays and Virtual Reality Systems XIV, 64901C (5 March 2007); https://doi.org/10.1117/12.703416

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available