Focus mismatches in multiview systems and efficient adaptive reference filtering for multiview video coding

PoLin Lai; Antonio Ortega; Purvin Pandit; Peng Yin; Cristina Gomila

doi:10.1117/12.769215

28 January 2008 Focus mismatches in multiview systems and efficient adaptive reference filtering for multiview video coding

PoLin Lai, Antonio Ortega, Purvin Pandit, Peng Yin, Cristina Gomila

Author Affiliations +

Proceedings Volume 6822, Visual Communications and Image Processing 2008; 682214 (2008) https://doi.org/10.1117/12.769215
Event: Electronic Imaging, 2008, San Jose, California, United States

Abstract

In this paper, we analyze focus mismatches among cameras utilized in a multiview system, and propose techniques to efficiently apply our previously proposed adaptive reference filtering (ARF) scheme to inter-view prediction in multiview video coding (MVC). We show that, with heterogeneous focus setting, the differences exhibit in images captured by different cameras can be represented in terms of the focus setting mismatches (view-dependency) and the depths of objects (depth-dependency). We then analyze the performance of the previously proposed ARF in MVC inter-view prediction. The gains in coding efficiency show a strong view-wise variation. Furthermore, the estimated filter coeffcients demonstrate strong correlation when the depths of objects in the scene remain similar. By exploiting the properties derived from the theoretical and performance analysis, we propose two techniques to achieve effcient ARF coding scheme: i) view-wise ARF adaptation based on RD-cost prediction, which determines whether ARF is beneficial for a given view, and ii) filter updating based on depth-composition change, in which the same set of filters will be used (i.e., no new filters will be designed) until there is significant change in the depth-composition within the scene. Simulation results show that significant complexity savings are possible (e.g., the complete ARF encoding process needs to be applied to only 20% ~ 35% of the frames) with negligible quality degradation (e.g., around 0.05 dB loss).

Citation Download Citation

PoLin Lai, Antonio Ortega, Purvin Pandit, Peng Yin, and Cristina Gomila "Focus mismatches in multiview systems and efficient adaptive reference filtering for multiview video coding", Proc. SPIE 6822, Visual Communications and Image Processing 2008, 682214 (28 January 2008); https://doi.org/10.1117/12.769215

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available