Block adaptive CNN/HEVC interframe prediction for video coding

Satoru Jimbo; Ji Wang; Yoshiyuki Yashima

doi:10.1117/12.2520214

22 March 2019 Block adaptive CNN/HEVC interframe prediction for video coding

Satoru Jimbo, Ji Wang, Yoshiyuki Yashima

Proceedings Volume 11049, International Workshop on Advanced Image Technology (IWAIT) 2019; 1104936 (2019) https://doi.org/10.1117/12.2520214
Event: 2019 Joint International Workshop on Advanced Image Technology (IWAIT) and International Forum on Medical Imaging in Asia (IFMIA), 2019, Singapore, Singapore

Abstract

This paper proposes a block adaptive CNN/HEVC prediction method for bidirectional motion compensated prediction which is one of the key technologies for video coding. We have already proposed a deep convolutional neural network (CNN) model which can predict the target block to be predicted from its spatially co-located blocks existed in the temporally previous and future frames. The CNN model estimates four geometric transformation matrices, and the predicted values are produced by transforming both previous block and future block using them. We have demonstrated that the method is greatly effective for frames with complicated motion. However, the conventional CNN model often did not work well for the frames with large motion. In this paper, we introduce an adaptation method which selects the one of CNN based prediction and HEVC based prediction. Experimental results show that the prediction error using the proposed method can be reduced to 60% to 90% for many kinds of videos with complex motions compared to only HEVC prediction.

Citation Download Citation

Satoru Jimbo, Ji Wang, and Yoshiyuki Yashima "Block adaptive CNN/HEVC interframe prediction for video coding", Proc. SPIE 11049, International Workshop on Advanced Image Technology (IWAIT) 2019, 1104936 (22 March 2019); https://doi.org/10.1117/12.2520214

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available