Hierarchical motion-compensated deep network for video compression

Ying Liu; Pengli Du; Yuzhu Li

doi:10.1117/12.2586459

12 April 2021 Hierarchical motion-compensated deep network for video compression

Ying Liu, Pengli Du, Yuzhu Li

Proceedings Volume 11730, Big Data III: Learning, Analytics, and Applications; 117300J (2021) https://doi.org/10.1117/12.2586459
Event: SPIE Defense + Commercial Sensing, 2021, Online Only

Abstract

Video coding is the process of reducing the huge volume of video data to a small number of bits. High coding efficiency reduces the bandwidth required for video streaming, and the space required to store the video data on electronic devices, while maintaining the fidelity of the decompressed video signal. In recent years, deep learning has been extensively applied in the field of video coding. However, it remains challenging how to explore the intra- and inter-frame correlations in deep learning-based video coding systems to improve the coding efficiency. In this work, we propose a hierarchical motion estimation and compensation network for video compression. The video frames are tagged as intra-frames and inter-frames. While intra-frames are compressed independently, the inter-frames are hierarchically predicted by adjacent frames using a bi-directional motion prediction network, which results in highly sparse and compressible residue. The residue frames are then compressed via separately trained residue coding networks. Experimental results demonstrate that the proposed hierarchical deep video compression network offers significantly higher coding efficiencey and superior visual quality compared to prior arts.

Conference Presentation

Citation Download Citation

Ying Liu, Pengli Du, and Yuzhu Li "Hierarchical motion-compensated deep network for video compression", Proc. SPIE 11730, Big Data III: Learning, Analytics, and Applications, 117300J (12 April 2021); https://doi.org/10.1117/12.2586459

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available