Video summarization with local and global attention

Ziyan Wang

doi:10.1117/12.2682389

26 May 2023 Video summarization with local and global attention

Ziyan Wang

Proceedings Volume 12700, International Conference on Electronic Information Engineering and Data Processing (EIEDP 2023); 127002L (2023) https://doi.org/10.1117/12.2682389
Event: International Conference on Electronic Information Engineering and Data Processing (EIEDP 2023), 2023, Nanchang, China

Abstract

In this work, we propose a novel framework for video summarization called the Frame and Shot Network (FSNet). Unlike existing supervised video summarization methods that focus on the relationship between frames in videos, we discovered that the correlation between shots is equally significant. Our FSNet comprises of two separate modules, one for calculating frame correlations and the other for shot correlations, both of which incorporate an attention mechanism. To demonstrate the effectiveness of our method, we evaluated it on the SumMe and TVSum datasets. The results indicate that our FSNet outperforms previous state-of-the-art algorithms.

Citation Download Citation

Ziyan Wang "Video summarization with local and global attention", Proc. SPIE 12700, International Conference on Electronic Information Engineering and Data Processing (EIEDP 2023), 127002L (26 May 2023); https://doi.org/10.1117/12.2682389

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available