A context-action dependency model for spatio-temporal action localization

Junhan Wang; Xu Wang; Nanxi Chen

doi:10.1117/12.2646770

23 August 2022 A context-action dependency model for spatio-temporal action localization

Junhan Wang, Xu Wang, Nanxi Chen

Proceedings Volume 12330, International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2022); 123301U (2022) https://doi.org/10.1117/12.2646770
Event: International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2022), 2022, Huzhou, China

Abstract

Understanding the interaction to the context and the co-occurrence of actions is necessary for human action detection. This paper proposes a Context-Action Dependency (CAD) model for spatio-temporal action localization tasks. It leverages context features and action relations through two attention-based modules. A context-dependency module learns the relation between actors and attentive context information. An action-dependency module models each action class separately and explores the relations within co-occurring actions. This paper introduces an action detection framework that integrates the CAD model to improve the precision of action localization. To verify the effectiveness of our solutions, we ran experiments on two datasets AVA and UCF101-24. Our experiment shows that CAD has better performance than the baselines.

Citation Download Citation

Junhan Wang, Xu Wang, and Nanxi Chen "A context-action dependency model for spatio-temporal action localization", Proc. SPIE 12330, International Conference on Cyber Security, Artificial Intelligence, and Digital Economy (CSAIDE 2022), 123301U (23 August 2022); https://doi.org/10.1117/12.2646770

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Video

Computer aided design

Sensors

RGB color model

Visualization

Information visualization

Optical flow

Show All Keywords

Keywords/Phrases

Search In:

Publication Years