Infrared transformer tracker based on Siamese network

Ying Meng; Chao Ma; Yaoyuan Zeng; Wei An

doi:10.1117/12.2623077

1 December 2021 Infrared transformer tracker based on Siamese network

Ying Meng, Chao Ma, Yaoyuan Zeng, Wei An

Proceedings Volume 12079, Second IYSF Academic Symposium on Artificial Intelligence and Computer Engineering; 120792L (2021) https://doi.org/10.1117/12.2623077
Event: 2nd IYSF Academic Symposium on Artificial Intelligence and Computer Engineering, 2021, Xi'an, China

Abstract

Infrared target tracking is a fundamental task and plays an important role in military, weapon guidance and other fields because of the superiority of infrared imaging system. However, it is a challenging task due to lower resolution, smaller size and less texture information of infrared targets. Although varieties of methods demonstrate promising performance on visual target tracking, they cannot directly perform well on infrared images. To address this issue, we propose an infrared target tracker based on siamese network, named InfTrans, consisting of three components: a feature extraction backbone, an encoder-decoder transformer and a prediction head. In the InfTrans, transformer architecture is employed to exploit spatial and temporal information effectively. Firstly, considering the superior ability in capturing long-range dependencies, encoder-decoder transformer is connected after backbone to capture relationship between template and search patch along spatial and temporal dimension. Secondly, considering the parallel computing power of transformer, InfTrans receives search patch sequences containing multiple patches as input of search branch and processes multiple frames in parallel. Finally, a prediction head is employed to output bounding box sequences. InfTrans views infrared target tracking as a parallel bounding box prediction problem. Extensive experiments show that the proposed tracker achieves promising performance on public infrared dataset.

Citation Download Citation

Ying Meng, Chao Ma, Yaoyuan Zeng, and Wei An "Infrared transformer tracker based on Siamese network", Proc. SPIE 12079, Second IYSF Academic Symposium on Artificial Intelligence and Computer Engineering, 120792L (1 December 2021); https://doi.org/10.1117/12.2623077

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available