Visual tracking with kernelized correlation filters based on multiple features

Zhi Cai; Liquan Dong; Ming Liu; Yuejin Zhao; Haoyuan Du; Ruifeng Yuan; Feilong Ma

doi:10.1117/12.2319715

7 September 2018 Visual tracking with kernelized correlation filters based on multiple features

Zhi Cai, Liquan Dong, Ming Liu, Yuejin Zhao, Haoyuan Du, Ruifeng Yuan, Feilong Ma

Proceedings Volume 10751, Optics and Photonics for Information Processing XII; 107510O (2018) https://doi.org/10.1117/12.2319715
Event: SPIE Optical Engineering + Applications, 2018, San Diego, California, United States

Abstract

Visual object tracking plays a significant role in our daily life such as intelligent transportation and surveillance. However, an accurate and robust object tracker is hard to be obtained as target objects often go through huge appearance changes caused by deformation, abrupt motion, background clutter and occlusion. In this paper, we combine features extracted from deep convolutional neural networks pretrained on object recognition datasets with color name features and histogram of oriented gradient features skillfully to improve tracking accuracy and robustness. The outputs of the convolutional layers encode the senior semantic information of targets and such representations are robust to great appearance variations while their spatial resolution is too coarse to precisely locate targets. In contrast, color name features connected at the back of HOG features could provide more precise localization but are less invariant to appearance changes. We first infer the response of the convolutional features and HOG-CN features respectively, then make a linear combination of them. The maximum value of the result could represent the accurate localization of the target. We not only compare the tracking results of adopting a single feature alone, showing that the performance of them is inferior to ours, but also analyze the effect of exploiting features extracted from different convolutional layers on the tracking performance. What’s more, we introduce the adaptive target response map in our tracking algorithm to keep the target from drifting as much as possible. Extensive experimental results on a large scale benchmark dataset illustrates outstanding performance of the proposed algorithm.

Conference Presentation

Citation Download Citation

Zhi Cai, Liquan Dong, Ming Liu, Yuejin Zhao, Haoyuan Du, Ruifeng Yuan, and Feilong Ma "Visual tracking with kernelized correlation filters based on multiple features", Proc. SPIE 10751, Optics and Photonics for Information Processing XII, 107510O (7 September 2018); https://doi.org/10.1117/12.2319715

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available