CONFERENCE PROCEEDINGS
Advanced Search
Home > Proceedings > Volume 13231 > Article
Paper
16 August 2024 Multispectral sample augmentation and illumination guidance for RGB-T object detection by mm detection framework
Jinqi Yang, Xin Yang, Yizhao Liao, Jinxiang Huang, Hongyu He, Erfan Zhang, Ya Zhou, Yong Song
Author Affiliations +
Proceedings Volume 13231, 4th International Conference on Laser, Optics, and Optoelectronic Technology (LOPET 2024); 132312B (2024) https://doi.org/10.1117/12.3040116
Event: Fourth International Conference on Laser, Optics, and Optoelectronic Technology (LOPET 2024), 2024, Chongqing, China
Abstract
Multispectral object detection technology has important application prospects in the fields of autonomous driving and so on. Conventional multispectral object detection algorithm rely solely on deep neural networks to learn multispectral image sample information, lacking the guidance of prior knowledge, and not fully utilizing infrared, visible, and other spectral information, resulting in decreased accuracy of object detection in complex scenes. To address this problem, this paper proposes an object detection algorithm based on infrared visible sample augmentation and illumination guidance. The algorithm adopts the MMDetection framework and extracts multispectral object features based on a designed sample augmentation method based on the fusion of positive and negative samples in multispectral images. Based on a designed adaptive weight allocation method guided by illumination, it enhances the algorithm's adaptability to the lighting environment. Finally, through the design of a multi-task loss function, it achieves high-precision and robust object detection in complex scenes. Experimental results on datasets such as FLIR and M3FD show that the proposed algorithm has significant advantages over comparative algorithms such as CFR_3 and GAFF in terms of average detection precision.
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Citation Download Citation
Jinqi Yang, Xin Yang, Yizhao Liao, Jinxiang Huang, Hongyu He, Erfan Zhang, Ya Zhou, and Yong Song "Multispectral sample augmentation and illumination guidance for RGB-T object detection by mm detection framework", Proc. SPIE 13231, 4th International Conference on Laser, Optics, and Optoelectronic Technology (LOPET 2024), 132312B (16 August 2024); https://doi.org/10.1117/12.3040116
ACCESS THE FULL ARTICLE
ORGANIZATIONAL
Sign in with credentials provided by your organization.
INSTITUTIONAL
Select your institution to access the SPIE Digital Library.
SELECT YOUR INSTITUTION
PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
PERSONAL SIGN IN
No SPIE Account? Create one
;
PURCHASE THIS CONTENT
SUBSCRIBE TO DIGITAL LIBRARY
50 downloads per 1-year subscription
Members: $195
Non-members: $335 ADD TO CART
25 downloads per 1 - year subscription
Members: $145
Non-members: $250 ADD TO CART
PURCHASE SINGLE ARTICLE
Includes PDF, HTML & Video, when available
Members: $17.00
Non-members: $21.00 ADD TO CART
PROCEEDINGS
 7 PAGES
DOWNLOAD PAPER SAVE TO MY LIBRARY
GET CITATION
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Object detection
Light sources and illumination
Detection and tracking algorithms
Infrared radiation
Infrared imaging
Visible radiation
Feature fusion
RELATED CONTENT
Subscribe to Digital Library
Receive Erratum Email Alert
Back to Top