Compact multimodal multispectral sensor system for tactical reconnaissance

Trym V. Haavardsholm; Thomas O. Opsahl; Torbjørn Skauli; Annette Stahl

doi:10.1117/12.2632701

30 September 2022 Compact multimodal multispectral sensor system for tactical reconnaissance

Trym V. Haavardsholm, Thomas O. Opsahl, Torbjørn Skauli, Annette Stahl

Proceedings Volume 12235, Imaging Spectrometry XXV: Applications, Sensors, and Processing; 122350B (2022) https://doi.org/10.1117/12.2632701
Event: SPIE Optical Engineering + Applications, 2022, San Diego, California, United States

Abstract

Multispectral imaging is an attractive sensing modality for small unmanned aerial vehicles (UAVs) in numerous military and civilian applications such as reconnaissance, target detection, and precision agriculture. Cameras based on patterned filters in the focal plane, such as conventional colour cameras, represent the most compact architecture for spectral imaging, but image reconstruction becomes challenging at higher band counts. We consider a camera configuration where six bandpass filters are arranged in a periodically repeating pattern in the focal plane. In addition, a large unfiltered region permits conventional monochromatic video imaging that can be used for situational awareness (SA), including estimating the camera motion and the 3D structure of the ground surface. By platform movement, the filters are scanned over the scene, capturing an irregular pattern of spectral samples of the ground surface. Through estimation of the camera trajectory and 3D scene structure, it is still possible to assemble a spectral image by fusing all measurements in software. The repeated sampling of bands enables spectral consistency testing, which can improve spectral integrity significantly. The result is a truly multimodal camera sensor system able to produce a range of image products. Here, we investigate its application in tactical reconnaissance by pushing towards on-board real-time spectral reconstruction based on visual odometry (VO) and full 3D reconstruction of the scene. The results are compared with offline processing based on estimates from visual simultaneous localisation and mapping (VSLAM) and indicate that the multimodal sensing concept has a clear potential for use in tactical reconnaissance scenarios.

Conference Presentation

Citation Download Citation

Trym V. Haavardsholm, Thomas O. Opsahl, Torbjørn Skauli, and Annette Stahl "Compact multimodal multispectral sensor system for tactical reconnaissance", Proc. SPIE 12235, Imaging Spectrometry XXV: Applications, Sensors, and Processing, 122350B (30 September 2022); https://doi.org/10.1117/12.2632701

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available