Geometric calibration of multi-sensor image fusion system with thermal infrared and low-light camera

Dragana Peric; Vojislav Lukic; Milana Spanovic; Radmila Sekulic; Jelena Kocic

doi:10.1117/12.2067061

Translator Disclaimer

13 October 2014 Geometric calibration of multi-sensor image fusion system with thermal infrared and low-light camera

Dragana Peric, Vojislav Lukic, Milana Spanovic, Radmila Sekulic, Jelena Kocic

Author Affiliations +

Proceedings Volume 9250, Electro-Optical Remote Sensing, Photonic Technologies, and Applications VIII; and Military Applications in Hyperspectral Imaging and High Spatial Resolution Sensing II; 92500O (2014) https://doi.org/10.1117/12.2067061
Event: SPIE Security + Defence, 2014, Amsterdam, Netherlands

Abstract

A calibration platform for geometric calibration of multi-sensor image fusion system is presented in this paper. The accurate geometric calibration of the extrinsic geometric parameters of cameras that uses planar calibration pattern is applied. For calibration procedure specific software is made. Patterns used in geometric calibration are prepared with aim to obtain maximum contrast in both visible and infrared spectral range - using chessboards which fields are made of different emissivity materials. Experiments were held in both indoor and outdoor scenarios. Important results of geometric calibration for multi-sensor image fusion system are extrinsic parameters in form of homography matrices used for homography transformation of the object plane to the image plane. For each camera a corresponding homography matrix is calculated. These matrices can be used for image registration of images from thermal and low light camera. We implemented such image registration algorithm to confirm accuracy of geometric calibration procedure in multi-sensor image fusion system. Results are given for selected patterns - chessboard with fields made of different emissivity materials. For the final image registration algorithm in surveillance system for object tracking we have chosen multi-resolution image registration algorithm which naturally combines with a pyramidal fusion scheme. The image pyramids which are generated at each time step of image registration algorithm may be reused at the fusion stage so that overall number of calculations that must be performed is greatly reduced.

Citation Download Citation

Dragana Peric, Vojislav Lukic, Milana Spanovic, Radmila Sekulic, and Jelena Kocic "Geometric calibration of multi-sensor image fusion system with thermal infrared and low-light camera", Proc. SPIE 9250, Electro-Optical Remote Sensing, Photonic Technologies, and Applications VIII; and Military Applications in Hyperspectral Imaging and High Spatial Resolution Sensing II, 92500O (13 October 2014); https://doi.org/10.1117/12.2067061

ACCESS THE FULL ARTICLE