Missing area reconstruction in 3D scene from multi-view satellite images for surveillance applications

V. Voronin; N. Gapon; M. Zhdanova; E. Semenishchev; Y. Cen; A. Zelensky

doi:10.1117/12.2574208

13 October 2020 Missing area reconstruction in 3D scene from multi-view satellite images for surveillance applications

V. Voronin, N. Gapon, M. Zhdanova, E. Semenishchev, Y. Cen, A. Zelensky

Proceedings Volume 11542, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies IV; 115420P (2020) https://doi.org/10.1117/12.2574208
Event: SPIE Security + Defence, 2020, Online Only

Conference Poster

Abstract

Automatic 3-D recovery from multiview satellite images can be extremely useful for information extraction for the surveillance application. For 3-D scene reconstruction, one approach is to employ multiple cameras for creating a multiview image with the aim to make interactive free-viewpoint selection possible in 3-D data. In most cases, such a 3-D scene contains missing holes on depth maps that appear during the synthesis from multi-views. This paper presents an automated pipeline for processing multi-view satellite images to 3-D digital surface models. The proposed approach uses the modified exemplar-based technique. We propose an algorithm using the concepts of a sparse representation of quaternions, which use a new gradient to calculate the priority function by integrating the structure of quaternions with LPA-ICI (local polynomial approximation - the intersection of confidence intervals) and the saliency map. Moreover, the color information incorporates into the optimization criteria to obtain sharp inpainting results. For this purpose, we use the Hamiltonian quaternion framework. Compared with state-of-the-art techniques, the proposed algorithm provides plausible restoration of the depth map from multi-view satellite images, which makes them a promising tool for surveillance applications.

Citation Download Citation

V. Voronin, N. Gapon, M. Zhdanova, E. Semenishchev, Y. Cen, and A. Zelensky "Missing area reconstruction in 3D scene from multi-view satellite images for surveillance applications", Proc. SPIE 11542, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies IV, 115420P (13 October 2020); https://doi.org/10.1117/12.2574208

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available