Efficient super-resolution image reconstruction applied to surveillance video captured by small unmanned aircraft systems

Qiang He; Richard R. Schultz; Chee-Hung Henry Chu

doi:10.1117/12.767826

17 April 2008 Efficient super-resolution image reconstruction applied to surveillance video captured by small unmanned aircraft systems

Qiang He, Richard R. Schultz, Chee-Hung Henry Chu

Author Affiliations +

Proceedings Volume 6968, Signal Processing, Sensor Fusion, and Target Recognition XVII; 696814 (2008) https://doi.org/10.1117/12.767826
Event: SPIE Defense and Security Symposium, 2008, Orlando, Florida, United States

Abstract

The concept surrounding super-resolution image reconstruction is to recover a highly-resolved image from a series of low-resolution images via between-frame subpixel image registration. In this paper, we propose a novel and efficient super-resolution algorithm, and then apply it to the reconstruction of real video data captured by a small Unmanned Aircraft System (UAS). Small UAS aircraft generally have a wingspan of less than four meters, so that these vehicles and their payloads can be buffeted by even light winds, resulting in potentially unstable video. This algorithm is based on a coarse-to-fine strategy, in which a coarsely super-resolved image sequence is first built from the original video data by image registration and bi-cubic interpolation between a fixed reference frame and every additional frame. It is well known that the median filter is robust to outliers. If we calculate pixel-wise medians in the coarsely super-resolved image sequence, we can restore a refined super-resolved image. The primary advantage is that this is a noniterative algorithm, unlike traditional approaches based on highly-computational iterative algorithms. Experimental results show that our coarse-to-fine super-resolution algorithm is not only robust, but also very efficient. In comparison with five well-known super-resolution algorithms, namely the robust super-resolution algorithm, bi-cubic interpolation, projection onto convex sets (POCS), the Papoulis-Gerchberg algorithm, and the iterated back projection algorithm, our proposed algorithm gives both strong efficiency and robustness, as well as good visual performance. This is particularly useful for the application of super-resolution to UAS surveillance video, where real-time processing is highly desired.

Citation Download Citation

Qiang He, Richard R. Schultz, and Chee-Hung Henry Chu "Efficient super-resolution image reconstruction applied to surveillance video captured by small unmanned aircraft systems", Proc. SPIE 6968, Signal Processing, Sensor Fusion, and Target Recognition XVII, 696814 (17 April 2008); https://doi.org/10.1117/12.767826

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available