Adaptive smoothing in real-time image stabilization

Shunguang Wu; David C. Zhang; Yuzheng Zhang; James Basso; Michael Melle

doi:10.1117/12.918737

7 May 2012 Adaptive smoothing in real-time image stabilization

Shunguang Wu, David C. Zhang, Yuzheng Zhang, James Basso, Michael Melle

Proceedings Volume 8399, Visual Information Processing XXI; 83990L (2012) https://doi.org/10.1117/12.918737
Event: SPIE Defense, Security, and Sensing, 2012, Baltimore, Maryland, United States

Abstract

When using the conventional fixed smoothing factor to display the stabilized video, we have the issue of large undefined black border regions (BBR) when camera is fast panning and zooming. To minimize the size of BBR and also provide smooth visualization to the display, this paper discusses several novel methods that have demonstrated on a real-time platform. These methods include an IIR filter, a single Kalman filter and an interactive multi-model filter. The fundamentals of these methods are to adapt the smoothing factor to the motion change from time to time to ensure small BBR and least jitters. To further remove the residual BBR, the pixels inside the BBR are composited from the previous frames. To do that, we first store the previous images and their corresponding frame-to-frame (F2F) motions in a FIFO queue, and then start filling the black pixels from valid pixels in the nearest neighbor frame based on the F2F motion. If a matching is found, then the search is stopped and continues to the next pixel. If the search is exhausted, the pixel remains black. These algorithms have been implemented and tested in a TI DM6437 processor.

Citation Download Citation

Shunguang Wu, David C. Zhang, Yuzheng Zhang, James Basso, and Michael Melle "Adaptive smoothing in real-time image stabilization", Proc. SPIE 8399, Visual Information Processing XXI, 83990L (7 May 2012); https://doi.org/10.1117/12.918737

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available