High precision object segmentation and tracking for use in super resolution video reconstruction

T. Nathan Mundhenk; Rashmi Sundareswara; David R. Gerwe; Yang Chen

doi:10.1117/12.871605

24 January 2011 High precision object segmentation and tracking for use in super resolution video reconstruction

T. Nathan Mundhenk, Rashmi Sundareswara, David R. Gerwe, Yang Chen

Proceedings Volume 7878, Intelligent Robots and Computer Vision XXVIII: Algorithms and Techniques; 78780G (2011) https://doi.org/10.1117/12.871605
Event: IS&T/SPIE Electronic Imaging, 2011, San Francisco Airport, California, United States

Abstract

Super resolution image reconstruction allows for the enhancement of images in a video sequence that is superior to the original pixel resolution of the imager. Difficulty arises when there are foreground objects that move differently than the background. A common example of this is a car in motion in a video. Given the common occurrence of such situations, super resolution reconstruction becomes non-trivial. One method for dealing with this is to segment out foreground objects and quantify their pixel motion differently. First we estimate local pixel motion using a standard block motion algorithm common to MPEG encoding. This is then combined with the image itself into a five dimensional mean-shift kernel density estimation based image segmentation with mixed motion and color image feature information. This results in a tight segmentation of objects in terms of both motion and visible image features. The next step is to combine segments into a single master object. Statistically common motion and proximity are used to merge segments into master objects. To account for inconsistencies that can arise when tracking objects, we compute statistics over the object and fit it with a generalized linear model. Using the Kullback-Leibler divergence, we have a metric for the goodness of the track for an object between frames.

Citation Download Citation

T. Nathan Mundhenk, Rashmi Sundareswara, David R. Gerwe, and Yang Chen "High precision object segmentation and tracking for use in super resolution video reconstruction", Proc. SPIE 7878, Intelligent Robots and Computer Vision XXVIII: Algorithms and Techniques, 78780G (24 January 2011); https://doi.org/10.1117/12.871605

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available