Hole filling using joint bilateral filtering for moving object segmentation

Ran Liu; Bole Li; Zhengwei Huang; Donghua Cao; Yingchun Tan; Zekun Deng; Miao Xu; Ruishuang Jia; Weimin Tan

doi:10.1117/1.JEI.23.6.063021

18 December 2014 Hole filling using joint bilateral filtering for moving object segmentation

Ran Liu, Bole Li, Zhengwei Huang, Donghua Cao, Yingchun Tan, Zekun Deng, Miao Xu, Ruishuang Jia, Weimin Tan

Author Affiliations +

Journal of Electronic Imaging, Vol. 23, Issue 6, 063021 (December 2014). https://doi.org/10.1117/1.JEI.23.6.063021

Abstract

Due to various reasons (e.g., poor quality of image, sudden changes in light conditions, occlusions, or objects with similar colors), holes may appear in the moving object region when performing moving object segmentation. How to remove these holes is a crucial problem in high-quality segmentation. A moving object segmentation approach combining symmetrical differencing and joint bilateral filtering is proposed. One important aspect of our approach is that joint bilateral filtering is used to eliminate/reduce the holes in the moving object region, which makes the extracted moving object more accurate and complete, in many cases in contrast to the reference temporal difference approaches. The approach first performs block-based symmetrical differencing to obtain coarse moving object regions. Then, a joint bilateral filter that uses the current gray image as a guide image is adopted to smooth the difference image. Next, edge detection is performed on the smoothed difference image and the current gray image, respectively, to get the edges of moving objects. Finally, the undesired background is distinguished from the moving object and is cut off by a postprocessing module. In addition, the fast joint bilateral filters that can be used as substitutes for the classical joint bilateral filter are discussed. Experimental results show that this approach can effectively fill the holes in the moving object region and provide an improvement in accuracy of moving object segmentation in many cases.

Citation Download Citation

Ran Liu, Bole Li, Zhengwei Huang, Donghua Cao, Yingchun Tan, Zekun Deng, Miao Xu, Ruishuang Jia, and Weimin Tan "Hole filling using joint bilateral filtering for moving object segmentation," Journal of Electronic Imaging 23(6), 063021 (18 December 2014). https://doi.org/10.1117/1.JEI.23.6.063021

Published: 18 December 2014

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available