New benchmark for image segmentation evaluation

Feng Ge; Song Wang; Tiecheng Liu

doi:10.1117/1.2762250

1 July 2007 New benchmark for image segmentation evaluation

Feng Ge, Song Wang, Tiecheng Liu

Author Affiliations +

Journal of Electronic Imaging, Vol. 16, Issue 3, 033011 (July 2007). https://doi.org/10.1117/1.2762250

Abstract

Image segmentation and its performance evaluation are very difficult but important problems in computer vision. A major challenge in segmentation evaluation comes from the fundamental conflict between generality and objectivity: For general-purpose segmentation, the ground truth and segmentation accuracy may not be well defined, while embedding the evaluation in a specific application, the evaluation results may not be extensible to other applications. We present a new benchmark to evaluate five different image segmentation methods according to their capability to separate a perceptually salient structure from the background with a relatively small number of segments. This way, we not only find a large variety of images that satisfy the requirement of good generality, but also construct ground-truth segmentations to achieve good objectivity. We also present a special strategy to address two important issues underlying this benchmark: (1) most image-segmentation methods are not developed to directly extract a single salient structure; (2) many real images have multiple salient structures. We apply this benchmark to evaluate and compare the performance of several state-of-the-art image segmentation methods, including the normalized-cut method, the watershed method, the efficient graph-based method, the mean-shift method, and the ratio-cut method.

©(2007) Society of Photo-Optical Instrumentation Engineers (SPIE)

Citation Download Citation

Feng Ge, Song Wang, and Tiecheng Liu "New benchmark for image segmentation evaluation," Journal of Electronic Imaging 16(3), 033011 (1 July 2007). https://doi.org/10.1117/1.2762250

Published: 1 July 2007

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available