Comparison of a segmentation algorithm to six expert imagiologists in detecting pulmonary contours on x-ray CT images

Carlos Ferreira; Beatriz Sousa Santos; Jose Silvestre Silva; Augusto Silva

doi:10.1117/12.480072

22 May 2003 Comparison of a segmentation algorithm to six expert imagiologists in detecting pulmonary contours on x-ray CT images

Carlos Ferreira, Beatriz Sousa Santos, Jose Silvestre Silva, Augusto Silva

Author Affiliations +

Proceedings Volume 5034, Medical Imaging 2003: Image Perception, Observer Performance, and Technology Assessment; (2003) https://doi.org/10.1117/12.480072
Event: Medical Imaging 2003, 2003, San Diego, California, United States

Abstract

Quantitative evaluation of the performance of segmentation algorithms on medical images is crucial before their clinical use can be considered. We have quantitatively compared the contours obtained by a pulmonary segmentation algorithm to contours manually-drawn by six expert imaiologists on the same set of images, since the ground truth is unknown. Two types of variability (inter-observer and intra-observer) should be taken into account in the performance evaluation of segmentation algorithms and several methods to do it have been proposed. This paper describes the quantitative evaluation of the performance of our segmentation algorithm using several figures of merit, exploratory and multivariate data analysis and non parametric tests, based on the assessment of the inter-observer variability of six expert imagiologists from three different hospitals and the intra-observer variability of two expert imagiologists from the same hospital. As an overall result of this comparison we were able to claim that the consistency and accuracy of our pulmonary segmentation algorithm is adequate for most of the quantitative requirements mentioned by the imagiologists. We also believe that the methodology used to evaluate the performance of our algorithm is general enough to be applicable to many other segmentation problems on medical images.

Citation Download Citation

Carlos Ferreira, Beatriz Sousa Santos, Jose Silvestre Silva, and Augusto Silva "Comparison of a segmentation algorithm to six expert imagiologists in detecting pulmonary contours on x-ray CT images", Proc. SPIE 5034, Medical Imaging 2003: Image Perception, Observer Performance, and Technology Assessment, (22 May 2003); https://doi.org/10.1117/12.480072

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE