Inverse dependence of search and classification performances in lesion localization tasks

D. P. Chakraborty; Hong-Jun Yoon; Claudia Mello-Thoms

doi:10.1117/12.911820

22 February 2012 Inverse dependence of search and classification performances in lesion localization tasks

D. P. Chakraborty, Hong-Jun Yoon, Claudia Mello-Thoms

Proceedings Volume 8318, Medical Imaging 2012: Image Perception, Observer Performance, and Technology Assessment; 83180H (2012) https://doi.org/10.1117/12.911820
Event: SPIE Medical Imaging, 2012, San Diego, California, United States

Abstract

Search involves detecting the locations of potential lesions. Classification involves determining if a detected region is a true lesion. The most commonly used measure of observer performance, namely the area A under the ROC curve, is affected by both search and classification performances. The aim was to demonstrate a method for separating these contributions and apply it to several clinical datasets. Search performance S was defined as the square root of 2 times the perpendicular distance of the end-point of the search-model predicted ROC from the chance diagonal. Classification performance C was defined as the separation of the unit-variance binormal distributions for signal and noise sites. Eleven (11) datasets were fitted by the search model and search, classification and trapezoidal A were computed for each modality and reader combination. Kendall-tau correlations were calculated between the resulting S, C and A pairs. Kendall correlation (S vs. C) was smaller than zero for all datasets, and the average Kendall correlation was significantly smaller than 0 (average = -0.401, P = 8.3 x 10^-6). Also, Kendall correlation (A vs. S) was larger than zero for 9 out of 11 datasets and the average Kendall correlation was significantly larger than 0 (average = 0.295, P = 2.9 x 10^-3). On the other hand average Kendall correlation (A vs. C) was not significantly different from zero (average = 0.102, P = 0.25). The results suggest that radiologists may learn to compensate for poor search performance with better classification performance. This study also indicates that efforts at improving net performance, which currently focus almost exclusively on improving classification performance, may be more successful if aimed at improving search performance.

Citation Download Citation

D. P. Chakraborty, Hong-Jun Yoon, and Claudia Mello-Thoms "Inverse dependence of search and classification performances in lesion localization tasks", Proc. SPIE 8318, Medical Imaging 2012: Image Perception, Observer Performance, and Technology Assessment, 83180H (22 February 2012); https://doi.org/10.1117/12.911820

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available