Predictive modeling of human perception subjectivity: feasibility study of mammographic lesion similarity

Songhua Xu; Kathleen Hudson M.D.; Yong Bradley M.D.; Brian J. Daley; Katherine Frederick-Dyer M.D.; Georgia Tourassi

doi:10.1117/12.913639

28 February 2012 Predictive modeling of human perception subjectivity: feasibility study of mammographic lesion similarity

Songhua Xu, Kathleen Hudson M.D., Yong Bradley M.D., Brian J. Daley, Katherine Frederick-Dyer M.D., Georgia Tourassi

Author Affiliations +

Proceedings Volume 8318, Medical Imaging 2012: Image Perception, Observer Performance, and Technology Assessment; 83180M (2012) https://doi.org/10.1117/12.913639
Event: SPIE Medical Imaging, 2012, San Diego, California, United States

Abstract

The majority of clinical content-based image retrieval (CBIR) studies disregard human perception subjectivity, aiming to duplicate the consensus expert assessment of the visual similarity on example cases. The purpose of our study is twofold: i) discern better the extent of human perception subjectivity when assessing the visual similarity of two images with similar semantic content, and (ii) explore the feasibility of personalized predictive modeling of visual similarity. We conducted a human observer study in which five observers of various expertise were shown ninety-nine triplets of mammographic masses with similar BI-RADS descriptors and were asked to select the two masses with the highest visual relevance. Pairwise agreement ranged between poor and fair among the five observers, as assessed by the kappa statistic. The observers' self-consistency rate was remarkably low, based on repeated questions where either the orientation or the presentation order of a mass was changed. Various machine learning algorithms were explored to determine whether they can predict each observer's personalized selection using textural features. Many algorithms performed with accuracy that exceeded each observer's self-consistency rate, as determined using a cross-validation scheme. This accuracy was statistically significantly higher than would be expected by chance alone (two-tailed p-value ranged between 0.001 and 0.01 for all five personalized models). The study confirmed that human perception subjectivity should be taken into account when developing CBIR-based medical applications.

Citation Download Citation

Songhua Xu, Kathleen Hudson M.D., Yong Bradley M.D., Brian J. Daley, Katherine Frederick-Dyer M.D., and Georgia Tourassi "Predictive modeling of human perception subjectivity: feasibility study of mammographic lesion similarity", Proc. SPIE 8318, Medical Imaging 2012: Image Perception, Observer Performance, and Technology Assessment, 83180M (28 February 2012); https://doi.org/10.1117/12.913639

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available