A bivariate binormal ROC methodology for comparing new methods to an existing standard for screening applications

Craig K. Abbey; Michael F. Insana; Miguel P. Eckstein; John M. Boone

doi:10.1117/12.711513

20 March 2007 A bivariate binormal ROC methodology for comparing new methods to an existing standard for screening applications

Craig K. Abbey, Michael F. Insana, Miguel P. Eckstein, John M. Boone

Author Affiliations +

Proceedings Volume 6515, Medical Imaging 2007: Image Perception, Observer Performance, and Technology Assessment; 651505 (2007) https://doi.org/10.1117/12.711513
Event: Medical Imaging, 2007, San Diego, CA, United States

Abstract

Validating the use of new imaging technologies for screening large patient populations is an important and very challenging area of diagnostic imaging research. A particular concern in ROC studies evaluating screening technologies is the problem of verification bias, in which an independent verification of disease status is only available for a subpopulation of patients, typically those with positive results by a current screening standard. For example, in screening mammography, a study might evaluate a new approach using a sample of patients that have undergone needle biopsy following a standard mammogram and subsequent work-up. This case sampling approach provides accurate independent verification of ground truth and increases the prevalence of disease cases. However, the selection criteria will likely bias results of the study. In this work we present an initial exploration of an approach to correcting this bias within the parametric framework of binormal assumptions. We posit conditionally bivariate normal distributions on the latent decision variable for both the new methodology as well as the screening standard. In this case, verification bias can be seen as the effect of missing data from an operating point in the screening standard. We examine the magnitude of this bias in the setting of breast cancer screening with mammography, and we derive a maximum likelihood approach to estimating bias corrected ROC curves in this model.

Citation Download Citation

Craig K. Abbey, Michael F. Insana, Miguel P. Eckstein, and John M. Boone "A bivariate binormal ROC methodology for comparing new methods to an existing standard for screening applications", Proc. SPIE 6515, Medical Imaging 2007: Image Perception, Observer Performance, and Technology Assessment, 651505 (20 March 2007); https://doi.org/10.1117/12.711513

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available