Analysis of components of variance in multiple-reader studies of computer-aided diagnosis with different tasks

Sergey V. Beiden; Robert F. Wagner; Gregory Campbell; Charles E. Metz; Heang-Ping Chan; Robert M. Nishikawa; Mitchell D. Schnall; Yulei Jiang

doi:10.1117/12.431185

26 June 2001 Analysis of components of variance in multiple-reader studies of computer-aided diagnosis with different tasks

Sergey V. Beiden, Robert F. Wagner, Gregory Campbell, Charles E. Metz, Heang-Ping Chan, Robert M. Nishikawa, Mitchell D. Schnall, Yulei Jiang

Author Affiliations +

Proceedings Volume 4324, Medical Imaging 2001: Image Perception and Performance; (2001) https://doi.org/10.1117/12.431185
Event: Medical Imaging 2001, 2001, San Diego, CA, United States

Abstract

In recent years, the multiple-reader, multiple-case (MRMC) study paradigm has become widespread for receiver operating characteristic (ROC) assessment of systems for diagnostic imaging and computer-aided diagnosis. We review how MRMC data can be analyzed in terms of the multiple components of the variance (case, reader, interactions) observed in those studies. Such information is useful for the design of pivotal studies from results of a pilot study and also for studying the effects of reader training. Recently, several of the present authors have demonstrated methods to generalize the analysis of multiple variance components to the case where unaided readers of diagnostic images are compared with readers who receive the benefit of a computer assist (CAD). For this case it is necessary to model the possibility that several of the components of variance might be reduced when readers incorporate the computer assist, compared to the unaided reading condition. We review results of this kind of analysis on three previously published MRMC studies, two of which were applications of CAD to diagnostic mammography and one was an application of CAD to screening mammography. The results for the three cases are seen to differ, depending on the reader population sampled and the task of interest. Thus, it is not possible to generalize a particular analysis of variance components beyond the tasks and populations actually investigated.

Citation Download Citation

Sergey V. Beiden, Robert F. Wagner, Gregory Campbell, Charles E. Metz, Heang-Ping Chan, Robert M. Nishikawa, Mitchell D. Schnall, and Yulei Jiang "Analysis of components of variance in multiple-reader studies of computer-aided diagnosis with different tasks", Proc. SPIE 4324, Medical Imaging 2001: Image Perception and Performance, (26 June 2001); https://doi.org/10.1117/12.431185

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available