Determining Roe and Metz model  parameters for simulating multireader multicase confidence-of-disease rating data based on read-data or conjectured Obuchowski-Rockette parameter estimates

Stephen L. Hillis

doi:10.1117/12.2550541

17 March 2020 Determining Roe and Metz model parameters for simulating multireader multicase confidence-of-disease rating data based on read-data or conjectured Obuchowski-Rockette parameter estimates

Stephen L. Hillis

Author Affiliations +

Proceedings Volume 11316, Medical Imaging 2020: Image Perception, Observer Performance, and Technology Assessment; 113160N (2020) https://doi.org/10.1117/12.2550541
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

The most frequently used model for simulating MRMC data that emulate confidence-of-disease ratings from diagnostic imaging studies has been the Roe and Metz model, proposed in 1997. The RM model generates continuous confidence-of-diseases ratings based on an underlying equal-variance binormal model for each reader, with the separation between the normal and abnormal rating distributions varying across readers. A problem with the RM model is that the parameters are expressed in terms of the rating distributions, as opposed to the reader performance outcomes. Because MRMC analysis results are almost always expressed in terms of the reader performance outcomes, and not in terms of the rating data distributions, it has been difficult to assess how similar the simulated data are to MRMC data encountered in practice. To remedy this situation, recently Hillis (in 2018) derived formulas expressing parameters that describe the distribution of empirical AUC outcomes computed from RM simulated data as functions of the RM parameters. An examination of these values revealed several problems with the realism of the simulated data. This paper continues that work by providing the inverse mapping, i.e., by deriving an algorithm that expresses the RM parameters as functions of the AUC empirical distribution parameters. This result will enable the creation of a recalibrated RM model that more closely emulates real-data studies.

Citation Download Citation

Stephen L. Hillis "Determining Roe and Metz model parameters for simulating multireader multicase confidence-of-disease rating data based on read-data or conjectured Obuchowski-Rockette parameter estimates", Proc. SPIE 11316, Medical Imaging 2020: Image Perception, Observer Performance, and Technology Assessment, 113160N (17 March 2020); https://doi.org/10.1117/12.2550541

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
10 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Data modeling

Performance modeling

Error analysis

Computer simulations

Diagnostics

Statistical modeling

Associative arrays

Show All Keywords

Keywords/Phrases

Search In:

Publication Years