Translator Disclaimer
Paper
24 May 1999 Monte Carlo validation of a multireader method for receiver operating characteristic discrete rating data: split-plot experimental design
Author Affiliations +
Abstract
The major purpose of this paper was to evaluate the Dorfman/Berbaum/Metz (DBM) method for analyzing multireader receiver operating characteristic (ROC) discrete rating data on reader split-plot and case split-plot designs. It is not always appropriate or practical for readers to interpret imaging studies of the same patients in all modalities. In split plot designs, either a different sample of readers is assigned to each modality or a different sample of cases is assigned to each modality. For each type of split-plot design, a series of null-case Monte Carlo simulations were conducted. The results suggest that the DBM method provides trustworthy alpha levels with discrete ratings when ROC area is not too large, and case and reader sample sizes are not too small. In other situations, the test tends to be somewhat conservative. Our Monte Carlo simulations show that the DBM multireader method can be validly extended to the reader-split and case- split plot designs.
© (1999) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Donald D. Dorfman, Kevin S. Berbaum, Russell V. Lenth, and Yeh Fong Chen "Monte Carlo validation of a multireader method for receiver operating characteristic discrete rating data: split-plot experimental design", Proc. SPIE 3663, Medical Imaging 1999: Image Perception and Performance, (24 May 1999); https://doi.org/10.1117/12.349629
PROCEEDINGS
9 PAGES


SHARE
Advertisement
Advertisement
Back to Top