Presentation + Paper
3 April 2023 Analysis of a pilot study collecting pathologist annotations for validating machine learning algorithms
Author Affiliations +
Abstract
Purpose: We describe registration accuracy studies of a custom hardware-software system called eeDAP that registers fields of view (FOVs) of a glass slide on a microscope to the digital presentations of regions of interest (ROIs) of whole slide images (WSI) of the same glass slide. In this manuscript, we describe the results of adding new hardware and use the results to size a larger pathologist data collection study.
Methods: We create a registration accuracy task by identifying a visually distinct target. This target will be the center of a WSI ROI and is expected to appear in the center of the microscope FOV. We examined the registration accuracy of 60 ROIs from six slides, alternating registration methods and slide order within each study. We measure the distance between the target and the FOV center (registration error) using an eye piece reticle ruler as the stage moves from target to target. We summarize each error as a success (≤ 5.0 µm) or failure (> 5.0 µm). We completed a multi-reader multicase (MRMC) analysis of the registration successes and failures to estimate the variance components due to the readers and the cases.
Results: When using eeDAP in-focus, accuracy was within 5 µm in more than 97% of the FOVs.
Conclusions: The eeDAP registration methods were robust to new hardware, and the MRMC analysis has provided variance components for sizing future registration accuracy studies to account for the variability from readers and cases.
Conference Presentation
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Katherine Elfer, Victor Garcia, and Brandon D. Gallas "Analysis of a pilot study collecting pathologist annotations for validating machine learning algorithms", Proc. SPIE 12467, Medical Imaging 2023: Image Perception, Observer Performance, and Technology Assessment, 124670Q (3 April 2023); https://doi.org/10.1117/12.2654388
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image registration

Microscopes

Glasses

Reticles

Time metrology

Cameras

Motion analysis

Back to Top