Hyperspectral imaging and deep learning for the detection of breast cancer cells in digitized histological images

Samuel Ortega; Martin Halicek; Himar Fabelo; Raul Guerra; Carlos Lopez; Marylene Lejeune; Fred Godtliebsen; Gustavo M. Callico; Baowei Fei

doi:10.1117/12.2548609

Translator Disclaimer

16 March 2020 Hyperspectral imaging and deep learning for the detection of breast cancer cells in digitized histological images

Samuel Ortega, Martin Halicek, Himar Fabelo, Raul Guerra, Carlos Lopez, Marylene Lejeune, Fred Godtliebsen, Gustavo M. Callico, Baowei Fei

Author Affiliations +

Proceedings Volume 11320, Medical Imaging 2020: Digital Pathology; 113200V (2020) https://doi.org/10.1117/12.2548609
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

In recent years, hyperspectral imaging (HSI) has been shown as a promising imaging modality to assist pathologists in the diagnosis of histological samples. In this work, we present the use of HSI for discriminating between normal and tumor breast cancer cells. Our customized HSI system includes a hyperspectral (HS) push-broom camera, which is attached to a standard microscope, and home-made software system for the control of image acquisition. Our HS microscopic system works in the visible and near-infrared (VNIR) spectral range (400 - 1000 nm). Using this system, 112 HS images were captured from histologic samples of human patients using 20× magnification. Cell-level annotations were made by an expert pathologist in digitized slides and were then registered with the HS images. A deep learning neural network was developed for the HS image classification, which consists of nine 2D convolutional layers. Different experiments were designed to split the data into training, validation and testing sets. In all experiments, the training and the testing set correspond to independent patients. The results show an area under the curve (AUCs) of more than 0.89 for all the experiments. The combination of HSI and deep learning techniques can provide a useful tool to aid pathologists in the automatic detection of cancer cells on digitized pathologic images.

Citation Download Citation

Samuel Ortega, Martin Halicek, Himar Fabelo, Raul Guerra, Carlos Lopez, Marylene Lejeune, Fred Godtliebsen, Gustavo M. Callico, and Baowei Fei "Hyperspectral imaging and deep learning for the detection of breast cancer cells in digitized histological images", Proc. SPIE 11320, Medical Imaging 2020: Digital Pathology, 113200V (16 March 2020); https://doi.org/10.1117/12.2548609

ACCESS THE FULL ARTICLE