Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach

Francesca Manni; Chuchen Cai; Fons van der Sommen; Svitlana Zinger; Caifeng Shan; Erik Edström; Adrian Elmi-Terander; Himar Fabelo; Samuel Ortega; Gustavo M. Callicó; Peter H. N. de With

doi:10.1117/12.2580158

Translator Disclaimer

15 February 2021 Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach

Francesca Manni, Chuchen Cai, Fons van der Sommen, Svitlana Zinger, Caifeng Shan, Erik Edström, Adrian Elmi-Terander, Himar Fabelo, Samuel Ortega, Gustavo M. Callicó, Peter H. N. de With

Author Affiliations +

Proceedings Volume 11598, Medical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling; 1159810 (2021) https://doi.org/10.1117/12.2580158
Event: SPIE Medical Imaging, 2021, Online Only

Abstract

Surgery is a crucial treatment for malignant brain tumors where gross total resection improves the prognosis. Tissue samples taken during surgery are either subject to a preliminary intraoperative histological analysis, or sent for a full pathological evaluation which can take days or weeks. Whereas a lengthy complete pathological analysis includes an array of techniques to be executed, a preliminary tissue analysis on frozen tissue is performed as quickly as possible (30-45 minutes on average) to provide fast feedback to the surgeon during the surgery. The surgeon uses the information to confirm that the resected tissue is indeed tumor and may, at least in theory, initiate repeated biopsies to help achieve gross total resection. However, due to the total turn-around time of the tissue inspection for repeated analyses, this approach may not be feasible during a single surgery. In this context, intraoperative image-guided techniques can improve the clinical workflow for tumor resection and improve outcome by aiding in the identification and removal of the malignant lesion. Hyperspectral imaging (HSI) is an optical imaging technique with the potential to extract combined spectral-spatial information. By exploiting HSI for human brain-tissue classification in 13 in-vivo hyperspectral images from 9 patients, a brain-tissue classifier is developed. The framework consists of a hybrid 3D-2D CNN-based approach and a band-selection step to enhance the capability of extracting both spectral and spatial information from the hyperspectral images. An overall accuracy of 77% was found when tumor, normal and hyper-vascularized tissue are classified, which clearly outperforms the state-of-the-art approaches (SVM, 2D-CNN). These results may open an attractive future perspective for intraoperative brain-tumor classification using HSI.

Conference Presentation

Citation Download Citation

Francesca Manni, Chuchen Cai, Fons van der Sommen, Svitlana Zinger, Caifeng Shan, Erik Edström, Adrian Elmi-Terander, Himar Fabelo, Samuel Ortega, Gustavo M. Callicó, and Peter H. N. de With "Hyperspectral imaging for tissue classification in glioblastoma tumor patients: a deep spectral-spatial approach", Proc. SPIE 11598, Medical Imaging 2021: Image-Guided Procedures, Robotic Interventions, and Modeling, 1159810 (15 February 2021); https://doi.org/10.1117/12.2580158

ACCESS THE FULL ARTICLE