High-resolution histopathological images have rich characteristics of cancer tissues and cells. Recent studies have shown that digital pathology analysis can aid clinical decision-making by identifying metastases, subtyping and grading tumors, and predicting clinical outcomes. Still, the analysis of digital histologic images remains challenging due to the imbalance of the training data, the intrinsic complexity of histology characteristics of tumor tissue, and the extremely heavy computation burden for processing extremely high-resolution whole slide imaging (WSI) images. In this study, we developed a new deep learning-based classification framework that addresses these unique challenges to support clinical decision-making. The proposed method is motivated by our recently developed adversarial learning strategy with two major innovations. First, an image pre-processing module was designed to process the high-resolution histology images to reduce computational burden and keep informative features, alleviating the risk of overfitting issues when training the network. Second, recently developed StyleGAN2 with powerful generative capability was employed to recognize complex texture patterns and stain information in histology images and learn deep classification-relevant information, further improving the classification and reconstruction performance of our method. The experimental results on three different histology image datasets for different classification tasks demonstrated superior classification performance compared to traditional deep learning-based methods, and the generality of the proposed method to be applied to various applications.
The COVID-19 pandemic continues spreading rapidly around the world and has caused devastating outcomes towards the health of the global population. The reverse transcription-polymerase chain reaction (RT-PCR) test, as the only current gold standard for screening infected cases, yields a relatively high false positive rate and low sensitivity on asymptomatic subjects. The use of chest X-ray radiography (CXR) images coupled with deep- learning (DL) methods for image classification, represents an attractive adjunct to or replacement for RT-PCR testing. However, its usage has been widely debated over the past few months and its potential effectiveness remains unclear. A number of DL-based methods have been proposed to classify the COVID-19 cases from the normal ones, achieving satisfying high performance. However, these methods show limited performance on the multi-class classification task for COVID-19, pneumonia and normal cases, mainly due to two factors: 1) the textures in COVID-19 CXR images are extremely similar to that of pneumonia cases, and 2) there are much fewer COVID-19 cases compared to the other two classes in the public domain. To address these challenges, a novel framework is proposed to learn a deep convolutional neural network (DCNN) model for accurately classifying COVID-19 and pneumonia cases from other normal cases by the use of CXR images. In addition to training the model by use of conventional classification loss which measures classification accuracy, the proposed method innovatively employs a reconstruction loss measuring image fidelity and an adversarial loss measuring class distribution fidelity to assist in the training of the main DCNN model to extract more informative features to support multi-class classification. The experiment results on a COVID-19 dataset demonstrate the superior classification performance of the proposed method in terms of accuracy compared to other existing DL-based methods. The experiment on another cancer dataset further implies the potential of applying the proposed methods in other medical imaging applications.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.