Drug response prediction using deep neural network trained by adaptive resampling of histopathological images

Tomoharu Kiyuna; Noriko Motoi; Hiroshi Yoshida; Hidehito Horinouchi; Tatsuya Yoshida; Takashi Kohno; Shun-ichi Watanabe; Yuichiro Ohe; Atsushi Ochiai

doi:10.1117/12.2611726

4 April 2022 Drug response prediction using deep neural network trained by adaptive resampling of histopathological images

Tomoharu Kiyuna, Noriko Motoi, Hiroshi Yoshida, Hidehito Horinouchi, Tatsuya Yoshida, Takashi Kohno, Shun-ichi Watanabe, Yuichiro Ohe, Atsushi Ochiai

Author Affiliations +

Proceedings Volume 12033, Medical Imaging 2022: Computer-Aided Diagnosis; 120332W (2022) https://doi.org/10.1117/12.2611726
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Conference Poster

Abstract

Recent advances in programmed death-1 (PD-1) and programmed death-ligand 1 (PD-L1) immune checkpoint inhibitor (ICI) revolutionized the clinical practice in lung cancer treatment. The PD-L1 immunohistochemistry (IHC) test is a widely used biomarker for ICI responder in lung cancer. However, the accuracy of PD-L1 IHC test for selecting ICI responder is unsatisfactory, especially due to its low specificity. Therefore, methods which could effectively predict the efficacy of ICI are crucial for patient selection. In this article, we apply a deep neural network (DNN) to predict responders for anti-PD1 blockade on the basis of histopathological images of hematoxylin and eosin (H&E) stained tissue. The main difficulty to train DNN for responder prediction is the inability to accurately label at the image patch level. We employed a semi-supervised multi-instance learning (MIL) framework with adaptive positive patch selection in each region-of-interest (ROI). Using a dataset of 250 whole slide images (WSIs) of non-small cell lung cancer (111 responders and 139 nonresponders), we train a DNN-based MIL classifier on a case-level partition of the dataset (150 WSIs) and obtain an area under curve (AUC) of 0.773 for the test dataset (50 WSIs), which outperforms the PD-L1 IHC test (AUC=0.636). These results suggest that a DNN model can be used for assisting clinicians to make decision for treatment plan. We also confirm that the locations of adaptively selected positive patches can give valuable insights into the histological features associated with drug response.

Citation Download Citation

Tomoharu Kiyuna, Noriko Motoi, Hiroshi Yoshida, Hidehito Horinouchi, Tatsuya Yoshida, Takashi Kohno, Shun-ichi Watanabe, Yuichiro Ohe, and Atsushi Ochiai "Drug response prediction using deep neural network trained by adaptive resampling of histopathological images", Proc. SPIE 12033, Medical Imaging 2022: Computer-Aided Diagnosis, 120332W (4 April 2022); https://doi.org/10.1117/12.2611726

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available