Multi-modality super-resolution loss for GAN-based super-resolution of clinical CT images using micro CT image database

Tong Zheng; Hirohisa Oda; Takayasu Moriya; Takaaki Sugino; Shota Nakamura; Masahiro Oda; Masaki Mori; Hirotsugu Takabatake; Hiroshi Natori; Kensaku Mori

doi:10.1117/12.2548929

10 March 2020 Multi-modality super-resolution loss for GAN-based super-resolution of clinical CT images using micro CT image database

Tong Zheng, Hirohisa Oda, Takayasu Moriya, Takaaki Sugino, Shota Nakamura, Masahiro Oda, Masaki Mori, Hirotsugu Takabatake, Hiroshi Natori, Kensaku Mori

Author Affiliations +

Proceedings Volume 11313, Medical Imaging 2020: Image Processing; 1131305 (2020) https://doi.org/10.1117/12.2548929
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

This paper newly introduces multi-modality loss function for GAN-based super-resolution that can maintain image structure and intensity on unpaired training dataset of clinical CT and micro CT volumes. Precise non- invasive diagnosis of lung cancer mainly utilizes 3D multidetector computed-tomography (CT) data. On the other hand, we can take μCT images of resected lung specimen in 50 μm or higher resolution. However, μCT scanning cannot be applied to living human imaging. For obtaining highly detailed information such as cancer invasion area from pre-operative clinical CT volumes of lung cancer patients, super-resolution (SR) of clinical CT volumes to μCT level might be one of substitutive solutions. While most SR methods require paired low- and high-resolution images for training, it is infeasible to obtain precisely paired clinical CT and μCT volumes. We aim to propose unpaired SR approaches for clincial CT using micro CT images based on unpaired image translation methods such as CycleGAN or UNIT. Since clinical CT and μCT are very different in structure and intensity, direct appliation of GAN-based unpaired image translation methods in super-resolution tends to generate arbitrary images. Aiming to solve this problem, we propose new loss function called multi-modality loss function to maintain the similarity of input images and corresponding output images in super-resolution task. Experimental results demonstrated that the newly proposed loss function made CycleGAN and UNIT to successfully perform SR of clinical CT images of lung cancer patients into μCT level resolution, while original CycleGAN and UNIT failed in super-resolution.

Conference Presentation

Citation Download Citation

Tong Zheng, Hirohisa Oda, Takayasu Moriya, Takaaki Sugino, Shota Nakamura, Masahiro Oda, Masaki Mori, Hirotsugu Takabatake, Hiroshi Natori, and Kensaku Mori "Multi-modality super-resolution loss for GAN-based super-resolution of clinical CT images using micro CT image database", Proc. SPIE 11313, Medical Imaging 2020: Image Processing, 1131305 (10 March 2020); https://doi.org/10.1117/12.2548929

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available