Multi-organ segmentation in pelvic CT images with CT-based synthetic MRI

Yang Lei; Xue Dong; Sibo Tian; Tonghe Wang; Pretesh Patel; Walter J. Curran; Ashesh B. Jani; Tian Liu; Xiaofeng Yang

doi:10.1117/12.2548470

28 February 2020 Multi-organ segmentation in pelvic CT images with CT-based synthetic MRI

Yang Lei, Xue Dong, Sibo Tian, Tonghe Wang, Pretesh Patel, Walter J. Curran, Ashesh B. Jani, Tian Liu, Xiaofeng Yang

Author Affiliations +

Proceedings Volume 11317, Medical Imaging 2020: Biomedical Applications in Molecular, Structural, and Functional Imaging; 113171S (2020) https://doi.org/10.1117/12.2548470
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

We propose a hybrid deep learning-based method, which includes a cycle consistent generative adversarial network (CycleGAN) and deep attention fully convolution network implemented by a U-Net (DAUnet), to perform volumetric multi-organ segmentation for pelvic computed tomography (CT). The proposed method first utilized CycleGAN to generate synthetic MRI (sMRI) to provide superior soft tissue contrast. Then, the proposed method fed the sMRI into the DAUnet to obtain the volumetric segmentation of bladder, prostate and rectum, simultaneously, via a multi-channel output. The deep attention strategy was introduced to retrieve the most relevant features to identify organ boundaries. Deep supervision was incorporated into the DAUnet to enhance the features’ discriminative ability. Segmented contours of a patient were obtained by feeding the CT image into the trained CycleGAN to generate sMRI, which was then fed to the trained DAUnet to generate the organ contours. A retrospective studied was performed with data sets from 45 patients with prostate cancer. The Dice similarity coefficient and mean surface distance indices for bladder, prostate, and rectum contours were 0.94, 0.47 mm; 0.86, 0.78 mm; and 0.89, 0.85 mm, respectively. The proposed network provides accurate and consistent prostate, bladder and rectum segmentation without the need of additional MRIs. With further evaluation and clinical implementation, this method has the potential to facilitate routine prostate-cancer radiotherapy treatment planning.

Citation Download Citation

Yang Lei, Xue Dong, Sibo Tian, Tonghe Wang, Pretesh Patel, Walter J. Curran, Ashesh B. Jani, Tian Liu, and Xiaofeng Yang "Multi-organ segmentation in pelvic CT images with CT-based synthetic MRI", Proc. SPIE 11317, Medical Imaging 2020: Biomedical Applications in Molecular, Structural, and Functional Imaging, 113171S (28 February 2020); https://doi.org/10.1117/12.2548470

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
7 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image segmentation

Magnetic resonance imaging

Computed tomography

Prostate

Bladder

Rectum

Feature extraction

Show All Keywords

Keywords/Phrases

Search In:

Publication Years