Attention-guided classification of abnormalities in semi-structured computed tomography reports

Khrystyna Faryna; Fakrul I. Tushar; Vincent M. D'Anniballe; Rui Hou; Geoffrey D. Rubin; Joseph Y. Lo

doi:10.1117/12.2551370

16 March 2020 Attention-guided classification of abnormalities in semi-structured computed tomography reports

Khrystyna Faryna, Fakrul I. Tushar, Vincent M. D'Anniballe, Rui Hou, Geoffrey D. Rubin, Joseph Y. Lo

Proceedings Volume 11314, Medical Imaging 2020: Computer-Aided Diagnosis; 113141P (2020) https://doi.org/10.1117/12.2551370
Event: SPIE Medical Imaging, 2020, Houston, Texas, United States

Abstract

Lack of annotated data is a major challenge to machine learning algorithms, particularly in the field of radiology. Algorithms that can efficiently extract labels in a fast and precise manner are in high demand. Weak supervision is a compromise solution, particularly, when dealing with imaging modalities like Computed Tomography (CT), where the number of slices can reach 1000 per case. Radiology reports store crucial information about clinicians’ findings and observations in CT slices. Automatic generation of labels from CT reports is not a trivial task due to the complexity of sentences and diversity of expression in free-text narration. In this study, we focus on abnormality classification in lungs, liver and kidneys. Firstly, a rule-based model is used to extract weak labels at the case level. Afterwards, attention guided recurrent neural network (RNN) is trained to perform binary classification of radiology reports in terms of whether the organ is normal or abnormal. Additionally, a multi-label RNN with attention mechanism is trained to perform binary classification by aggregating its output for four representative diseases (lungs: emphysema, mass-nodule, effusion and atelectasis-pneumonia; liver: dilatation, fatty infiltration-steatosis, calcification-stone-gallstone, lesion-mass; kidneys: atrophy, cyst, stone-calculi, lesion) into a single abnormal class. Performance has been evaluated using the receiver operating characteristic (ROC) area under the curve (AUC) on 274, 306 and 278 reports for lungs, liver and kidneys correspondingly, manually annotated by radiology experts. The change in performance was evaluated for different sizes of training dataset for lungs. The AUCs of multi-label pretrained models: lungs - 0.929, liver - 0.840, kidney - 0.844; multi-label models: lungs - 0.903, liver - 0.848, kidney - 0.906; binary pretrained models: lungs - 0.922, liver - 0.826, kidneys - 0.928.

Conference Presentation

Citation Download Citation

Khrystyna Faryna, Fakrul I. Tushar, Vincent M. D'Anniballe, Rui Hou, Geoffrey D. Rubin, and Joseph Y. Lo "Attention-guided classification of abnormalities in semi-structured computed tomography reports", Proc. SPIE 11314, Medical Imaging 2020: Computer-Aided Diagnosis, 113141P (16 March 2020); https://doi.org/10.1117/12.2551370

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available