Expert identification of visual primitives used by CNNs during mammogram classification

Jimmy Wu; Diondra Peck; Scott Hsieh; Vandana Dialani M.D.; Constance D. Lehman M.D.; Bolei Zhou; Vasilis Syrgkanis; Lester Mackey; Genevieve Patterson

doi:10.1117/12.2293890

27 February 2018 Expert identification of visual primitives used by CNNs during mammogram classification

Jimmy Wu, Diondra Peck, Scott Hsieh, Vandana Dialani M.D., Constance D. Lehman M.D., Bolei Zhou, Vasilis Syrgkanis, Lester Mackey, Genevieve Patterson

Author Affiliations +

Proceedings Volume 10575, Medical Imaging 2018: Computer-Aided Diagnosis; 105752T (2018) https://doi.org/10.1117/12.2293890
Event: SPIE Medical Imaging, 2018, Houston, Texas, United States

Abstract

This work interprets the internal representations of deep neural networks trained for classification of diseased tissue in 2D mammograms. We propose an expert-in-the-loop inter- pretation method to label the behavior of internal units in convolutional neural networks (CNNs). Expert radiologists identify that the visual patterns detected by the units are correlated with meaningful medical phenomena such as mass tissue and calcificated vessels. We demonstrate that several trained CNN models are able to produce explanatory descriptions to support the final classification decisions. We view this as an important first step toward interpreting the internal representations of medical classification CNNs and explaining their predictions.

Citation Download Citation

Jimmy Wu, Diondra Peck, Scott Hsieh, Vandana Dialani M.D., Constance D. Lehman M.D., Bolei Zhou, Vasilis Syrgkanis, Lester Mackey, and Genevieve Patterson "Expert identification of visual primitives used by CNNs during mammogram classification", Proc. SPIE 10575, Medical Imaging 2018: Computer-Aided Diagnosis, 105752T (27 February 2018); https://doi.org/10.1117/12.2293890

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available