Toward content-based image retrieval with deep convolutional neural networks

Judah E. S. Sklan; Andrew J. Plassard; Daniel Fabbri; Bennett A. Landman

doi:10.1117/12.2081551

19 March 2015 Toward content-based image retrieval with deep convolutional neural networks

Judah E. S. Sklan, Andrew J. Plassard, Daniel Fabbri, Bennett A. Landman

Proceedings Volume 9417, Medical Imaging 2015: Biomedical Applications in Molecular, Structural, and Functional Imaging; 94172C (2015) https://doi.org/10.1117/12.2081551
Event: SPIE Medical Imaging, 2015, Orlando, Florida, United States

Abstract

Content-based image retrieval (CBIR) offers the potential to identify similar case histories, understand rare disorders, and eventually, improve patient care. Recent advances in database capacity, algorithm efficiency, and deep Convolutional Neural Networks (dCNN), a machine learning technique, have enabled great CBIR success for general photographic images. Here, we investigate applying the leading ImageNet CBIR technique to clinically acquired medical images captured by the Vanderbilt Medical Center. Briefly, we (1) constructed a dCNN with four hidden layers, reducing dimensionality of an input scaled to 128x128 to an output encoded layer of 4x384, (2) trained the network using back-propagation 1 million random magnetic resonance (MR) and computed tomography (CT) images, (3) labeled an independent set of 2100 images, and (4) evaluated classifiers on the projection of the labeled images into manifold space. Quantitative results were disappointing (averaging a true positive rate of only 20%); however, the data suggest that improvements would be possible with more evenly distributed sampling across labels and potential re-grouping of label structures. This preliminary effort at automated classification of medical images with ImageNet is promising, but shows that more work is needed beyond direct adaptation of existing techniques.

Citation Download Citation

Judah E. S. Sklan, Andrew J. Plassard, Daniel Fabbri, and Bennett A. Landman "Toward content-based image retrieval with deep convolutional neural networks", Proc. SPIE 9417, Medical Imaging 2015: Biomedical Applications in Molecular, Structural, and Functional Imaging, 94172C (19 March 2015); https://doi.org/10.1117/12.2081551

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available