Contrastive learning meets transfer learning: a case study in medical image analysis

Yuzhe Lu; Aadarsh Jha; Ruining Deng; Yuankai Huo

doi:10.1117/12.2610990

4 April 2022 Contrastive learning meets transfer learning: a case study in medical image analysis

Yuzhe Lu, Aadarsh Jha, Ruining Deng, Yuankai Huo

Proceedings Volume 12033, Medical Imaging 2022: Computer-Aided Diagnosis; 120332Q (2022) https://doi.org/10.1117/12.2610990
Event: SPIE Medical Imaging, 2022, San Diego, California, United States

Conference Poster

Abstract

Annotated medical images are typically more rare than labeled natural images, since they are limited by domain knowledge and privacy constraints. Recent advances in transfer and contrastive learning have provided effective solutions to tackle such issues from different perspectives. The state-of-the-art transfer learning (e.g., Big Transfer (BiT)) and contrastive learning (e.g., Simple Siamese Contrastive Learning (SimSiam)) approaches have been investigated independently, without considering the complementary nature of such techniques. It would be appealing to accelerate contrastive learning with transfer learning, given that slow convergence speed is a critical limitation of modern contrastive learning approaches. In this paper, we investigate the feasibility of aligning BiT with SimSiam. From empirical analyses, different normalization techniques (Group Norm in BiT vs. Batch Norm in SimSiam) is a key hurdle of adapting BiT to SimSiam. When combining BiT with SimSiam, we evaluated the performance of using BiT, SimSiam, and BiT+SimSiam on CIFAR-10 and HAM10000 datasets. The results suggest that the BiT models accelerate the convergence speed of SimSiam. When used together, the model gives superior performance over both of its counterparts. We hope this study will motivate researchers to revisit the task of aggregating big pretrained models with contrastive learning models for image analysis.

Citation Download Citation

Yuzhe Lu, Aadarsh Jha, Ruining Deng, and Yuankai Huo "Contrastive learning meets transfer learning: a case study in medical image analysis", Proc. SPIE 12033, Medical Imaging 2022: Computer-Aided Diagnosis, 120332Q (4 April 2022); https://doi.org/10.1117/12.2610990

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available