Clear and deep temporal focusing multiphoton microscopy imaging using deep prediction with PhyCell and ConvLSTM

Hao-Chung Chi; Anupama Nair; Yvonne Yuling Hu; Feng-Chun Hsu; Chia-Wei Hsu; Chun-Yu Lin; Shean-Jen Chen

doi:10.1117/12.2670700

9 August 2023 Clear and deep temporal focusing multiphoton microscopy imaging using deep prediction with PhyCell and ConvLSTM

Hao-Chung Chi, Anupama Nair, Yvonne Yuling Hu, Feng-Chun Hsu, Chia-Wei Hsu, Chun-Yu Lin, Shean-Jen Chen

Author Affiliations +

Proceedings Volume 12630, Advances in Microscopic Imaging IV; 1263003 (2023) https://doi.org/10.1117/12.2670700
Event: European Conferences on Biomedical Optics, 2023, Munich, Germany

Abstract

Temporal focusing multiphoton excitation microscopy (TFMPEM) can rapidly provide 3D imaging in neuroscience; however, due to the widefield illumination and the use of camera detector, the strong scattering of emission photons through biotissue will degrade the image quality and reduce the penetration depth. As a result, TFMPEM images suffers from poor spatial resolution and low signal-to-noise ratio (SNR), burying weak fluorescent signals of small structures such as neurons in calyx part, especially for deep layers under fast acquisition rate. In the study, we present a prediction learning model with depth information to overcome. First, a point-scanning multiphoton excitation microscopy (PSMPEM) image as the gold standard was precisely registered to the corresponding TFMPEM image via a linear affine transformation and an unsupervised VoxelMorph network. Then, a multi-stage 3D U-Net model with cross-stage feature fusion mechanism and self-supervised attention module has been developed to restore shallow layers of drosophila mushroom body under cross-modality training. Furthermore, a convolutional long short-term memory (ConvLSTM)- based network with PhyCell, which is designed to forecast the deeper information according to previous 3D information, is introduced for the prediction of depth information.

Citation Download Citation

Hao-Chung Chi, Anupama Nair, Yvonne Yuling Hu, Feng-Chun Hsu, Chia-Wei Hsu, Chun-Yu Lin, and Shean-Jen Chen "Clear and deep temporal focusing multiphoton microscopy imaging using deep prediction with PhyCell and ConvLSTM", Proc. SPIE 12630, Advances in Microscopic Imaging IV, 1263003 (9 August 2023); https://doi.org/10.1117/12.2670700

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available