Fast and lightweight network improves serial brain section stitching

Lianchao Wang; Jiajia Chen; Wei Gong; Ke Si

doi:10.1117/12.3005396

18 December 2023 Fast and lightweight network improves serial brain section stitching

Lianchao Wang, Jiajia Chen, Wei Gong, Ke Si

Proceedings Volume 12963, AOPC 2023: Optical Sensing, Imaging, and Display Technology and Applications; and Biomedical Optics; 129631V (2023) https://doi.org/10.1117/12.3005396
Event: Applied Optics and Photonics China 2023 (AOPC2023), 2023, Beijing, China

Abstract

High-resolution three-dimensional brain image reconstruction is crucial for understanding the brain. Light sheet microscopy combined with tissue clearing imaging plays a pivotal role in analyzing the micro-level structure of mammalian brains. However, the complex multi-level stitching process poses challenges such as non-overlapping areas, surface deformation, and tissue loss, resulting in incomplete or discontinuous tissue structures at the junctions. These issues not only impact the precision of the atlas but also complicate subsequent analyses like cell counting and neuron tracing. To address these issues, we propose a rapid deep learning-based image inpainting approach for accurate neuron reconstruction and analysis. Our approach involves initially employing conventional registration algorithms to preliminarily stitch brain sections together, followed by utilizing a neural network to predict and restore missing tissue with a thickness exceeding 10 µm. This process enhances the structural continuity and integrity between adjacent brain slices. Compared to the original 3D U-Net and ResNet models, our approach performs better and has a processing speed that is five times faster than the original 3D U-Net. Moreover, our method enables more accurate cell counting by repairing incomplete cell bodies, leading to an average improvement of 37.37% in the number of cell bodies accurately counted near the slice junction. By integrating this novel 3D image inpainting network into brain reconstruction processes, our research opens new avenues for a more detailed and accurate investigation of neural circuitry and neurological disorders.

(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Lianchao Wang, Jiajia Chen, Wei Gong, and Ke Si "Fast and lightweight network improves serial brain section stitching", Proc. SPIE 12963, AOPC 2023: Optical Sensing, Imaging, and Display Technology and Applications; and Biomedical Optics, 129631V (18 December 2023); https://doi.org/10.1117/12.3005396

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
9 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Brain

Neuroimaging

3D image processing

Image restoration

Biological imaging

Neurons

Image registration

Show All Keywords

Keywords/Phrases

Search In:

Publication Years