3D reconstruction of synapses with deep learning based on EM Images

Chi Xiao; Qiang Rao; Dandan Zhang; Xi Chen; Hua Han; Qiwei Xie

doi:10.1117/12.2254282

9 March 2017 3D reconstruction of synapses with deep learning based on EM Images

Chi Xiao, Qiang Rao, Dandan Zhang, Xi Chen, Hua Han, Qiwei Xie

Proceedings Volume 10132, Medical Imaging 2017: Physics of Medical Imaging; 101324N (2017) https://doi.org/10.1117/12.2254282
Event: SPIE Medical Imaging, 2017, Orlando, Florida, United States

Abstract

Recently, due to the rapid development of electron microscope (EM) with its high resolution, stacks delivered by EM can be used to analyze a variety of components that are critical to understand brain function. Since synaptic study is essential in neurobiology and can be analyzed by EM stacks, the automated routines for reconstruction of synapses based on EM Images can become a very useful tool for analyzing large volumes of brain tissue and providing the ability to understand the mechanism of brain. In this article, we propose a novel automated method to realize 3D reconstruction of synapses for Automated Tapecollecting Ultra Microtome Scanning Electron Microscopy (ATUM-SEM) with deep learning. Being different from other reconstruction algorithms, which employ classifier to segment synaptic clefts directly. We utilize deep learning method and segmentation algorithm to obtain synaptic clefts as well as promote the accuracy of reconstruction. The proposed method contains five parts: (1) using modified Moving Least Square (MLS) deformation algorithm and Scale Invariant Feature Transform (SIFT) features to register adjacent sections, (2) adopting Faster Region Convolutional Neural Networks (Faster R-CNN) algorithm to detect synapses, (3) utilizing screening method which takes context cues of synapses into consideration to reduce the false positive rate, (4) combining a practical morphology algorithm with a suitable fitting function to segment synaptic clefts and optimize the shape of them, (5) applying the plugin in FIJI to show the final 3D visualization of synapses. Experimental results on ATUM-SEM images demonstrate the effectiveness of our proposed method.

Citation Download Citation

Chi Xiao, Qiang Rao, Dandan Zhang, Xi Chen, Hua Han, and Qiwei Xie "3D reconstruction of synapses with deep learning based on EM Images", Proc. SPIE 10132, Medical Imaging 2017: Physics of Medical Imaging, 101324N (9 March 2017); https://doi.org/10.1117/12.2254282

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available