An effective AI integrated system for neuron tracing on anisotropic electron microscopy volume. (August 2021)

• Record Type: Journal Article
• Authors: Liu, Jing; Hong, Bei; Chen, Xi; Xie, Qiwei; Tang, Yuanyan; Han, Hua
• Is Part Of: Biomedical signal processing and control. Volume 69(2021)
• Publication Date: 2021-08
• Subjects: Neuron tracing -- Electron microscopy -- Deep learning -- Convolutional LSTM; Signal processing -- Periodicals; Biomedical engineering -- Periodicals; Signal Processing, Computer-Assisted -- Periodicals; Image Processing, Computer-Assisted -- Periodicals; Biomedical Engineering -- Periodicals; 610.28
• DOI: 10.1016/j.bspc.2021.102829
• Languages: English
• ISSNs: 1746-8094

Abstract

Highlights: Highlight Convolutional LSTMs and 2D convolution are used to estimate the inter- and intraslice features simultaneously. A shift estimation and correction module is proposed to solve the misalignments problem in large-scale data. A novel recursive mode is introduced into the training process, which significantly improve the performance. Abstract: Electron microscopy has become the most important technique in the field of connectomics. Several methods have been proposed in the literature to tackle the problem of dense reconstruction. However, sparse reconstruction, which is a promising technique, has not been extensively studied. As a result, we develop an AI integrated system for sparse reconstruction that can automatically trace neurons with only the initial seeded masks. First, as an important part of the system for interlayer information estimation, convolutional LSTMs are employed to estimate the spatial contexts between adjacent sections. Then, the intra-slice information is obtained by a lightweight U-Net. Moreover, we employ a novel recursive training method that can significantly improve the performance. To reduce the tracing errors caused by misalignments in large-scale data, we integrate a shift estimation and correction module that effectively improves the traced neuron length. To the best of our knowledge, this is the first attempt to apply a recurrent neural network to the task of neuron tracing. In addition, our approach performs better than other state-of-the-art methods on two highly anisotropic datasets.