Convolutional nets for reconstructing neural circuits from brain images acquired by serial section electron microscopy

White, 1986, The structure of the nervous system of the nematode Caenorhabditis elegans, Philos Trans R Soc Lond B Biol Sci, 314, 1, 10.1098/rstb.1986.0056 Lee, 2016, Anatomy and function of an excitatory network in the visual cortex, Nature, 532, 370, 10.1038/nature17192 Sobel, 1980, Special techniques for the automatic computer reconstruction of neuronal structures, Annu Rev Biophys Bioeng, 9, 347, 10.1146/annurev.bb.09.060180.002023 Jain, 2007, Supervised learning of image restoration with convolutional networks, The IEEE International Conference on Computer Vision (ICCV), 1 Kornfeld, 2018, Progress and remaining challenges in high-throughput volume electron microscopy, Curr Opin Neurobiol, 50, 261, 10.1016/j.conb.2018.04.030 Denk, 2004, Serial block-face scanning electron microscopy to reconstruct three-dimensional tissue nanostructure, PLoS Biol, 2, 10.1371/journal.pbio.0020329 Xu, 2017, Enhanced FIB-SEM systems for large-volume 3D imaging, eLife, 6, 10.7554/eLife.25916 Knott, 2008, Serial section scanning electron microscopy of adult brain tissue using focused ion beam milling, J Neurosci, 28, 2959, 10.1523/JNEUROSCI.3189-07.2008 Bojarski, 2016, End to end learning for self-driving cars, arXiv preprint Jain, 2010, Machines that learn to segment images: a crucial technology for connectomics, Curr Opin Neurobiol, 20, 653, 10.1016/j.conb.2010.07.004 Helmstaedter, 2013, Connectomic reconstruction of the inner plexiform layer in the mouse retina, Nature, 500, 168, 10.1038/nature12346 Kim, 2014, Space-time wiring specificity supports direction selectivity in the retina, Nature, 509, 331, 10.1038/nature13240 Takemura, 2013, A visual motion detection circuit suggested by Drosophila connectomics, Nature, 500, 175, 10.1038/nature12450 Mishchenko, 2010, Ultrastructural analysis of hippocampal neuropil from the connectomics perspective, Neuron, 67, 1009, 10.1016/j.neuron.2010.08.014 Kasthuri, 2015, Saturated reconstruction of a volume of neocortex, Cell, 162, 648, 10.1016/j.cell.2015.06.054 Kaynig, 2015, Large-scale automatic reconstruction of neuronal processes from electron microscopy images, Med Image Anal, 22, 77, 10.1016/j.media.2015.02.001 Avants, 2011, A reproducible evaluation of ANTs similarity metric performance in brain image registration, NeuroImage, 54, 2033, 10.1016/j.neuroimage.2010.09.025 Saalfeld, 2012, Elastic volume reconstruction from series of ultra-thin microscopy sections, Nat Methods, 9, 717, 10.1038/nmeth.2072 Wetzel, 2016, Registering large volume serial-section electron microscopy image sets for neural circuit reconstruction using FFT signal whitening, 2016 IEEE Applied Imagery Pattern Recognition Workshop (AIPR), 1 Anderson, 2011, Exploring the retinal connectome, Mol Vis, 17, 355 Joesch, 2016, Reconstruction of genetically identified neurons imaged by serial-section electron microscopy, eLife, 5, e15015, 10.7554/eLife.15015 Khairy, 2018, Joint deformable registration of large em image volumes: a matrix solver approach, arXiv preprint Zheng, 2018, A complete electron microscopy volume of the brain of adult Drosophila melanogaster, Cell, 174, 730, 10.1016/j.cell.2018.06.019 Macrina, 2018 Buniatyan, 2017, Deep learning improves template matching by normalized cross correlation, arXiv preprint Yoo, 2017, ssEMnet: serial-section electron microscopy image registration using a spatial transformer network with learned features, 249 Jain, 2017, Adversarial image alignment and interpolation, arXiv preprint Mitchell, 2019, Siamese encoding and alignment by multiscale learning with self-supervision, arXiv preprint Dosovitskiy, 2015, FlowNet: learning optical flow with convolutional networks, The IEEE International Conference on Computer Vision (ICCV), 2758, 10.1109/ICCV.2015.316 Ranjan, 2017, Optical flow estimation using a spatial pyramid network, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2720 Zeng, 2017, DeepEM3D: approaching human-level performance on 3D anisotropic EM image segmentation, BMC Bioinformatics, 33, 2555, 10.1093/bioinformatics/btx188 Beier, 2017, Multicut brings automated neurite segmentation closer to human performance, Nat Methods, 14, 101, 10.1038/nmeth.4151 Lee, 2017, Superhuman accuracy on the SNEMI3D connectomics challenge, arXiv preprint Funke, 2018, Large scale image segmentation with structured loss based deep learning for connectome reconstruction, IEEE Trans Pattern Anal Mach Intell Ronneberger, 2015, U-Net: convolutional networks for biomedical image segmentation, 234 Çiçek, 2016, 3D U-Net: learning dense volumetric segmentation from sparse annotation, 424 Quan, 2016, FusionNet: a deep fully residual convolutional neural network for image segmentation in connectomics, arXiv preprint Fakhry, 2017, Residual deconvolutional networks for brain electron microscopy image segmentation, IEEE Trans Med Imaging, 36, 447, 10.1109/TMI.2016.2613019 Knowles-Barley, 2016, RhoanaNet pipeline: dense automatic neural annotation, arXiv preprint Meirovitch, 2016, A multi-pass approach to large-scale connectomics, arXiv preprint Turaga, 2010, Convolutional networks can learn to generate affinity graphs for image segmentation, Neural Comput, 22, 511, 10.1162/neco.2009.10-08-881 Parag, 2017, Anisotropic EM segmentation by 3D affinity learning and agglomeration, arXiv preprint Turaga, 2009, Maximin affinity learning of image segmentation, 22, 1865 Tobin, 2017, Wiring variations that enable and constrain neural computation in a sensory microcircuit, eLife, 6, 10.7554/eLife.24838 Januszewski, 2018, High-precision automated reconstruction of neurons with flood-filling networks, Nat Methods, 15, 605, 10.1038/s41592-018-0049-4 Zlateski, 2015, Image segmentation by size-dependent single linkage clustering of a watershed basin graph, arXiv preprint Wolf, 2017, Learned watershed: end-to-end learning of seeded segmentation, The IEEE International Conference on Computer Vision (ICCV), 10.1109/ICCV.2017.222 Arbelaez, 2011, Contour detection and hierarchical image segmentation, IEEE Trans Pattern Anal Mach Intell, 33, 898, 10.1109/TPAMI.2010.161 Jain, 2011, Learning to Agglomerate Superpixel Hierarchies, 648 Bogovic, 2014, Learned versus hand-designed feature representations for 3d agglomeration, International Conference on Learning Representations (ICLR) Nunez-Iglesias, 2013, Machine Learning of Hierarchical Clustering to Segment 2D and 3D Images, PLoS One, 8, e71715, 10.1371/journal.pone.0071715 Nunez-Iglesias, 2014, Graph-based active learning of agglomeration (GALA): a python library to segment 2D and 3D neuroimages, Front Neuroinformatics, 8, 34, 10.3389/fninf.2014.00034 Maitin-Shepard, 2016, Combinatorial Energy Learning for Image Segmentation, 1966 Haehn, 2018, Guided proofreading of automatic segmentations for connectomics, The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Rolnick, 2017, Morphological error detection in 3d segmentations, arXiv preprint Dmitriev, 2018, Efficient correction for EM connectomics with skeletal representation, British Machine Vision Conference (BMVC) Zung, 2017, An error detection and correction framework for connectomics, 6818 Dorkenwald, 2017, Automated synaptic connectivity inference for volume electron microscopy, Nat Methods, 14, 435, 10.1038/nmeth.4206 Kreshuk, 2011, Automated segmentation of synapses in 3D EM data, The IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 220 Becker, 2013, Learning context cues for synapse segmentation, IEEE Trans Med Imaging, 32, 1864, 10.1109/TMI.2013.2267747 Kreshuk, 2014, Automated detection of synapses in serial section transmission electron microscopy image stacks, PLoS One, 9, 10.1371/journal.pone.0087351 Jagadeesh, 2014, Synapse classification and localization in electron micrographs, Pattern Recognit Lett, 43, 17, 10.1016/j.patrec.2013.06.001 Márquez Neila, 2016, A fast method for the segmentation of synaptic junctions and mitochondria in serial electron microscopic images of the brain, Neuroinformatics, 14, 235, 10.1007/s12021-015-9288-z Roncal, 2015, Volumetric exploitation of synaptic information using context localization and evaluation, British Machine Vision Conference (BMVC) Huang, 2014, Identifying synapses using deep and wide multiscale recursive networks, arXiv preprint Huang, 2018, Fully-automatic synapse prediction and validation on a large data set, Front Neural Circuits, 12, 87, 10.3389/fncir.2018.00087 Santurkar, 2017, Toward streaming synapse detection with compositional ConvNets, ArXiv Prepr Heinrich, 2018, Synaptic cleft segmentation in non-isotropic volume electron microscopy of the complete Drosophila brain, 317 Buhmann, 2018, Synaptic partner prediction from point annotations in insect brains, 309 Parag, 2018, Detecting synapse location and connectivity by signed proximity estimation and pruning with deep nets, European Conference on Computer Vision Workshop (ECCVW) Turner, 2019, Synaptic partner assignment using attentional voxel association networks, arXiv preprint Staffler, 2017, SynEM, automated synapse detection for connectomics, eLife, 6, 10.7554/eLife.26414 Katz, 2019, DVID: distributed versioned image-oriented dataservice, Front Neural Circuits, 13, 5, 10.3389/fncir.2019.00005 Plaza, 2018 Kleissas, 2017, The Block Object Storage Service (bossDB): a cloud-native approach for petascale neuroscience discovery, bioRxiv Burns, 2013, The open connectome project data cluster: scalable analysis and vision for high-throughput neuroscience, Sci Stat Database Manag Silversmith, 2018 Wu, 2018 Wu, 2019, Chunkflow: distributed hybrid cloud processing of large 3D images by convolutional nets, arXiv preprint Silversmith, 2018 Wong, 2018 Takemura, 2015, Synaptic circuits and their variations within different columns in the visual system of Drosophila, Proc Natl Acad Sci U S A, 112, 13711, 10.1073/pnas.1509820112 Fathi, 2017, Semantic instance segmentation via deep metric learning, arXiv preprint Brabandere, 2017, Semantic instance segmentation with a discriminative loss function, arXiv preprint Luther, 2019, Learning metric graphs for neuron segmentation in electron microscopy images, ArXiv Prepr Eberle, 2015, High-resolution, high-throughput imaging with a multibeam scanning electron microscope, J Microsc, 259, 114, 10.1111/jmi.12224 Hayworth, 2019, GCIB-SEM: A path to 10 nm isotropic imaging of cubic millimeter volumes, bioRxiv