Person:

Berger, Daniel

The automated tape-collecting ultramicrotome (ATUM) makes it possible to collect large numbers of ultrathin sections quickly—the equivalent of a petabyte of high resolution images each day. However, even high throughput image acquisition strategies generate images far more slowly (at present ~1 terabyte per day). We therefore developed WaferMapper, a software package that takes a multi-resolution approach to mapping and imaging select regions within a library of ultrathin sections. This automated method selects and directs imaging of corresponding regions within each section of an ultrathin section library (UTSL) that may contain many thousands of sections. Using WaferMapper, it is possible to map thousands of tissue sections at low resolution and target multiple points of interest for high resolution imaging based on anatomical landmarks. The program can also be used to expand previously imaged regions, acquire data under different imaging conditions, or re-image after additional tissue treatments.

To stimulate progress in automating the reconstruction of neural circuits, we organized the first international challenge on 2D segmentation of electron microscopic (EM) images of the brain. Participants submitted boundary maps predicted for a test set of images, and were scored based on their agreement with a consensus of human expert annotations. The winning team had no prior experience with EM images, and employed a convolutional network. This “deep learning” approach has since become accepted as a standard for segmentation of EM images. The challenge has continued to accept submissions, and the best so far has resulted from cooperation between two teams. The challenge has probably saturated, as algorithms cannot progress beyond limits set by ambiguities inherent in 2D scoring and the size of the test dataset. Retrospective evaluation of the challenge scoring system reveals that it was not sufficiently robust to variations in the widths of neurite borders. We propose a solution to this problem, which should be useful for a future 3D segmentation challenge.

From birth to adulthood, an animal’s nervous system changes as its body grows and its behaviours mature. The form and extent of circuit remodelling across the connectome is unknown. We used serial-section electron microscopy to reconstruct the full brain of eight isogenic C. elegans individuals across postnatal stages to learn how it changes with age. The overall geometry of the nervous system is preserved from birth to adulthood. Upon this constant scaffold, substantial changes in chemical synaptic connectivity emerge. Comparing connectomes among individuals reveals substantial connectivity differences that make each brain partly unique. Comparing connectomes across maturation reveals consistent wiring changes between different neurons. These changes alter the strength of existing connections and create new connections. Collective changes in the network alter information processing. Over development, the central decision-making circuitry is maintained whereas sensory and motor pathways substantially remodel. With age, the brain progressively becomes more feedforward and discernibly modular. Developmental connectomics reveals principles that underlie brain maturation.

Connectomics provides nanometer-resolution, synapse-level maps of neural circuits to understand brain activity and behavior. However, few researchers have access to the high-throughput electron microscopes necessary to generate enough data for whole brain or even whole circuit reconstruction. To date, machine-learning methods have been used after the collection of images by electron microscopy (EM) to accelerate and improve neuronal segmentation, synapse reconstruction and other data analysis. With the computational improvements in processing EM images, acquiring EM images has now become the rate-limiting step in automated connectomics. Here, in order to speed up EM imaging, we integrate machine-learning into real-time image acquisition in a single-beam scanning electron microscope. This SmartEM approach allows an electron microscope to perform intelligent, data-aware imaging of specimens. SmartEM saves time by allocating the proper imaging time for each region of interest – first scanning all pixels rapidly, then rescanning more slowly only the small subareas where a higher quality signal is required. We demonstrate that SmartEM achieves up to a $\sim$7-fold acceleration of image acquisition time for connectomic samples using a commercial single-beam SEM in samples from nematodes, mice and human brain. We apply this fast imaging method to reconstruct a portion of mouse cerebral cortex with an accuracy comparable to traditional electron microscopy.