A fluorescence-microscopy method for tracing neuronal connections in the brain could make connectomics studies more widely accessible for neuroscientists.

High-throughput 2D and 3D scanning electron microscopy, which relies on automation and dependable control algorithms, requires high image quality with minimal human intervention. Classical focus and astigmatism correction algorithms attempt to explicitly model image formation and subsequently aberration correction. Such models often require parameter adjustments by experts when deployed to new microscopes, challenging samples, or imaging conditions to prevent unstable convergence, making them hard to use in practice or unreliable. Here, we introduce DeepFocus, a purely data-driven method for aberration correction in scanning electron microscopy. DeepFocus works under very low signal-to-noise ratio conditions, reduces processing times by more than an order of magnitude compared to the state-of-the-art method, rapidly converges within a large aberration range, and is easily recalibrated to different microscopes or challenging samples.

While genetically encoded reporters are common for fluorescence microscopy, equivalent multiplexable gene reporters for electron microscopy (EM) are still scarce. Here, by installing a variable number of fixation-stable metal-interacting moieties in the lumen of encapsulin nanocompartments of different sizes, we developed a suite of spherically symmetric and concentric barcodes (EMcapsulins) that are readable by standard EM techniques. Six classes of EMcapsulins could be automatically segmented and differentiated. The coding capacity was further increased by arranging several EMcapsulins into distinct patterns via a set of rigid spacers of variable length. Fluorescent EMcapsulins were expressed to monitor subcellular structures in light and EM. Neuronal expression in Drosophila and mouse brains enabled the automatic identification of genetically defined cells in EM. EMcapsulins are compatible with transmission EM, scanning EM and focused ion beam scanning EM. The expandable palette of genetically controlled EM-readable barcodes can augment anatomical EM images with multiplexed gene expression maps.

Electron microscopy is the primary approach to study ultrastructural features of the cerebrovasculature. However, 2D snapshots of a vascular bed capture only a small fraction of its complexity. Recent efforts to synaptically map neuronal circuitry using volume electron microscopy have also sampled the brain microvasculature in 3D. Here, we perform a meta-analysis of 7 data sets spanning different species and brain regions, including two data sets from the MICrONS consortium that have made efforts to segment vasculature in addition to all parenchymal cell types in mouse visual cortex. Exploration of these data have revealed rich information for detailed investigation of the cerebrovasculature. Neurovascular unit cell types (including, but not limited to, endothelial cells, mural cells, perivascular fibroblasts, microglia, and astrocytes) could be discerned across broad microvascular zones. Image contrast was sufficient to identify subcellular details, including endothelial junctions, caveolae, peg-and-socket interactions, mitochondria, Golgi cisternae, microvilli and other cellular protrusions of potential significance to vascular signaling. Additionally, non-cellular structures including the basement membrane and perivascular spaces were visible and could be traced between arterio-venous zones along the vascular wall. These explorations revealed structural features that may be important for vascular functions, such as blood-brain barrier integrity, blood flow control, brain clearance, and bioenergetics. They also identified limitations where accuracy and consistency of segmentation could be further honed by future efforts. The purpose of this article is to introduce these valuable community resources within the framework of cerebrovascular research. We do so by providing an assessment of their vascular contents, identifying features of significance for further study, and discussing next step ideas for refining vascular segmentation and analysis.

The ability to acquire ever larger datasets of brain tissue using volume electron microscopy leads to an increasing demand for the automated extraction of connectomic information. We introduce SyConn2, an open-source connectome analysis toolkit, which works with both on-site high-performance compute environments and rentable cloud computing clusters. SyConn2 was tested on connectomic datasets with more than 10 million synapses, provides a web-based visualization interface and makes these data amenable to complex anatomical and neuronal connectivity queries.

Dense reconstruction of synaptic connectivity requires high-resolution electron microscopy images of entire brains and tools to efficiently trace neuronal wires across the volume. To generate such a resource, we sectioned and imaged a larval zebrafish brain by serial block-face electron microscopy at a voxel size of 14 × 14 × 25 nm3. We segmented the resulting dataset with the flood-filling network algorithm, automated the detection of chemical synapses and validated the results by comparisons to transmission electron microscopic images and light-microscopic reconstructions. Neurons and their connections are stored in the form of a queryable and expandable digital address book. We reconstructed a network of 208 neurons involved in visual motion processing, most of them located in the pretectum, which had been functionally characterized in the same specimen by two-photon calcium imaging. Moreover, we mapped all 407 presynaptic and postsynaptic partners of two superficial interneurons in the tectum. The resource developed here serves as a foundation for synaptic-resolution circuit analyses in the zebrafish nervous system.

Sequential activation of neurons has been observed during various behavioral and cognitive processes, but the underlying circuit mechanisms remain poorly understood. Here, we investigate premotor sequences in HVC (proper name) of the adult zebra finch forebrain that are central to the performance of the temporally precise courtship song. We use high-density silicon probes to measure song-related population activity, and we compare these observations with predictions from a range of network models. Our results support a circuit architecture in which heterogeneous delays between sequentially active neurons shape the spatiotemporal patterns of HVC premotor neuron activity. We gauge the impact of several delay sources, and we find the primary contributor to be slow conduction through axonal collaterals within HVC, which typically adds between 1 and 7.5 ms for each link within the sequence. Thus, local axonal “delay lines” can play an important role in determining the dynamical repertoire of neural circuits.

Reconstruction and annotation of volume electron microscopy data sets of brain tissue is challenging but can reveal invaluable information about neuronal circuits. Significant progress has recently been made in automated neuron reconstruction as well as automated detection of synapses. However, methods for automating the morphological analysis of nanometer-resolution reconstructions are less established, despite the diversity of possible applications. Here, we introduce cellular morphology neural networks (CMNs), based on multi-view projections sampled from automatically reconstructed cellular fragments of arbitrary size and shape. Using unsupervised training, we infer morphology embeddings (Neuron2vec) of neuron reconstructions and train CMNs to identify glia cells in a supervised classification paradigm, which are then used to resolve neuron reconstruction errors. Finally, we demonstrate that CMNs can be used to identify subcellular compartments and the cell types of neuron reconstructions.

Reconstruction of neural circuits from volume electron microscopy data requires the tracing of cells in their entirety, including all their neurites. Automated approaches have been developed for tracing, but their error rates are too high to generate reliable circuit diagrams without extensive human proofreading. We present flood-filling networks, a method for automated segmentation that, similar to most previous efforts, uses convolutional neural networks, but contains in addition a recurrent pathway that allows the iterative optimization and extension of individual neuronal processes. We used flood-filling networks to trace neurons in a dataset obtained by serial block-face electron microscopy of a zebra finch brain. Using our method, we achieved a mean error-free neurite path length of 1.1 mm, and we observed only four mergers in a test set with a path length of 97 mm. The performance of flood-filling networks was an order of magnitude better than that of previous approaches applied to this dataset, although with substantially increased computational costs.

Recent advances in the effectiveness of the automatic extraction of neural circuits from volume electron microscopy data have made us more optimistic that the goal of reconstructing the nervous system of an entire adult mammal (or bird) brain can be achieved in the next decade. The progress on the data analysis side — based mostly on variants of convolutional neural networks — has been particularly impressive, but improvements in the quality and spatial extent of published VEM datasets are substantial. Methodologically, the combination of hot-knife sample partitioning and ion milling stands out as a conceptual advance while the multi-beam scanning electron microscope promises to remove the data-acquisition bottleneck.

Spinal interneurons coordinate the activity of motoneurons to generate the spatiotemporal patterns of muscle contractions required for vertebrate locomotion. It is controversial to what degree the orderly, gradual recruitment of motoneurons is determined by biophysical differences among them rather than by specific connections from presynaptic interneurons to subsets of motoneurons. To answer this question, we mapped all connections from two types of interneurons onto all motoneurons in a larval zebrafish spinal cord hemisegment, using serial block-face electron microscopy (SBEM). We found specific synaptic connectivity from dorsal but not from ventral excitatory ipsilateral interneurons, with large motoneurons, active only when strong force is required, receiving specific inputs from dorsally located interneurons, active only during fast swims. By contrast, the connectivity between inhibitory commissural interneurons and motoneurons lacks any discernible pattern. The wiring pattern is consistent with a recruitment mechanism that depends to a considerable extent on specific connectivity.

Teravoxel volume electron microscopy data sets from neural tissue can now be acquired in weeks, but data analysis requires years of manual labor. We developed the SyConn framework, which uses deep convolutional neural networks and random forest classifiers to infer a richly annotated synaptic connectivity matrix from manual neurite skeleton reconstructions by automatically identifying mitochondria, synapses and their types, axons, dendrites, spines, myelin, somata and cell types. We tested our approach on serial block-face electron microscopy data sets from zebrafish, mouse and zebra finch, and computed the synaptic wiring of songbird basal ganglia. We found that, for example, basal-ganglia cell types with high firing rates in vivo had higher densities of mitochondria and vesicles and that synapse sizes and quantities scaled systematically, depending on the innervated postsynaptic cell types.

The sequential activation of neurons has been observed in various areas of the brain, but in no case is the underlying network structure well understood. Here we examined the circuit anatomy of zebra finch HVC, a cortical region that generates sequences underlying the temporal progression of the song. We combined serial block-face electron microscopy with light microscopy to determine the cell types targeted by HVC(RA) neurons, which control song timing. Close to their soma, axons almost exclusively targeted inhibitory interneurons, consistent with what had been found with electrical recordings from pairs of cells. Conversely, far from the soma the targets were mostly other excitatory neurons, about half of these being other HVC(RA) cells. Both observations are consistent with the notion that the neural sequences that pace the song are generated by global synaptic chains in HVC embedded within local inhibitory networks.

Learning by imitation is fundamental to both communication and social behavior and requires the conversion of complex, nonlinear sensory codes for perception into similarly complex motor codes for generating action. To understand the neural substrates underlying this conversion, we study sensorimotor transformations in songbird cortical output neurons of a basal-ganglia pathway involved in song learning. Despite the complexity of sensory and motor codes, we find a simple, temporally specific, causal correspondence between them. Sensory neural responses to song playback mirror motor-related activity recorded during singing, with a temporal offset of roughly 40 ms, in agreement with short feedback loop delays estimated using electrical and auditory stimulation. Such matching of mirroring offsets and loop delays is consistent with a recent Hebbian theory of motor learning and suggests that cortico-basal ganglia pathways could support motor control via causal inverse models that can invert the rich correspondence between motor exploration and sensory feedback.

Computer simulation using long molecular dynamics (MD) can be used to simulate the folding equilibria of peptides and small proteins. However, a systematic investigation of the influence of the side-chain composition and position at the backbone on the folding equilibrium is computationally as well as experimentally too expensive because of the exponentially growing number of possible side-chain compositions and combinations along the peptide chain. Here, we show that application of the one-step perturbation technique may solve this problem, at least computationally; that is, one can predict many folding equilibria of a polypeptide with different side-chain substitutions from just one single MD simulation using an unphysical reference state. The methodology reduces the number of required separate simulations by an order of magnitude.