Search bioRxiv⌕ Search

Biology subjects

Wester, B.

Publications and source records attributed to Wester, B..

17 recordsLinked to original sources

Connectome quality converges predictably to reveal optimal stopping points during proofreading

Volumetric electron microscopy (EM) has become a critical approach to generating high-resolution reconstructions of brain tissue. As the size of EM volumes increase, use of automated image segmentation within the reconstruction pipeline has become essential, although it generates errors that need correction. The proofreading and correcting of these errors has since become the dominant cost driver in the pipeline, but precisely estimating the sufficient number of proofreading edits to enable meaningful scientific analyses of the reconstructed neuronal networks remains a challenge. We present a fast, computationally inexpensive way to estimate the progress of a connectomic proofreading effort without requiring a priori knowledge of ground truth. We show that simple global graph invariants converge predictably to asymptotic limits with increasing numbers of proofreading edits, informing a quantitative "pencils down" criterion for proofreading completeness. We illustrate our method on two datasets in different stages of proofreading progress, a zebrafish spinal cord and the hemibrain Drosophila melanogaster dataset. Our method reduces the uncertainty associated with the planning and prioritization of proofreading activities and enables data owners to accurately predict and budget the amount of proofreading necessary for their scientific questions.

neuroscience↗

Physical contact reveals a hidden layer of cortical architecture

Neurons interact at synapses, but they also communicate through physical contact and proximity, including diffusion, glia-mediated interactions, and ephaptic coupling. Standard connectomes map synapses, but cannot capture the full set of cell-cell contacts that can support these pathways. Here we extract contactomes from two large mouse visual cortex volumes at nanoscale resolution and quantify every cell-cell contact, the shared surface area of each contact, and the relationship between contact and synaptic connectivity. We find that contactomes are 5 - 10x denser than synaptic graphs, revealing that neurons physically contact a much larger set of potential neighbors than they synaptically connect to. We further find that most nearby potential neighbors are already in physical contact, indicating that local structural change would add few new candidate synaptic partners. Finally, we find that astrocytes form a single large syncytium-like network that spans the tissue and directly contacts nearly all neurons, and that glial processes lie within a micron or two of almost every synapse, indicating that synapses reside within a pervasive glia-shaped microenvironment. Together, these results show that physical contact forms a distinct layer of brain architecture that extends far beyond the synaptic connectome.

neuroscience↗

Comparative Connectomics Highlights Conserved Architectural Synaptic Motifs in the Drosophila Mushroom Body

While the influence of synaptic plasticity on learning and memory has been extensively studied, the detailed patterns of synaptic connectivity remain incompletely mapped. Convergent synaptic motifs -- a tight grouping of at least two axons whose active zones are within 300nm and which are presynaptic to the same target -- are a common feature of neural circuits in the insect brain and are believed to serve as an important computational primitive in many brain areas. The Mushroom Body (MB) of Drosophila, for instance, is the center of associative learning and memory, where sensory information is conducted by Kenyon cells (KCs), the intrinsic neurons of the MB, and integrated by MB output neurons (MBONs). Indeed, the majority of KC-to-MBON synapses occur in a convergent motif. Nonetheless, the functional role of this convergent motif is not well studied. To gain insight into their potential role in the MB, we combine big-data network neuroscience tools with existing electron microscopy connectome datasets to detect and map the distribution of convergent synaptic motifs. We find that convergent motifs consistently occur across the MB in different individuals, including the -lobe where they were first quantified, and we report on both the variance and consistency in the formation of these motifs across different MB regions and individuals. Our discovery of multiply-convergent motifs -- where two KCs target multiple postsynaptic targets simultaneously -- reveals a previously unrecognized synaptic economy that may optimize information transfer while conserving neural resources. These stereotyped arrangements likely represent fundamental organizational principles underlying associative learning across species. Lastly, to our knowledge, this study offers the first and most extensive comparative analysis of synaptic motifs across Drosophila connectomes, establishing a framework for enabling systematic motif analysis of synapses across species.

neuroscience↗

EM-Compressor: Electron Microscopy Image Compression in Connectomics with Variational Autoencoders

The ongoing pursuit to map detailed brain structures at high resolution using electron microscopy (EM) has led to advancements in imaging that enable the generation of connectomic volumes that have reached the petabyte scale and are soon expected to reach the exascale for whole mouse brain collections. To tackle the high costs of managing these large-scale datasets, we have developed a data compression approach employing Variational Autoencoders (VAEs) to significantly reduce data storage requirements. Due to their ability to capture the complex patterns of EM images, our VAE models notably decrease data size while carefully preserving important image features pertinent to connectomics-based image analysis. Through a comprehensive study using human EM volumes (H01 dataset), we demonstrate how our approach can reduce data to as little as 1/128th of the original size without significantly compromising the ability to subsequently segment the data, outperforming standard data size reduction methods. This performance suggests that this method can greatly alleviate requirements for data management for connectomics applications, and enable more efficient data access and sharing. Additionally, we developed a cloud-based application named EM-Compressor on top of this work to enable on-thefly interactive visualization: https://em-compressor-demonstration.s3.amazonaws.com/EM-Compressor+App.mp4.

neuroscience↗

Generative interpolation and restoration of images using deep learning for improved 3D tissue mapping

The development of novel imaging platforms has improved our ability to collect and analyze large three-dimensional (3D) biological imaging datasets. Advances in computing have led to an ability to extract complex spatial information from these data, such as the composition, morphology, and interactions of multi-cellular structures, rare events, and integration of multi-modal features combining anatomical, molecular, and transcriptomic (among other) information. Yet, the accuracy of these quantitative results is intrinsically limited by the quality of the input images, which can contain missing or damaged regions, or can be of poor resolution due to mechanical, temporal, or financial constraints. In applications ranging from intact imaging (e.g. light-sheet microscopy and magnetic resonance imaging) to sectioning based platforms (e.g. serial histology and serial section transmission electron microscopy), the quality and resolution of imaging data has become paramount. Here, we address these challenges by leveraging frame interpolation for large image motion (FILM), a generative AI model originally developed for temporal interpolation, for spatial interpolation of a range of 3D image types. Comparative analysis demonstrates the superiority of FILM over traditional linear interpolation to produce functional synthetic images, due to its ability to better preserve biological information including microanatomical features and cell counts, as well as image quality, such as contrast, variance, and luminance. FILM repairs tissue damages in images and reduces stitching artifacts. We show that FILM can decrease imaging time by synthesizing skipped images. We demonstrate the versatility of our method with a wide range of imaging modalities (histology, tissue-clearing/light-sheet microscopy, magnetic resonance imaging, serial section transmission electron microscopy), species (human, mouse), healthy and diseased tissues (pancreas, lung, brain), staining techniques (IHC, H&E), and pixel resolutions (8 nm, 2 {micro}m, 1mm). Overall, we demonstrate the potential of generative AI in improving the resolution, throughput, and quality of biological image datasets, enabling improved 3D imaging.

bioinformatics↗

A Novel Semi-automated Proofreading and Mesh Error Detection Pipeline for Neuron Extension

AO_SCPLOWBSTRACTC_SCPLOWThe immense scale and complexity of neuronal electron microscopy (EM) datasets pose significant challenges in data processing, validation, and interpretation, necessitating the development of efficient, automated, and scalable error-detection methodologies. This paper proposes a novel approach that employs mesh processing techniques to identify potential error locations near neuronal tips. Error detection at tips is a particularly important challenge since these errors usually indicate that many synapses are falsely split from their parent neuron, injuring the integrity of the connectomic reconstruction. Additionally, we draw implications and results from an implementation of this error detection in a semi-automated proofreading pipeline. Manual proofreading is a laborious, costly, and currently necessary method for identifying the errors in the machine learning based segmentation of neural tissue. This approach streamlines the process of proofreading by systematically highlighting areas likely to contain inaccuracies and guiding proofreaders towards potential continuations, accelerating the rate at which errors are corrected.

neuroscience↗

Data-driven motif discovery in biological neural networks

AO_SCPLOWBSTRACTC_SCPLOWData from a variety of domains are represented as graphs, including social networks, transportation networks, computer networks, and biological networks. A key question spans these domains: are there meaningful repeated subgraphs, or motifs, within the structure of these larger networks? This is a particularly relevant problem when searching for repeated neural circuits in networks of biological neurons, as the field now regularly produces large brain connectivity maps of neurons and synapses, or connectomes. Given acquisition costs, however, these neuron-synapse connectivity maps are mostly one-of-a-kind. With current graph analysis techniques, it is very challenging to discover new "interesting" subgraphs a priori given small sample sizes of host graphs. Another challenge is that for even relatively modest graph sizes, an exhaustive search of all possible subgraphs is computationally intractable. For these reasons, motif discovery in biological graphs remains an unsolved challenge in the field. In this work, we present a motif discovery approach that can derive a list of undirected or directed motifs, with occurrence counts which are statistically significant compared to randomized graphs, from a single graph example. We first address common pitfalls in the current most common approaches when testing for motif statistical significance, and outline a strategy to ameliorate this problem with improved graph randomization techniques. We then propose a progressive-refinement approach for motif discovery, which addresses issues of computational cost. We demonstrate that our sampling correction technique allows for significance testing of target motifs while highlighting misleading conclusions from standard random graph models. Finally, we share our reference implementation, which is available as an open-source Python package, and demonstrate real-world preliminary results on the C. elegans connectome and the ellipsoid body of the Drosophila melanogaster fruit fly connectome.

neuroscience↗

Vimo: Visual Analysis of Neuronal Connectivity Motifs

Recent advances in high-resolution connectomics provide researchers with access to accurate petascale reconstructions of neuronal circuits and brain networks for the first time. Neuroscientists are analyzing these networks to better understand information processing in the brain. In particular, scientists are interested in identifying specific small network motifs, i.e., repeating subgraphs of the larger brain network that are believed to be neuronal building blocks. Although such motifs are typically small (e.g., 2 - 6 neurons), the vast data sizes and intricate data complexity present significant challenges to the search and analysis process. To analyze these motifs, it is crucial to review instances of a motif in the brain network and then map the graph structure to detailed 3D reconstructions of the involved neurons and synapses. We present Vimo, an interactive visual approach to analyze neuronal motifs and motif chains in large brain networks. Experts can sketch network motifs intuitively in a visual interface and specify structural properties of the involved neurons and synapses to query large connectomics datasets. Motif instances (MIs) can be explored in high-resolution 3D renderings. To simplify the analysis of MIs, we designed a continuous focus&context metaphor inspired by visual abstractions. This allows users to transition from a highly-detailed rendering of the anatomical structure to views that emphasize the underlying motif structure and synaptic connectivity. Furthermore, Vimo supports the identification of motif chains where a motif is used repeatedly (e.g., 2 - 4 times) to form a larger network structure. We evaluate Vimo in a user study and an in-depth case study with seven domain experts on motifs in a large connectome of the fruit fly, including more than 21,000 neurons and 20 million synapses. We find that Vimo enables hypothesis generation and confirmation through fast analysis iterations and connectivity highlighting.

neuroscience↗

Cell lineage predicts neural connectivity beyond cell type

During nervous system development, repeated cell divisions of the zygote give rise to a "family tree" of neurons related by mitotic lineage. The developmental process also gives rise to neuronal connections, and neurons phenotypically converge to different cell types. Neural connections are steered by cell type, but they may be driven in part by lineage: We do not know if lineage matters for the developmental neurogenesis process. We thus asked if mitotic lineage predicts neural connections beyond cell type alone. Using three C. elegans datasets, we fit models for edge prediction tasks: predicting synaptic targets, and predicting synaptic sources. Adding the mitotic lineage improved these predictions. Our results suggest that the family tree matters for the connections made by neurons, and that developmental lineage is a variable that should be considered more deeply in models of connectome assembly.

neuroscience↗

The BRAIN Initiative Cell Census Data Ecosystem: A User's Guide

Characterizing cellular diversity at different levels of biological organization across data modalities is a prerequisite to understanding the function of cell types in the brain. Classification of neurons is also required to manipulate cell types in controlled ways, and to understand their variation and vulnerability in brain disorders. The BRAIN Initiative Cell Census Network (BICCN) is an integrated network of data generating centers, data archives and data standards developers, with the goal of systematic multimodal brain cell type profiling and characterization. Emphasis of the BICCN is on the whole mouse brain and demonstration of prototypes for human and non-human primate (NHP) brains. Here, we provide a guide to the cellular and spatial approaches employed, and to accessing and using the BICCN data and its extensive resources, including the BRAIN Cell Data Center (BCDC) which serves to manage and integrate data across the ecosystem. We illustrate the power of the BICCN data ecosystem through vignettes highlighting several BICCN analysis and visualization tools. Finally, we present emerging standards that have been developed or adopted by the BICCN toward FAIR (Wilkinson et al. 2016a) neuroscience. The combined BICCN ecosystem provides a comprehensive resource for the exploration and analysis of cell types in the brain.

bioinformatics↗

NeuVue: A Framework and Workflows for High-Throughput Electron Microscopy Connectomics Proofreading

Connectomic reconstruction from large image volumes produces segmentation and synaptic-assignment errors that must be resolved to support downstream analyses. As datasets have grown larger and teams more distributed, proofreading has become a critical operational bottleneck. Workflows for proofreading and error correction have not scaled commensurately with connectomic data production and may not accommodate heterogeneous proofreader expertise and machine-generated candidate edits. New tools are therefore needed to organize, prioritize, and coordinate proofreading at volume scale. Here we present NeuVue, a task-management and prioritization framework that operationalizes proofreading through atomic, auditable tasks for individual and team review, multistage routing across proofreader cohorts, performance and volume-state tracking, and integration with community annotation, visualization, and analysis services. We report the use of NeuVue across two volumetric datasets, supporting scalable proofreading by over forty proofreaders and producing over fifty thousand edits. NeuVue provides a reproducible human-in-the-loop framework for generating, validating, and maintaining large connectomic datasets.

neuroscience↗

Scalable graph analysis tools for the connectomics community

Neuroscientists now have the opportunity to analyze synaptic resolution connectomes that are larger than the memory on single consumer workstations. As dataset size and tissue diversity have grown, there is increasing interest in conducting comparative connectomics research, including rapidly querying and searching for recurring patterns of connectivity across brain regions and species. There is also a demand for algorithm reuse -- applying methods developed for one dataset to another volume. A key technological hurdle is enabling researchers to efficiently and effectively query these diverse datasets, especially as the raw image volumes grow beyond terabyte sizes. Existing community tools can perform such queries and analysis on smaller scale datasets, which can fit locally in memory, but the path to scaling remains unclear. Existing solutions such as neuPrint or FlyBrainLab enable these queries for specific datasets, but there remains a need to generalize algorithms and standards across datasets. To overcome this challenge, we present a software framework for comparative connectomics and graph discovery to make connectomes easy to analyze, even when larger-than-RAM, and even when stored in disparate datastores. This software suite includes visualization tools, a web portal, a connectivity and annotation query engine, and the ability to interface with a variety of data sources and community tools from the neuroscience community. These tools include MossDB (an immutable datastore for metadata and rich annotations); Grand (for prototyping larger-than-RAM graphs); GrandIso-Cloud (for querying existing graphs that exceed the capabilities of a single work-station); and Motif Studio (for enabling the public to query across connectomes). These tools interface with existing frameworks such as neuPrint, graph databases such as Neo4j, and standard data analysis tools such as Pandas or NetworkX. Together, these tools enable tool and algorithm reuse, standardization, and neuroscience discovery.

neuroscience↗

intern: Integrated Toolkit for Extensible and Reproducible Neuroscience

As neuroscience datasets continue to grow in size, the complexity of data analyses can require a detailed understanding and implementation of systems computer science for storage, access, processing, and sharing. Currently, several general data standards (e.g., Zarr, HDF5, precompute, tensorstore) and purpose-built ecosystems (e.g., BossDB, CloudVolume, DVID, and Knossos) exist. Each of these systems has advantages and limitations and is most appropriate for different use cases. Using datasets that dont fit into RAM in this heterogeneous environment is challenging, and significant barriers exist to leverage underlying research investments. In this manuscript, we outline our perspective for how to approach this challenge through the use of community provided, standardized interfaces that unify various computational backends and abstract computer science challenges from the scientist. We introduce desirable design patterns and our reference implementation called intern.

neuroscience↗

Leveraging Tools from Autonomous Navigation for Rapid, Robust Neuron Connectivity

As biological imaging datasets continue to grow in size, extracting information from large image volumes presents a computationally intensive challenge. State-of-the-art algorithms are almost entirely dominated by the use of convolutional neural network approaches that may be diffcult to run at scale given schedule, cost, and resource limitations. We demonstrate a novel solution for high-resolution electron microscopy brain image volumes that permits the identification of individual neurons and synapses. Instead of conventional approaches whereby voxels are labelled according to the neuron or neuron segment to which they belong, we instead focus on extracting the underlying brain graph represented by synaptic connections between individual neurons while also identifying key features like skeleton similarity and path length. This graph represents a critical step and scaffold for understanding the structure of neuronal circuitry. Our approach recasts the segmentation problem to one of path-finding between keypoints (i.e., connectivity) in an information sharing framework using virtual agents. We create a family of sensors which follow local decision-making rules that perform computationally cheap operations on potential fields to perform tasks such as avoiding cell membranes and finding synapses. These enable a swarm of virtual agents to effciently and robustly traverse three-dimensional datasets, create a sparse segmentation of pathways, and capture connectivity information. We achieve results that meet or exceed state-of-the-art performance at a substantially lower computational cost. This tool offers a categorically different approach to connectome estimation that can augment how we extract connectivity information at scale. Our method is generalizable and may be extended to biomedical imaging problems such as tracing the bronchial trees in lungs or road networks in natural images.

neuroscience↗

Toward A Reproducible, Scalable Framework for Processing Large Neuroimaging Datasets

Emerging neuroimaging datasets (collected through modalities such as Electron Microscopy, Calcium Imaging, or X-ray Microtomography) describe the location and properties of neurons and their connections at unprecedented scale, promising new ways of understanding the brain. These modern imaging techniques used to interrogate the brain can quickly accumulate gigabytes to petabytes of structural brain imaging data. Unfortunately, many neuroscience laboratories lack the computational expertise or resources to work with datasets of this size: computer vision tools are often not portable or scalable, and there is considerable difficulty in reproducing results or extending methods. We developed an ecosystem of neuroimaging data analysis pipelines that utilize open source algorithms to create standardized modules and end-to-end optimized approaches. As exemplars we apply our tools to estimate synapse-level connectomes from electron microscopy data and cell distributions from X-ray microtomography data. To facilitate scientific discovery, we propose a generalized processing framework, that connects and extends existing open-source projects to provide large-scale data storage, reproducible algorithms, and workflow execution engines. Our accessible methods and pipelines demonstrate that approaches across multiple neuroimaging experiments can be standardized and applied to diverse datasets. The techniques developed are demonstrated on neuroimaging datasets, but may be applied to similar problems in other domains.

neuroscience↗

A substrate for modular, extensible data-visualization

As the scope of scientific questions increase and datasets grow larger, the visualization of relevant information correspondingly becomes more difficult and complex. Sharing visualizations amongst collaborators and with the public can be especially onerous, as it is challenging to reconcile software dependencies, data formats, and specific user needs in an easily accessible package. We present substrate, a data-visualization framework designed to simplify communication and code reuse across diverse research teams. Our platform provides a simple, powerful, browser-based interface for scientists to rapidly build effective three-dimensional scenes and visualizations. We aim to reduce the gap of existing systems, which commonly prescribe a limited set of high-level components, that are rarely optimized for arbitrarily large data visualization or for custom data types. To further engage the broader scientific community and enable seamless integration with existing scientific workflows, we also present pytri, a Python library that bridges the use of substrate with the ubiquitous scientific computing platform, Jupyter. Our intention is to reduce the activation energy required to transition between exploratory data analysis, data visualization, and publication-quality interactive scenes.

bioinformatics↗

The Block Object Storage Service (bossDB): A Cloud-Native Approach for Petascale Neuroscience Discovery

Large volumetric neuroimaging datasets have grown in size over the past ten years from gigabytes to terabytes, with petascale data becoming available and more common over the next few years. Current approaches to store and analyze these emerging datasets are insufficient in their ability to scale in both cost-effectiveness and performance. Additionally, enabling large-scale processing and annotation is critical as these data grow too large for manual inspection. We provide a new cloud-native managed service for large and multi-modal experiments, with support for data ingest, storage, visualization, and sharing through a RESTful Application Programming Interface (API) and web-based user interface. Our project is open source and can be easily and cost-effectively used for a variety of modalities and applications.

bioinformatics↗