Biology subjects

Franke, K.

Publications and source records attributed to Franke, K..

At least 19 recordsLinked to original sources

bioRxiv2026

Visual uncertainty and task demands shape active sensing strategies in mice

In natural environments, animals actively sample visual information to guide behavior. Sensory feedback is dynamic and often requires active movements, whether saccading across the lines of this page or walking through a park. From high-acuity vision in hawks to low-acuity mice, many animals actively navigate to seek information, which can be called infotaxis. Although mice have relatively low-acuity vision, they still rely on sight for critical behaviors including navigation and prey capture. Yet, how sensitive they are to visual information and performing infotaxis has not been established. Here, we develop a virtual reality object discrimination task to investigate visual decision-making under naturalistic conditions. We show that mice perform infotaxis by actively seeking out informative views to guide their choices. Stimulus manipulations confirm that this strategy is modulated by the amount of available visual information. These results reveal that mice use principled active strategies to resolve visual uncertainty, highlighting a key role for information-seeking in natural vision. HighlightsO_LIMice perform active visual sensing in a free-range VR object discrimination task. C_LIO_LIThey perform infotaxis and select the correct object under variable visibility. C_LIO_LIDecisions decoded from head-body movements and speed reflect occlusion sensitivity. C_LI

neuroscience↗

bioRxiv2026

Eyewire II - A connectomic resource for resolving cell types and circuits of the mouse retina

Comprehensive wiring diagrams from electron microscopy (EM) are a powerful tool to understand the inner workings of the brain. The retina is an easily accessible part of the brain that performs complex visual computations. Its thin, layered structure offers a unique opportunity to decipher neural cell types and map their connectivity. A major obstacle has been the limited size of existing retinal EM datasets, which could not resolve rare cell types and neurons with large dendritic arbors. Here, we describe Eyewire II, a large-scale EM dataset covering nearly 1 mm2 of the adult mouse retina - roughly 10-100 times larger than previous retinal EM volumes. Human proofreading of an automated reconstruction has so far yielded more than 8, 000 bipolar cells, 13, 000 amacrine cells, and 4, 000 retinal ganglion cells. Automated detection is complete for synaptic ribbons and in progress for conventional synapses. Prior to EM imaging, visual responses to diverse stimuli - including natural movies - were recorded in a subset of neurons using two-photon Ca2+ imaging, enabling direct alignment of morphological and functional cell type identity. To enable high-throughput, automatic cell typing, we devised a human-in-the-loop approach that combines deep learning with human expert annotations. As a proof-of-principle, we show that morphological features of reconstructed bipolar cells are sufficient to recover all 15 known bipolar cell types with regular, non-overlapping mosaics. Together, these data and tools establish Eyewire II as a shared resource for the field of retina research. Already now, more than 30 laboratories worldwide are contributing proofreading, expert annotations, and software tools, advancing Eyewire II towards a complete cell type catalog and synaptic wiring diagram of a mammalian retina.

neuroscience↗

bioRxiv2026

The functional organization of retinal input to the mouse superior colliculus

The superior colliculus integrates retinal input to drive rapid, adaptive visual behavior, yet how the functional diversity of retinal ganglion cell types is represented in superior colliculus remains poorly understood. Using chronic two-photon calcium imaging of retinal ganglion cell axonal boutons in awake mice, we recorded over 200,000 boutons across superficial superior colliculus layers -- a scale that enabled systematic comparison with large-scale ex vivo retinal datasets. This revealed that the superior colliculus receives a near-complete sampling of retinal ganglion cell functional diversity. Functionally distinct response types were organized in systematic laminar gradients: not only response properties such as direction selectivity and contrast suppression, but retinal response types themselves varied systematically with depth. To probe how this organized input encodes natural scenes, we trained a "digital twin" deep network model on natural movie responses and validated its generalization to parametric stimuli, including cell type identification. Leveraging this model to generate predicted responses to looming stimuli, we identify a discrete subset of retinal response types tuned for collision detection at low angular thresholds -- a specialization embedded within a broader, non-specialized retinal population. The digital twin is made publicly available as a community resource. Together, these findings provide a comprehensive functional map of retinal drive to the superior colliculus and an in silico platform for linking retinal cell types to behaviorally relevant superior colliculus computations.

neuroscience↗

bioRxiv2025

A large-scale dataset of functional mouse ganglion cell layer responses

We present the AO_SCPLOWLLC_SCPLOW-GCL dataset, a large-scale resource of functional two-photon Ca2+-imaging recordings with rich meta-data information from more than 80,000 cells in the ganglion cell layer (GCL) of the ex vivo mouse retina. Collected over nine years across more than 139 experimental sessions, the dataset provides recordings of light-evoked responses to various stimuli, including a shared set of core stimuli. To enable cell-type-specific analyses, cells are probabilistically assigned to 46 previously characterized functional groups, including retinal ganglion cells and displaced amacrine cells. Further, we assessed the influence of experimental and biological factors on the functional responses and found only small batch effects across experimenters, setups, and recording sessions, highlighting the datasets consistency. The AO_SCPLOWLLC_SCPLOW-GCL dataset offers a comprehensive and standardised reference for studying retinal computation at scale. It supports population-level analyses, computational modelling, and the development of machine learning approaches for biological time-series data. Future releases will expand the dataset with additional mouse lines and light stimuli, creating a growing resource for the vision science community.

neuroscience↗

bioRxiv2025

Dual-feature selectivity enables bidirectional coding in visual cortical neurons

Sensory neurons are traditionally viewed as feature detectors that respond with an increase in firing rate to preferred stimuli while remaining unresponsive to others. Here, we identify a dual-feature encoding strategy in macaque visual cortex, wherein many neurons in areas V1 and V4 are selectively tuned to two distinct visual features--one that enhances and one that suppresses activity--around an elevated baseline firing rate. By combining neuronal recordings with functional digital twin models--deep learning-based predictive models of biological neurons--we were able to systematically identify each neurons preferred and non-preferred features. These feature pairs served as anchors for a continuous, low-dimensional axis in natural image similarity space, along which neuronal activity varied approximately linearly. Within a single visual area, visual features that strongly or weakly activated individual neurons also had a high probability of modulating the activity of other neurons, suggesting a shared feature selectivity across the population that structures stimulus encoding. We show that this encoding strategy is conserved across species, present in both primary and lateral visual areas of mouse cortex. Dual-feature selectivity is consistent with recent anatomical evidence for feature-specific inhibitory connectivity, complementing the feature-detector principle through circuit mechanisms in which selective excitation and inhibition may together enhance the representational capacity of the neuronal population.

neuroscience↗

bioRxiv2024

GABAergic amacrine cells balance biased chromatic information in the mouse retina

The retina extracts chromatic information present in an animals environment. In the mouse, the feed-forward, excitatory pathway through the retina is dominated by a chromatic gradient, with green and UV signals primarily processed in the dorsal and ventral retina, respectively. However, at the output of the retina, chromatic tuning is more mixed, suggesting that amacrine cells alter spectral tuning. We genetically targeted the population of 40+ GABAergic amacrine cell types and used two-photon calcium imaging to systematically survey chromatic responses in their dendritic processes. We found that amacrine cells show diverse chromatic responses in different spatial regions of their receptive fields and across the dorso-ventral axis of the retina. Compared to their excitatory inputs from bipolar cells, amacrine cells are less chromatically tuned and less likely to be colour-opponent. We identified 25 functional amacrine cell types that, in addition to their chromatic properties, exhibit distinctive achromatic receptive field properties. A combination of pharmacological interventions and a biologically-inspired deep learning model revealed how lateral inhibition and recurrent excitatory inputs shape chromatic properties of amacrine cells. Our data suggest that amacrine cells balance the strongly biased spectral tuning of excitation in the mouse retina and thereby support increased diversity in chromatic information of the retinal output.

neuroscience↗

bioRxiv2023

MADDD-seq, a novel massively parallel sequencing tool for simultaneous detection of DNA damage and mutations

Our genome is exposed to a wide variety of DNA-damaging agents. If left unrepaired, this damage can be fixed into mutations that promote carcinogenesis and the development of genetically inherited diseases. As a result, it is crucial that we can detect DNA damage and mutations with exquisite sensitivity. Here, we describe a modified version of double barcoding sequencing technology termed Mutation And DNA Damage Detection-seq (MADDD-seq) that can detect DNA damage and mutations simultaneously, with a single assay. To demonstrate the utility of MADDD-seq as a multifunctional detection tool, we treated yeast cells with a DNA-damaging agent and tracked the presence of DNA damage and mutations over a 24-hour timespan. These experiments allowed us to identify thousands of adducts and mutations in a single sequencing run and expose the kinetics of DNA repair and mutagenesis in remarkable detail.

genetics↗

bioRxiv2023

Asymmetric distribution of color-opponent response types across mouse visual cortex supports superior color vision in the sky

Color is an important visual feature that informs behavior, and the retinal basis for color vision has been studied across various vertebrate species. While many studies have investigated how color information is processed in visual brain areas of primate species, we have limited understanding of how it is organized beyond the retina in other species, including most dichromatic mammals. In this study, we systematically characterized how color is represented in the primary visual cortex (V1) of mice. Using large-scale neuronal recordings and a luminance and color noise stimulus, we found that more than a third of neurons in mouse V1 are color-opponent in their receptive field center, while the receptive field surround predominantly captures luminance contrast. Furthermore, we found that color-opponency is especially pronounced in posterior V1 that encodes the sky, matching the statistics of natural scenes experienced by mice. Using unsupervised clustering, we demonstrate that the asymmetry in color representations across cortex can be explained by an uneven distribution of green-On/UV-Off color-opponent response types that are represented in the upper visual field. Finally, a simple model with natural scene-inspired parametric stimuli shows that green-On/UV-Off color-opponent response types may enhance the detection of "predatory"-like dark UV-objects in noisy daylight scenes. The results from this study highlight the relevance of color processing in the mouse visual system and contribute to our understanding of how color information is organized in the visual hierarchy across species.

neuroscience↗

bioRxiv2023

Energy Guided Diffusion for Generating Neurally Exciting Images

In recent years, most exciting inputs (MEIs) synthesized from encoding models of neuronal activity have become an established method to study tuning properties of biological and artificial visual systems. However, as we move up the visual hierarchy, the complexity of neuronal computations increases. Consequently, it becomes more challenging to model neuronal activity, requiring more complex models. In this study, we introduce a new attention readout for a convolutional data-driven core for neurons in macaque V4 that outperforms the state-of-the-art task-driven ResNet model in predicting neuronal responses. However, as the predictive network becomes deeper and more complex, synthesizing MEIs via straightforward gradient ascent (GA) can struggle to produce qualitatively good results and overfit to idiosyncrasies of a more complex model, potentially decreasing the MEIs model-to-brain transferability. To solve this problem, we propose a diffusion-based method for generating MEIs via Energy Guidance (EGG). We show that for models of macaque V4, EGG generates single neuron MEIs that generalize better across architectures than the state-of-the-art GA while preserving the within-architectures activation and requiring 4.7x less compute time. Furthermore, EGG diffusion can be used to generate other neurally exciting images, like most exciting natural images that are on par with a selection of highly activating natural images, or image reconstructions that generalize better across architectures. Finally, EGG is simple to implement, requires no retraining of the diffusion model, and can easily be generalized to provide other characterizations of the visual system, such as invariances. Thus EGG provides a general and flexible framework to study coding properties of the visual system in the context of natural images.1

neuroscience↗

bioRxiv2023

Deep learning-driven characterization of single cell tuning in primate visual area V4 unveils topological organization

Deciphering the brains structure-function relationship is key to understanding the neuronal mechanisms underlying perception and cognition. The cortical column, a vertical organization of neurons with similar functions, is a classic example of primate neocortex structure-function organization. While columns have been identified in primary sensory areas using parametric stimuli, their prevalence across higher-level cortex is debated, particularly regarding complex tuning in natural image space. However, a key hurdle in identifying columns is characterizing the complex, nonlinear tuning of neurons to high-dimensional sensory inputs. Building on prior findings of topological organization for features like color and orientation, we investigate functional clustering in macaque visual area V4 in non-parametric natural image space, using large-scale recordings and deep learning-based analysis. We combined linear probe recordings with deep learning methods to systematically characterize the tuning of >1,200 V4 neurons using in silico synthesis of most exciting images (MEIs), followed by in vivo verification. Single V4 neurons exhibited MEIs containing complex features, including textures and shapes, and even high-level attributes with eye-like appearance. Neurons recorded on the same silicon probe, inserted orthogonal to the cortical surface, often exhibited similarities in their spatial feature selectivity, suggesting a degree of functional organization along the cortical depth. We quantified MEI similarity using human psychophysics and distances in a contrastive learning-derived embedding space. Moreover, the selectivity of the V4 neuronal population showed evidence of clustering into functional groups of shared feature selectivity. These functional groups showed parallels with the feature maps of units in artificial vision systems, suggesting potential shared encoding strategies. These results demonstrate the feasibility and scalability of deep learning-based functional characterization of neuronal selectivity in naturalistic visual contexts, offering a framework for quantitatively mapping cortical organization across multiple levels of the visual hierarchy.

neuroscience↗

bioRxiv2023

Towards a Foundation Model of the Mouse Visual Cortex

The complexity of neural circuits makes it challenging to decipher the brains algorithms of intelligence. Recent break-throughs in deep learning have produced models that accurately simulate brain activity, enhancing our understanding of the brains computational objectives and neural coding. However, these models struggle to generalize beyond their training distribution, limiting their utility. The emergence of foundation models, trained on vast datasets, has introduced a new AI paradigm with remarkable generalization capabilities. We collected large amounts of neural activity from visual cortices of multiple mice and trained a foundation model to accurately predict neuronal responses to arbitrary natural videos. This model generalized to new mice with minimal training and successfully predicted responses across various new stimulus domains, such as coherent motion and noise patterns. It could also be adapted to new tasks beyond neural prediction, accurately predicting anatomical cell types, dendritic features, and neuronal connectivity within the MICrONS functional connectomics dataset. Our work is a crucial step toward building foundation brain models. As neuroscience accumulates larger, multi-modal datasets, foundation models will uncover statistical regularities, enabling rapid adaptation to new tasks and accelerating research.

neuroscience↗

bioRxiv2023

Bipartite invariance in mouse primary visual cortex

A primary goal of sensory systems is to extract robust and meaningful features that are invariant to variations in the sensory input. Characterizing these invariances at the neuronal level is crucial for understanding how the visual system supports generalization, but the high-dimensional nature of ecological stimuli poses major challenges. Consequently, our understanding of how the brain represents invariances has historically depended on a few examples, such as phase invariance to grating stimuli in V1 complex cells. Here, we leverage the inception loop paradigm --iterating between large-scale recordings, deep learning neuronal predictive models, and in silico experiments with in vivo verification--to characterize neuronal invariances in mouse V1. Using a neuronal predictive model, we synthesized Diverse Exciting Inputs (DEIs) that strongly drive target neurons while differing substantially in image space. These DEIs revealed a novel bipartite invariance: one portion of the receptive field encodes shift-invariant, high-frequency textures, while the other encodes a fixed, low-frequency spatial pattern. This subfield division aligned with object boundaries defined by spatial frequency differences in highly activating stimuli, suggesting bi-partite invariance contributes to segmentation. Our analysis of computational models and anatomical data from the MICrONS dataset revealed a hierarchical organization of excitatory neurons in mouse V1 Layers 2/3: We found that postsynaptic neurons exhibited greater invariance than their presynaptic inputs, while neurons with lower invariance formed more connections. These findings suggest a synaptic-level hierarchy that progressively increases neural invariance within the primary visual cortex. Intriguingly, similar high-low frequency bipartite patterns strongly activate certain units in artificial neural networks, suggesting that universal visual representations govern both biological and artificial systems, potentially aiding in the extraction of visual features from complex backgrounds.

neuroscience↗

bioRxiv2023

Pattern completion and disruption characterize contextual modulation in mouse visual cortex

Vision is fundamentally context-dependent, with neuronal responses influenced not just by local features but also by surrounding contextual information. In the visual cortex, studies using simple grating stimuli indicate that congruent stimuli--where the center and surround share the same orientation--are more inhibitory than when orientations are orthogonal, potentially serving redundancy reduction and predictive coding. Understanding these center-surround interactions in relation to natural image statistics is challenging due to the high dimensionality of the stimulus space, yet crucial for deciphering the neuronal code of real-world sensory processing. Utilizing large-scale recordings from mouse V1, we trained convolutional neural networks (CNNs) to predict and synthesize surround patterns that either optimally suppressed or enhanced responses to center stimuli, confirmed by in v ivo experiments. Contrary to the notion that congruent stimuli are suppressive, we found that surrounds that completed patterns based on natural image statistics were facilitatory, while disruptive surrounds were suppressive. Applying our CNN image synthesis method in macaque V1, we discovered that pattern completion within the near surround occurred more frequently with excitatory than with inhibitory surrounds, suggesting that our results in mice are conserved in macaques. Further, experiments and model analyses confirmed previous studies reporting the opposite effect with grating stimuli in both species. Using the MICrONS functional connectomics dataset, we observed that neurons with similar feature selectivity formed excitatory connections regardless of their receptive field overlap, aligning with the pattern completion phenomenon observed for excitatory surrounds. Finally, our empirical results emerged in a normative model of perception implementing Bayesian inference, where neuronal responses are modulated by prior knowledge of natural scene statistics. In summary, our findings identify a novel relationship between contextual information and natural scene statistics and provide evidence for a role of contextual modulation in hierarchical inference.

neuroscience↗

bioRxiv2022

A chromatic feature detector in the retina signals visual context changes

The retina transforms patterns of light into visual feature representations supporting behaviour. These representations are distributed across various types of retinal ganglion cells (RGCs), whose spatial and temporal tuning properties have been studied extensively in many model organisms, including the mouse. However, it has been difficult to link the potentially nonlinear retinal transformations of natural visual inputs to specific ethological purposes. Here, we discover a nonlinear selectivity to chromatic contrast in an RGC type that allows the detection of changes in visual context. We trained a convolutional neural network (CNN) model on large-scale functional recordings of RGC responses to natural mouse movies, and then used this model to search in silico for stimuli that maximally excite distinct types of RGCs. This procedure predicted centre colour-opponency in transient Suppressed-by-Contrast RGCs (tSbC), a cell type whose function is being debated. We confirmed experimentally that these cells indeed responded very selectively to Green-OFF, UV-ON contrasts. This type of chromatic contrast was characteristic of transitions from ground to sky in the visual scene, as might be elicited by heador eye-movements across the horizon. Because tSbC cells performed best among all RGC types at reliably detecting these transitions, we suggest a role for this RGC type in providing contextual information (i.e. sky or ground) necessary for the selection of appropriate behavioural responses to other stimuli, such as looming objects. Our work showcases how a combination of experiments with natural stimuli and computational modelling allows discovering novel types of stimulus selectivity and identifying their potential ethological relevance.

neuroscience↗

bioRxiv2021

Removing Inter-Experimental Variability from Functional Data in Systems Neuroscience

Integrating data from multiple experiments is common practice in systems neuroscience but it requires inter-experimental variability to be negligible compared to the biological signal of interest. This requirement is rarely fulfilled; systematic changes between experiments can drastically affect the outcome of complex analysis pipelines. Modern machine learning approaches designed to adapt models across multiple data domains offer flexible ways of removing inter-experimental variability where classical statistical methods often fail. While applications of these methods have been mostly limited to single-cell genomics, in this work, we develop a theoretical framework for domain adaptation in systems neuroscience. We implement this in an adversarial optimization scheme that removes inter-experimental variability while preserving the biological signal. We compare our method to previous approaches on a large-scale dataset of two-photon imaging recordings of retinal bipolar cell responses to visual stimuli. This dataset provides a unique benchmark as it contains biological signal from well-defined cell types that is obscured by large inter-experimental variability. In a supervised setting, we compare the generalization performance of cell type classifiers across experiments, which we validate with anatomical cell type distributions from electron microscopy data. In an unsupervised setting, we remove inter-experimental variability from data which can then be fed into arbitrary downstream analyses. In both settings, we find that our method achieves the best trade-off between removing inter-experimental variability and preserving biological signal. Thus, we offer a flexible approach to remove inter-experimental variability and integrate datasets across experiments in systems neuroscience. Code available at https://github.com/eulerlab/rave.

neuroscience↗

bioRxiv2021

Behavioral state tunes mouse vision to ethological features through pupil dilation

Sensory processing changes with behavioral context to increase computational flexibility. In the visual system, active behavioral states enhance sensory responses but typically leave the preferred stimuli of neurons unchanged. Here we find that behavioral state does modulate stimulus selectivity in mouse visual cortex in the context of colored natural scenes. Using population imaging, behavior, pharmacology, and deep neural networks, we identified a shift of color selectivity towards ultraviolet stimuli exclusively caused by pupil dilation, resulting in a dynamic switch from rod to cone photoreceptors, extending their role beyond night and day vision. This facilitated the detection of ethological stimuli, such as aerial predators against the twilight sky. In contrast to previous studies that have used pupil dilation as an indirect measure of brain state, our results suggest that the brain uses pupil dilation itself to differentially recruit rods and cones on short timescales to tune visual representations to behavioral demands.

neuroscience↗

bioRxiv2021

Center-surround interactions underlie bipolar cell motion sensing in the mouse retina

Motion is a critical aspect of vision. We studied the representation of motion in mouse retinal bipolar cells and found, surprisingly, that some bipolar cells possess motion-sensing capabilities that rely on their center-surround receptive fields. Using a glutamate sensor, we directly observed motion-sensitive bipolar cell synaptic output, which was strongest for local motion and dependent on the motions origin. We characterized bipolar cell receptive fields and found that there are motion and non-motion sensitive bipolar cell types, the majority being motion sensitive. Next, we used these bipolar cell receptive fields along with connectomics to design biophysical models of downstream cells. The models and experiments demonstrated that bipolar cells pass motion-sensitive excitation to starburst amacrine cells through direction-specific signals mediated by bipolar cells center-surround receptive field structure. As bipolar cells provide excitation to most amacrine and ganglion cells, their motion sensitivity may contribute to motion processing throughout the visual system.

neuroscience↗

bioRxiv2021

Mind the gap: performance metric evaluation in brain-age prediction

Estimating age based on neuroimaging-derived data has become a popular approach to developing markers for brain integrity and health. While a variety of machine-learning algorithms can provide accurate predictions of age based on brain characteristics, there is significant variation in model accuracy reported across studies. We predicted age based on neuroimaging data in two population-based datasets, and assessed the effects of age range, sample size, and age-bias correction on the model performance metrics r, R2, Root Mean Squared Error (RMSE), and Mean Absolute Error (MAE). The results showed that these metrics vary considerably depending on cohort age range; r and R2 values are lower when measured in samples with a narrower age range. RMSE and MAE are also lower in samples with a narrower age range due to smaller errors/brain age delta values when predictions are closer to the mean age of the group. Across subsets with different age ranges, performance metrics improve with increasing sample size. Performance metrics further vary depending on prediction variance as well as mean age difference between training and test sets, and age-bias corrected metrics indicate high accuracy - also for models showing poor initial performance. In conclusion, performance metrics used for evaluating age prediction models depend on cohort and study-specific data characteristics, and cannot be directly compared across different studies. Since age-bias corrected metrics in general indicate high accuracy, even for poorly performing models, inspection of uncorrected model results provides important information about underlying model attributes such as prediction variance.

neuroscience↗