Bracket Coding: The Optimal Balance Between Temporal Integration and Segregation in Early Visual Processing

Abstract

Despite over a century of research into the neural code, the fundamental principles by which the brain encodes sensory information remain debated. In this study we provide converging evidence for the presence of a dynamic, fast-switching integration of rate and temporal coding in the thalamus, primary visual cortex, and higher-order visual cortical areas of mice viewing an array of visual stimuli. This scheme is primarily characterized by the presence of distinct, temporally coordinated "bracket"s that tile the duration of each trial, are rate-coded within, and are separated by boundaries that are precisely-timed and synchronized across the population. Using large-scale Neuropixels recordings from the Allen Institute Visual Coding dataset, we provide evidence for the robustness and generality of bracket coding across several visual tasks and brain regions, as well as its optimality for information decoding, functional relevance for information representation, pronounced hierarchical organization, long-range bottom-up synchrony across visual regions, and coherence with low-frequency local field oscillations. These findings were all subsequently validated in a second, independent dataset provided by the International Brain Laboratory consortium. Finally, we provide a computational model that can serve as a potential mechanism for the generation of bracket-coded population spiking activity. Together, our results demonstrate the presence of a novel form of sensory information encoding in the brain, with broad implications for neuroscience and neuroengineering.