Search bioRxiv⌕ Search

Biology subjects

Doyle, W.

Publications and source records attributed to Doyle, W..

At least 19 recordsLinked to original sources

Normalization accounts for temporal dynamics in human somatosensory cortex

Sensory processing is fundamentally shaped by stimulation history. For example, in visual cortex, neural responses are reduced for repeated or sustained stimuli (adaptation). These phenomena are well characterized and effectively modeled by divisive normalization. We asked whether these same computational principles govern somatosensory processing. We used fMRI (6 participants) and intracranial electroencephalography (iEEG, 2 participants) to measure responses to time-varying vibrotactile stimuli in human somatosensory cortex. Stimuli consisted of single- and paired-pulses with durations and interstimulus intervals ranging from 0.05 to 1.2 s. We extracted BOLD time courses to capture neural response amplitudes, and high-frequency iEEG broadband envelopes to capture fast neural dynamics. In both experiments, we observed pronounced sub-additive temporal summation. Responses to longer or repeated stimuli were consistently lower than predicted by linear integration. Computational modeling revealed that divisive normalization models outperformed linear models in cross-validated accuracy across both datasets. These results demonstrate that somatosensory temporal dynamics closely mirror those in the visual system. Our findings suggest that the nervous system employs similar computational principles across modalities to encode sensory information across time. Significance statementHow the brain integrates sensory information over time is a fundamental question in neuroscience. While nonlinear temporal integration is well documented in visual cortex, it has not been extensively mapped in the human somatosensory system. By combining fMRI with intracranial EEG in humans, we demonstrate that somatosensory responses to tactile stimulation exhibit subadditive temporal summation. This nonlinearity is accurately captured by a divisive normalization model, matching observations in the visual system. Our results suggest that normalization is a canonical computation shared across different modalities to manage temporal dynamics, providing a unified framework for understanding how the brain encodes dynamic sensory stimuli.

neuroscience↗

Neural Dynamics of Automatic Speech Production

Speech is a defining human behavior, and this ability depends critically on speech motor cortex. While the ventral precentral and postcentral gyri are classically regarded as chiefly articulatory and somatosensory regions, a growing body of literature challenges this simplification. Most prior research, however, has examined cued or structured speech production tasks, neglecting the automatic, overlearned speech commonly utilized in clinical assessment. Consequently, the neural dynamics and precise timing of cortical recruitment during automatic speech remain poorly understood. Here, we present intracranial electrocorticography (ECoG) recordings from the left perisylvian cortex in participants performing automatic speech such as counting and recitation of overlearned sequences. We investigate neural dynamics using encoding (multivariate temporal response function) and decoding (deep neural network speech synthesis) models. We show that automatic speech engages a distributed network across superior temporal, precentral, and post-central cortices, characterized by attenuated pre-articulatory activity and weaker frontal encoding. Furthermore, two complementary decoding strategies reveal that speech motor cortex represents a mixture of feedforward and feedback signals, with a subset of sites exhibiting exclusively feed-forward dynamics. These results delineate the spatiotemporal cortical organization of automatic speech and establish that the speech motor cortex supports more complex dynamics than purely feedforward control.

neuroscience↗

Decoding state specific connectivity during speech production and perception

Understanding how dynamic brain networks support language perception and production is central to cognitive neuroscience. A vast network based literature has employed functional connectivity (FC), primarily using resting-state and task-based fMRI. However, methodological limitations have hindered this approach in language processing, particularly during speech production. Here, we address this gap by employing a large cohort of electrocorticographic (ECoG) patients (N=42) to investigate the networks driving speech perception and production. We acquired data while patients were engaged in a controlled battery of speech production tasks focusing on five cognitive states (auditory perception, picture perception, reading perception, speech production, and baseline). Using linear classifiers we were able to robustly decode cognitive states from single-trial FC (i.e. Pearson correlations) of the neural activity patterns, achieving a mean accuracy of 64.4%. These classifiers revealed distinct network signatures underlying auditory and visual perception as well as speech production via stable network connectivity. Importantly, the network signatures included both regions with robust local neural activity and those with minimal or no detectable activation. Such signatures indicate that even low-activity regions contribute critically to differentiating cognitive states. Our findings underscore the significance of functional connectivity analysis as a complementary dimension to investigating local neural activity, and suggest that the functional networks supporting speech extend beyond the most metabolically active regions.

neuroscience↗

A probabilistic functional atlas based on extraoperative electrocortical stimulation mapping

BackgroundDirect electrocortical stimulation (DES) is the clinical gold standard for identifying eloquent cortex and guiding neurosurgical intervention, yet prior intraoperative DES during awake craniotomies have been limited by intraoperative sampling constraints and density-based rather than probabilistic analyses. The probability of typical and atypical cortical organization has not been fully explored, especially in epilepsy populations. We sought to generate a probabilistic atlas of motor, sensory, and language functions using extraoperative DES in a large cohort of patients with epilepsy. MethodsWe retrospectively analyzed 2,124 extraoperative DES trials from 125 patients undergoing intracranial monitoring (2008-2023). Positive and negative trials were mapped to Montreal Neurological Institute space, parcellated with the Human Connectome Project atlas, and analyzed using probability mapping, bootstrapped region-of-interest hit probabilities, hierarchical clustering, and kernel density estimation. Mixed-effects models assessed clinical predictors of language disruption. ResultsProbabilistic maps revealed regions of increased likelihood for eliciting functional responses in expected sensorimotor and language territories, but also demonstrated marked variability and deviations from expected cortical locations. Language disruption occurred in 338 trials, motor in 520, and sensory in 370. Instead of observing high probabilities and low inter-patient variability isolated to classic perisylvian locations (e.g., Brocas and Wernickes areas), the likelihood of language disruption followed graded probabilistic gradients with high inter-patient variability. The middle frontal gyrus emerged as a consistent locus of naming and speech arrest. Motor phenomena extended into parietal association cortex. Higher-order experiences, including forced thoughts and feelings of presence, were reproducibly evoked from frontal and temporoparietal sites. Early seizure onset and temporal lobe lesions predicted lower naming disruption probabilities. ConclusionsThis extraoperative DES atlas, the largest to date, demonstrates that eloquent cortical functions are organized along probabilistic continua rather than fixed regions. Findings highlight the middle frontal gyrus as a critical language node, extend motor mapping into parietal cortex, and delineate reproducible experiential phenomena. Substantial inter-patient variability underscores the necessity of individualized mapping in surgical planning.

neuroscience↗

Frontal cortex organization supporting audiovisual processing during naturalistic viewing

AbstractOur brains dynamically adapt to a multisensory world by orchestrating diverse inputs across sensory streams. This process engages multiple brain regions, but it remains unclear how audiovisual stimuli are represented and evolve over time, especially in naturalistic scenarios. Here, we employed a movie-viewing paradigm to explore this question. We recorded intracranial electrocorticography (iEEG) to measure brain activity in 19 participants watching a short multilingual movie. Using unsupervised clustering and supervised encoding models, we identified a robust modality-specific gradient in the frontal cortex, wherein the ventral division primarily processes auditory information and the dorsal division processes visual inputs. Further, we found that this cortical organization dynamically changed, adapting to different movie contexts. This result potentially reflects flexible audiovisual-resource assignment to construct a coherent percept of the movie. Leveraging behavioral ratings, we found that the frontal cortex is the primary site in this modality assignment process. Together, our findings shed new light on the functional architecture of the frontal cortex underlying flexible multisensory representation and integration in natural contexts.

neuroscience↗

Neural and Computational Mechanisms Underlying One-shot Perceptual Learning in Humans

The ability to quickly learn and generalize is one of the brains most impressive feats and recreating it remains a major challenge for modern artificial intelligence research. One of the most mysterious one-shot learning abilities displayed by humans is one-shot perceptual learning, whereby a single viewing experience drastically alters visual perception in a long-lasting manner. Where in the brain one-shot perceptual learning occurs and what mechanisms support it remain enigmatic. Combining psychophysics, 7T fMRI, and intracranial recordings, we identify high-level visual cortex as the most likely neural substrate wherein neural plasticity supports one-shot perceptual learning. We further develop a novel deep neural network model incorporating top-down feedback into a vision transformer, which recapitulates and predicts human behavior. The prior knowledge learnt by this model is highly similar to the neural code in the human high-level visual cortex. These results reveal the neurocomputational mechanisms underlying one-shot perceptual learning in humans.

neuroscience↗

The "Podcast" ECoG dataset for modeling neural activity during natural language comprehension

Naturalistic electrocorticography (ECoG) data are a rare but essential resource for studying the brains linguistic capabilities. ECoG offers a high temporal resolution suitable for investigating processes at multiple temporal timescales and frequency bands. It also provides broad spatial coverage, often along critical language areas. Here, we share a dataset of nine ECoG participants with 1,330 electrodes listening to a 30-minute audio podcast. The richness of this naturalistic stimulus can be used for various research endeavors, from auditory perception to semantic integration. In addition to the neural data, we extract linguistic features of the stimulus ranging from phonetic information to large language model word embeddings. We use these linguistic features in encoding models that relate stimulus properties to neural activity. Finally, we provide detailed tutorials for preprocessing raw data, extracting stimulus features, and running encoding analyses that can serve as a pedagogical resource or a springboard for new research.

neuroscience↗

Fast-timescale hippocampal processes bridge between slowly unfurling neocortical states during memory search

Prior behavioral work showed that event structure supports our ability to search through continuous naturalistic memories. We hypothesized that, neurally, this memory search process involves a division of labor between slowly unfurling neocortical states representing event knowledge and fast hippocampal-neocortical communication supporting retrieval of new information at transitions between events. In a sample of ten intracranial EEG patients we tracked slow neural state-patterns as patients viewed a movie and then searched their memories in a structured naturalistic interview. As patients answered questions ("after A, when does B happen next?"), state-patterns from movie-viewing were reinstated in neocortex. During the critical memory-search period, states unfurled in a forward direction, realizing a trajectory from A to B in memory. Punctate moments of state-transition during memory-search were marked by low-frequency power decreases in cortex and preceded by power decreases in hippocampus that correlated with reinstatement. Connectivity-analysis revealed information-flow from hippocampus to cortex underpinning state-transitions.

neuroscience↗

From single words to sentence production: Shared cortical representations but distinct temporal dynamics

Sentence production is the uniquely human ability to transform complex thoughts into strings of words. Despite the importance of this process, language production research has primarily focused on single words. However, it remains a largely untested assumption that the principles of word production generalize to more naturalistic utterances like sentences. Here, we investigate this using high-resolution neurosurgical recordings (ECoG) and an overt production experiment where patients produced six words in isolation (picture naming) and in sentences (scene description). We trained machine learning classifiers to identify the unique brain activity patterns for each word during picture naming, and used these patterns to decode which words patients were processing while they produced sentences. Our findings confirm that words share cortical representations across tasks, but reveal a division of labor within the language network. In sensorimotor cortex, words were consistently activated in the order in which they were said in the sentence. However, in inferior and middle frontal gyri (IFG and MFG), the order in which words were processed depended on the syntactic structure of the sentence. Deeper analysis of this pattern revealed a spatial code for representing a words position in the sentence, with subjects selectively encoded in IFG and objects in MFG. Finally, we argue that the processes we observe in prefrontal cortex may impose a subtle pressure on language evolution, explaining why nearly all the worlds languages position subjects before objects.

neuroscience↗

Temporal integration in human auditory cortex is predominantly yoked to absolute time, not structure duration

Sound structures such as phonemes and words have highly variable durations. Thus, there is a fundamental difference between integrating across absolute time (e.g., 100 ms) vs. sound structure (e.g., phonemes). Auditory and cognitive models have traditionally cast neural integration in terms of time and structure, respectively, but the extent to which cortical computations reflect time or structure remains unknown. To answer this question, we rescaled the duration of all speech structures using time stretching/compression and measured integration windows in the human auditory cortex using a new experimental/computational method applied to spatiotemporally precise intracranial recordings. We observed significantly longer integration windows for stretched speech, but this lengthening was very small ([~]5%) relative to the change in structure durations, even in non-primary regions strongly implicated in speech-specific processing. These findings demonstrate that time-yoked computations dominate throughout the human auditory cortex, placing important constraints on neurocomputational models of structure processing.

neuroscience↗

A low-activity cortical network selectively encodes syntax

Humans are the only species with the ability to systematically combine words to convey an unbounded number of complex meanings. This process is guided by combinatorial processes whose underlying neural mechanisms remain obscured by inherent limitations of non-invasive brain measures and a near total focus on comprehension paradigms. Here, we address these limitations with high-resolution neurosurgical recordings (electrocorticography) and a controlled sentence production experiment. We uncover distinct cortical networks encoding word-level and higher-order information. These networks exhibited a hybrid spatial organization: broadly distributed across traditional language areas, but with focal concentrations of sensitivity to semantic and structural contrasts in canonical language regions. In contrast to previous comprehension-based findings, we find that these networks are largely non-overlapping. Most strikingly, our data re-veal an unexpected property of higher-order linguistic information: it is encoded independent of neural activity levels. These results show that activity magnitude and information content are dissociable, with important implications for studying the neurobiology of language. Teaser"Brain recordings during speech reveal complex linguistic information throughout cortex, independent of neural activity levels."

neuroscience↗

Scale matters: Large language models with billions (rather than millions) of parameters better match neural representations of natural language

Recent research has used large language models (LLMs) to study the neural basis of naturalistic language processing in the human brain. LLMs have rapidly grown in complexity, leading to improved language processing capabilities. However, neuroscience researchers havent kept up with the quick progress in LLM development. Here, we utilized several families of transformer-based LLMs to investigate the relationship between model size and their ability to capture linguistic information in the human brain. Crucially, a subset of LLMs were trained on a fixed training set, enabling us to dissociate model size from architecture and training set size. We used electrocorticography (ECoG) to measure neural activity in epilepsy patients while they listened to a 30-minute naturalistic audio story. We fit electrode-wise encoding models using contextual embeddings extracted from each hidden layer of the LLMs to predict word-level neural signals. In line with prior work, we found that larger LLMs better capture the structure of natural language and better predict neural activity. We also found a logarithmic relationship where the encoding performance peaks in relatively earlier layers as model size increases. We also observed variations in the best-performing layer across different brain regions, corresponding to an organized language processing hierarchy.

neuroscience↗

ALIGNING BRAINS INTO A SHARED SPACE IMPROVES THEIR ALIGNMENT TO LARGE LANGUAGE MODELS

AO_SCPLOWBSTRACTC_SCPLOWRecent studies have shown that large language models (LLMs) can accurately predict neural activity measured using electrocorticography (ECoG) during natural language processing. To predict word-by-word neural activity, most prior work has estimated and evaluated encoding models within each electrode and subject--without evaluating how these models generalize across individual brains. In this paper, we analyze neural responses in 8 subjects while they listened to the same 30-minute podcast episode. We use a shared response model (SRM) to estimate a shared information space across subjects. We show that SRM significantly improves LLM-based encoding model performance. We also show that we can use this shared space to denoise the individual brain responses by projecting back into the individualized electrode space, and this process achieves a mean 38% improvement in encoding performance. The strongest improvement was observed for brain areas specialized for language comprehension, specifically in the superior temporal gyrus (STG) and inferior frontal gyrus (IFG). Critically, estimating a shared space allows us to construct encoding models that better generalize across individuals.

neuroscience↗

A left-lateralized dorsolateral prefrontal network for naming

The ability to connect the form and meaning of a concept, known as word retrieval, is fundamental to human communication. While various input modalities could lead to identical word retrieval, the exact neural dynamics supporting this process relevant to daily auditory discourse remain poorly understood. Here, we recorded neurosurgical electrocorticographic (ECoG) data from 48 patients and dissociated two key language networks that highly overlap in time and space critical for word retrieval. Using unsupervised temporal clustering techniques, we found a semantic processing network located in the middle and inferior frontal gyri. This network was distinct from an articulatory planning network in the inferior frontal and precentral gyri, which was invariant to input modalities. Functionally, we confirmed that the semantic processing network encodes word surprisal during sentence perception. These findings elucidate neurophysiological mechanisms underlying the processing of semantic auditory inputs ranging from passive language comprehension to conversational speech.

neuroscience↗

Subject-Agnostic Transformer-Based Neural Speech Decoding from Surface and Depth Electrode Signals

ObjectiveThis study investigates speech decoding from neural signals captured by intracranial electrodes. Most prior works can only work with electrodes on a 2D grid (i.e., Electrocorticographic or ECoG array) and data from a single patient. We aim to design a deep-learning model architecture that can accommodate both surface (ECoG) and depth (stereotactic EEG or sEEG) electrodes. The architecture should allow training on data from multiple participants with large variability in electrode placements and the trained model should perform well on participants unseen during training. ApproachWe propose a novel transformer-based model architecture named SwinTW that can work with arbitrarily positioned electrodes by leveraging their 3D locations on the cortex rather than their positions on a 2D grid. We train subject-specific models using data from a single participant and multi-patient models exploiting data from multiple participants. Main ResultsThe subject-specific models using only low-density 8x8 ECoG data achieved high decoding Pearson Correlation Coefficient with ground truth spectrogram (PCC=0.817), over N=43 participants, outperforming our prior convolutional ResNet model and the 3D Swin transformer model. Incorporating additional strip, depth, and grid electrodes available in each participant (N=39) led to further improvement (PCC=0.838). For participants with only sEEG electrodes (N=9), subject-specific models still enjoy comparable performance with an average PCC=0.798. The multi-subject models achieved high performance on unseen participants, with an average PCC=0.765 in leave-one-out cross-validation. SignificanceThe proposed SwinTW decoder enables future speech neuropros-theses to utilize any electrode placement that is clinically optimal or feasible for a particular participant, including using only depth electrodes, which are more routinely implanted in chronic neurosurgical procedures. Importantly, the generalizability of the multi-patient models suggests that such a model can be applied to new patients that do not have paired acoustic and neural data, providing an advance in neuroprostheses for people with speech disability, where acoustic-neural training data is not feasible.

neuroscience↗

A Genome-Wide Arrayed CRISPR Screen Reveals PLSCR1 as an Intrinsic Barrier to SARS-CoV-2 Entry

Interferons (IFNs) play a crucial role in the regulation and evolution of host-virus interactions. Here, we conducted a genome-wide arrayed CRISPR knockout screen in the presence and absence of IFN to identify human genes that influence SARS-CoV-2 infection. We then performed an integrated analysis of genes interacting with SARS-CoV-2, drawing from a selection of 67 large-scale studies, including our own. We identified 28 genes of high relevance in both human genetic studies of COVID-19 patients and functional genetic screens in cell culture, with many related to the IFN pathway. Among these was the IFN-stimulated gene PLSCR1. PLSCR1 did not require IFN induction to restrict SARS-CoV-2 and did not contribute to IFN signaling. Instead, PLSCR1 specifically restricted spike-mediated SARS-CoV-2 entry. The PLSCR1-mediated restriction was alleviated by TMPRSS2 over-expression, suggesting that PLSCR1 primarily restricts the endocytic entry route. In addition, recent SARS-CoV-2 variants have adapted to circumvent the PLSCR1 barrier via currently undetermined mechanisms. Finally, we investigate the functional effects of PLSCR1 variants present in humans and discuss an association between PLSCR1 and severe COVID-19 reported recently.

immunology↗

Closed-loop electrical stimulation to prevent focal epilepsy progression and long-term memory impairment

Interictal epileptiform discharges (IEDs) are ubiquitously expressed in epileptic networks and disrupt cognitive functions. It is unclear whether addressing IED-induced dysfunction could improve epilepsy outcomes as most therapeutics target seizures. We show in a model of progressive hippocampal epilepsy that IEDs produce pathological oscillatory coupling which is associated with prolonged, hypersynchronous neural spiking in synaptically connected cortex and expands the brain territory capable of generating IEDs. A similar relationship between IED-mediated oscillatory coupling and temporal organization of IEDs across brain regions was identified in human subjects with refractory focal epilepsy. Spatiotemporally targeted closed-loop electrical stimulation triggered on hippocampal IED occurrence eliminated the abnormal cortical activity patterns, preventing spread of the epileptic network and ameliorating long-term spatial memory deficits in rodents. These findings suggest that stimulation-based network interventions that normalize interictal dynamics may be an effective treatment of epilepsy and its comorbidities, with a low barrier to clinical translation. One-Sentence SummaryTargeted closed-loop electrical stimulation prevents spread of the epileptic network and ameliorates long-term spatial memory deficits.

neuroscience↗

eCV: Enhanced coefficient of variation and IDR extensions for reproducibility 1 assessment of high-throughput experiments with multiple replicates.

MotivationReproducibility assessment is essential in extracting reliable scientific insights from highthroughput experiments. Inconsistency between technical replicates poses a challenge, particularly clear in next generation sequencing technologies based on immunoprecipitations, where the assessment of reproducibility in peak identification is a critical analytical step. While the Irreproducibility Discovery Rate (IDR) method has been instrumental in assessing reproducibility, its standard implementation is constrained to handling only two replicates. In the current era of steadily growing sample sizes, eased by multiplexing and reduced sequencing costs, highly performing methods that handle any number of replicates are desirable. ResultsWe introduce three novel methods for reproducibility assessment in high-throughput data that handle an arbitrary number of replicates. The first, general IDR (gIDR), extends the standard IDR by adapting its Expectation-Maximization (EM) algorithm to handle distributions of any dimensions dictated by the number of replicates. The second, meta-IDR (mIDR), employs a meta-analysis approach, calculating local IDR scores for all pairs of replicates and combining them using standard probability rules. The third method introduces an "enhanced" Coefficient of Variation (eCV), ranking features based on intensity and variability, using a parametric bootstrap approach to obtain an index analogous to local IDR. Comparative analysis with traditional IDR in simulated and experimental data reveals the heightened performance of the proposed multivariate alternatives under varying scenarios, thereby addressing the critical challenge of reproducibility assessment in contemporary high-throughput experiments. Availability and implementationThe described methods are implemented as an R package: https://github.com/eclipsebio/eCV Contactinfo@eclipsebio.com

bioinformatics↗