Search bioRxiv⌕ Search

Biology subjects

Poldrack, R. A.

Publications and source records attributed to Poldrack, R. A..

At least 37 records · Page 2Linked to original sources

Neuroscout, a unified platform for generalizable and reproducible fMRI research

Functional magnetic resonance imaging (fMRI) has revolutionized cognitive neuroscience, but methodological barriers limit the generalizability of findings from the lab to the real world. Here, we present Neuroscout, an end-to-end platform for analysis of naturalistic fMRI data designed to facilitate the adoption of robust and generalizable research practices. Neuroscout leverages state-of-the-art machine learning models to automatically annotate stimuli from dozens of naturalistic fMRI studies, allowing researchers to easily test neuroscientific hypotheses across multiple ecologically-valid datasets. In addition, Neuroscout builds on a robust ecosystem of open tools and standards to provide an easy-to-use analysis builder and a fully automated execution engine that reduce the burden of reproducible research. Through a series of meta-analytic case studies, we validate the automatic feature extraction approach and demonstrate its potential to support more robust fMRI research. Owing to its ease of use and a high degree of automation, Neuroscout makes it possible to overcome modeling challenges commonly arising in naturalistic analysis and to easily scale analyses within and across datasets, democratizing generalizable fMRI research.

neuroscience↗

Discovering dynamical models of human behavior

Response time (RT) data collected from cognitive tasks are a cornerstone of psychology and neuroscience research, yet existing models of these data either make strong assumptions about the data generating process or are limited to modeling single trials. We introduce task-DyVA, a deep learning framework in which expressive dynamical systems are trained to reproduce sequences of RTs observed in data from individual human subjects. Models fitted to a large task-switching dataset captured subject-specific behavioral differences with high temporal precision, including task-switching costs. Through perturbation experiments and analyses of the models latent dynamics, we find support for a rational account of switch costs in terms of a stability-flexibility tradeoff. Thus, our framework can be used to discover interpretable cognitive theories that explain how the brain dynamically gives rise to behavior.

neuroscience↗

Moving Beyond Processing and Analysis-Related Variation in Neuroscience

When fields lack consensus standard methods and accessible ground truths, reproducibility can be more of an ideal than a reality. Such has been the case for functional neuroimaging, where there exists a sprawling space of tools and processing pipelines. We provide a critical evaluation of the impact of differences across five independently developed minimal preprocessing pipelines for functional MRI. We show that even when handling identical data, inter-pipeline agreement was only moderate, critically shedding light on a factor that limits cross-study reproducibility. We show that low inter-pipeline agreement mainly becomes appreciable when the reliability of the underlying data is high, which is increasingly the case as the field progresses. Crucially, we show that when inter-pipeline agreement is compromised, so too are the consistency of insights from brainwide association studies. We highlight the importance of comparing analytic configurations, as both widely discussed and commonly overlooked decisions can lead to marked variation.

neuroscience↗

Survey on Open Science Practices in Functional Neuroimaging

Replicability and reproducibility of scientific findings is paramount for sustainable progress in neuroscience. Preregistration of the hypotheses and methods of an empirical study before analysis, the sharing of primary research data, and compliance with data standards such as the Brain Imaging Data Structure (BIDS), are considered effective practices to secure progress and to substantiate quality of research. We investigated the current level of adoption of open science practices in neuroimaging and the difficulties that prevent researchers from using them. Email invitations to participate in the survey were sent to addresses received through a PubMed search of human functional magnetic resonance imaging studies between 2010 and 2020. 283 persons completed the questionnaire. Although half of the participants were experienced with preregistration, the willingness to preregister studies in the future was modest. The majority of participants had experience with the sharing of primary neuroimaging data. Most of the participants were interested in implementing a standardized data structure such as BIDS in their labs. Based on demographic variables, we compared participants on seven subscales, which had been generated through factor analysis. It was found that experienced researchers at lower career level had higher fear of being transparent, researchers with residence in the EU had a higher need for data governance, and researchers at medical faculties as compared to other university faculties reported a higher need for data governance and a more unsupportive environment. The results suggest growing adoption of open science practices but also highlight a number of important impediments.

scientific communication and education↗

Intracranial electrical stimulation alters meso-scale network integration as a function of network topology

Human brain dynamics are organized into a multi-scale network structure that contains multiple tight-knit, meso-scale communities. Recent work has demonstrated that many psychological capacities, as well as impairments in cognitive function secondary to damage, can be mapped onto organizing principles at this mesoscopic scale. However, we still dont know the rules that govern the dynamic interactions between regions that are constrained by the topology of the broader network. In this preregistered study, we utilized a unique human dataset in which whole brain BOLD-fMRI activity was recorded simultaneously with intracranial electrical stimulation, to characterize the effects of direct neural stimulation on the dynamic reconfiguration of the broader network. Direct neural stimulation increased the extent to which the stimulation sites own mesoscale community integrated with the rest of the brain. Further, we found that these network changes depended on the topological role of the stimulation site itself: stimulating regions with high participation coefficients led to global integration, whereas stimulating sites with low participation coefficients integrated that regions own community with the rest of the brain. These findings provide direct causal evidence for how network topology shapes and constrains inter-regional coordination, and suggest applications for targeted therapeutic interventions in patients with deep-brain stimulation.

neuroscience↗

Human es-fMRI Resource: Concurrent deep-brain stimulation and whole-brain functional MRI

Mapping the causal effects of one brain region on another (effective connectivity) is a challenging problem in neuroscience, since it requires invasive direct manipulation of brain function, together with whole-brain measurement of the effects produced. Here we establish a unique resource and present data from 26 human patients who underwent electrical stimulation during functional magnetic resonance imaging (es-fMRI). The patients had medically refractory epilepsy requiring surgically implanted intracranial electrodes in cortical and subcortical locations. One or multiple contacts on these electrodes were stimulated while simultaneously recording BOLD-fMRI activity in a block design. Multiple runs exist for patients with different stimulation sites. We describe the resource, data collection process, preprocessing using the fMRIPrep analysis pipeline and management of artifacts, and provide end-user analyses to visualize distal brain activation produced by site-specific electrical stimulation. The data are organized according to the brain imaging data structure (BIDS) specification, and are available for analysis or future dataset contributions on openneuro.org including both raw and preprocessed data.

neuroscience↗

A cautionary note on stop-signal data from the Adolescent Brain Cognitive Development study

The Adolescent Brain Cognitive Development (ABCD) study is an unprecedented longitudinal neuroimaging sample that tracks the brain development of over 10,000 9-10 year olds through adolescence. At the core of this study are the three tasks that are completed repeatedly within the MRI scanner, one of which is the stop-signal task. In analyzing the available stopping experimental code and data, we identified a set of design issues that we believe significantly compromise its value. These issues include but are not limited to: variable stimulus durations that violate basic assumptions of dominant stopping models, trials in which stimuli are incorrectly not presented, and faulty stop-signal delays. We present eight issues, show their effect on the existing ABCD data, suggest prospective solutions including task changes for future data collection and preliminary computational models, and suggest retrospective solutions for data users who wish to make the most of the existing data.

neuroscience↗

Reward learning and working memory: effects of massed versus spaced training and post-learning delay period

Neuroscience research has illuminated the mechanisms supporting learning from reward feedback, demonstrating a critical role for the striatum and midbrain dopamine system. However, in humans, short-term working memory that is dependent on frontal and parietal cortices can also play an important role, particularly in commonly-used paradigms in which learning is relatively condensed in time. Given the growing use of reward-based learning tasks in translational studies in computational psychiatry, it is important to understand the degree of working memory contributions and whether gradual learning mechanisms can be better isolated. In our experiments, we manipulated the spacing between repetitions along with a post-learning delay preceding a test phase. We found that learning was slower for stimuli repeated after a long delay (spaced-trained) compared to those repeated immediately (massed-trained), likely reflecting the remaining contribution of feedback learning mechanisms when working memory is not available. Brief interruptions of massed learning led to drops in subsequent performance. Further, individual differences in working memory capacity positively correlated with massed learning performance. Critically, after a delay period but not immediately, relative preferences decayed in the massed condition and increased in the spaced condition. Overall, our results provide additional support for a large role of working memory in reward-based learning in temporally condensed designs. We suggest that spacing training within or between sessions is a promising approach to better isolate and understand mechanisms supporting gradual reward-based learning, with particular importance for understanding potential learning dysfunctions in addiction and psychiatric disorders.

neuroscience↗

Variability in the analysis of a single neuroimaging dataset by many teams

Data analysis workflows in many scientific domains have become increasingly complex and flexible. To assess the impact of this flexibility on functional magnetic resonance imaging (fMRI) results, the same dataset was independently analyzed by 70 teams, testing nine ex-ante hypotheses. The flexibility of analytic approaches is exemplified by the fact that no two teams chose identical workflows to analyze the data. This flexibility resulted in sizeable variation in hypothesis test results, even for teams whose statistical maps were highly correlated at intermediate stages of their analysis pipeline. Variation in reported results was related to several aspects of analysis methodology. Importantly, meta-analytic approaches that aggregated information across teams yielded significant consensus in activated regions across teams. Furthermore, prediction markets of researchers in the field revealed an overestimation of the likelihood of significant findings, even by researchers with direct knowledge of the dataset. Our findings show that analytic flexibility can have substantial effects on scientific conclusions, and demonstrate factors related to variability in fMRI. The results emphasize the importance of validating and sharing complex analysis workflows, and demonstrate the need for multiple analyses of the same data. Potential approaches to mitigate issues related to analytical variability are discussed.

neuroscience↗

Dataset Decay: the problem of sequential analyses on open datasets

Open data has two principal uses: (i) to reproduce original findings and (ii) to allow researchers to ask new questions with existing data. The latter enables discoveries by allowing a more diverse set of viewpoints and hypotheses to approach the data, which is self-evidently advantageous for the progress of science. However, if many researchers reuse the same dataset, multiple statistical testing may increase false positives in the literature. Current practice suggests that the number of tests to be corrected is the number of simultaneous tests performed by a researcher. Here we demonstrate that sequential hypothesis testing on the same dataset by multiple researchers can inflate error rates. This finding is troubling because, as more researchers embrace an open dataset, the likelihood of false positives (i.e. type I errors) will increase. Thus, we should expect a datasets utility for discovering new true relations between variables to decay. We consider several sequential correction procedures. These solutions can reduce the number of false positives but, at the same time, can prompt undesired challenges to open data (e.g. incentivising restricted access).

bioinformatics↗

A computational knowledge engine for human neuroscience

Functional neuroimaging has been a mainstay of human neuroscience for the past 25 years. The goal for this research has largely been to understand how activity across brain structures relates to mental constructs and computations. However, interpretation of fMRI data has often occurred within knowledge frameworks crafted by experts, which have the potential to reify historical trends and amplify the subjective biases that limit the replicability of findings. 1 In other words, we lack a comprehensive data-driven ontology for structure-function mapping in the human brain, through which we can also test the explanatory value of current dominant conceptual frameworks. Ontologies in other fields are popular tools for automated data synthesis,2, 3 yet relatively few attempts have been made to engineer ontologies in a data-driven manner.4 Here, we employ a computational approach to derive a data-driven ontology for neurobiological domains that synthesizes the texts and data of nearly 20,000 human neuroimaging articles. The data-driven ontology includes 6 domains, each defined by a circuit of brain structures and its associated mental functions. Several of these domains are omitted from the leading framework in neuroscience, while others uncover novel combinations of mental functions related to common brain circuitry. Crucially, the structure-function links in each domain better replicate across articles in held-out data than those mapped from the dominant frameworks in neuroscience and psychiatry. We further show that the data-driven ontology partitions the literature into modular subfields, for which the domains serve as generalizable archetypes of the structure-function patterns observed in single articles. The approach to computational ontology we present here is the most comprehensive functional characterization of human brain circuits quantifiable with fMRI. Moreover, our methods can be extended to synthesize other scientific literatures, yielding ontologies that are built up from the data of the field.

neuroscience↗

Analysis of task-based functional MRI data preprocessed with fMRIPrep

Functional magnetic resonance imaging (fMRI) is a standard tool to investigate the neural correlates of cognition. fMRI noninvasively measures brain activity, allowing identification of patterns evoked by tasks performed during scanning. Despite the long history of this technique, the idiosyncrasies of each dataset have led to the use of ad-hoc preprocessing protocols customized for nearly every different study. This approach is time-consuming, error-prone, and unsuitable for combining datasets from many sources. Here we showcase fMRIPrep (http://fmriprep.org), a robust tool to prepare human fMRI data for statistical analysis. This software instrument addresses the reproducibility concerns of the established protocols for fMRI preprocessing. By leveraging the Brain Imaging Data Structure (BIDS) to standardize both the input datasets --MRI data as stored by the scanner-- and the outputs --data ready for modeling and analysis--, fMRIPrep is capable of preprocessing a diversity of datasets without manual intervention. In support of the growing popularity of fMRIPrep, this protocol describes how to integrate the tool in a task-based fMRI investigation workflow.

bioinformatics↗

Time-varying nodal measures with temporal community structure: a cautionary note to avoid misquantification

In network neuroscience, temporal network models have gained popularity. In these models, network properties have been related to cognition and behaviour. Here we demonstrate that calculating nodal properties that are dependent on temporal community structure (such as the participation coefficient) in time-varying contexts can potentially lead to misleading results. Specifically, with regards to the participation coefficient, increases in integration can be inferred when the opposite is occuring. Further, we present a temporal extension to the participation coefficient measure (temporal participation coefficient) that circumnavigates this problem by jointly considering all community partitions assigned to a node through time. The proposed method allows us to track a nodes integration through time while adjusting for the possible changes in the community structure of the overall network.

neuroscience↗

Somatosensory-Motor Dysconnectivity Spans Multiple Transdiagnostic Dimensions of Psychopathology

BackgroundThere is considerable interest in a dimensional transdiagnostic approach to psychiatry. Most transdiagnostic studies have derived factors based only on clinical symptoms, which might miss possible links between psychopathology, cognitive processes and personality traits. Furthermore, many psychiatric studies focus on higher-order association brain networks, thus neglecting the potential influence of huge swaths of the brain.\n\nMethodsA multivariate data-driven approach (partial least squares; PLS) was utilized to identify latent components linking a large set of clinical, cognitive and personality measures to whole-brain resting-state functional connectivity (RSFC) patterns across 224 participants. The participants were either healthy (N=110) or diagnosed with bipolar disorder (N=40), attention-deficit/hyperactivity disorder (N=37), schizophrenia (N=29) or schizoaffective disorder (N=8). In contrast to traditional case-control analyses, the diagnostic categories were not utilized in the PLS analysis, but were helpful for interpreting the components.\n\nResultsOur analyses revealed three latent components corresponding to general psychopathology, cognitive dysfunction and impulsivity. Each component was associated with a unique whole-brain RSFC signature and shared across all participants. The components were robust across multiple control analyses and replicated using independent task functional magnetic resonance imaging data from the same participants. Strikingly, all three components featured connectivity alterations within the somatosensory-motor network, and its connectivity with subcortical structures and cortical executive networks.\n\nConclusionsWe identified three distinct dimensions with dissociable (but overlapping) whole-brain RSFC signatures across healthy individuals and individuals with psychiatric illness, providing potential intermediate phenotypes that span across diagnostic categories. Our results suggest expanding the focus of psychiatric neuroscience beyond higher-order brain networks.

neuroscience↗

The identification of temporal communities through trajectory clustering correlates with single-trial behavioural fluctuations in neuroimaging data

Interacting sets of nodes and fluctuations in their interaction are important properties of a dynamic network system. In some cases the edges reflecting these interactions are directly quantifiable from the data collected. However, in many cases (such as functional magnetic resonance imaging (fMRI) data), the edges must be inferred from statistical relations between the nodes. Here we present a new method, Temporal Communities through Trajectory Clustering (TCTC), that derives time-varying communities directly from time-series data collected from the nodes in a network. First, we verify TCTC on resting and task fMRI data by showing that time-averaged results correspond with expected static connectivity results. We then show that the time-varying communities correlate and predict single-trial behaviour. This new perspective on temporal community detection of node-collected data identifies robust communities revealing ongoing spatiotemporal community configurations during task performance.

neuroscience↗

Symptom Severity in Youths with Attention Deficit Hyperactivity Disorder Associated with Normalizing Effects of Treatment on fMRI Response during a Stop Signal Task

Inhibitory control deficits represent one of many core cognitive deficits in Attention-Deficit/Hyperactivity Disorder (ADHD). Neuroimaging studies suggest that individuals with ADHD exhibit atypical engagement of neural systems during response inhibition, but the exact nature of this phenotype is obscured by mixed findings. We tested whether drug-free youths with ADHD (n=30, ages 7-14 years, 10 female) exhibited atypical neural correlates of response inhibition, as measured with a stop signal task and fMRI, compared to matched controls. We next investigated medication effects and whether there was a relationship between symptom severity and medication effects on the fMRI-evaluated signal. Finally, we tested for a significant difference between effects of monotherapy and combined pharmacological treatment. Patients showed significantly slower stop signal response time and lower percent inhibition, but no significant differences in the neural correlates of response inhibition relative to controls. However, patients showed significantly elevated signal in frontostriatal regions during responses. Prefrontal signal in patients was positively associated with reaction time variability in patients, and change (medicated - drug free) in the prefrontal signal was significantly associated with symptom scores, such that patients with elevated symptoms had greater BOLD signal reduction following treatment. Medication significantly improved go response time median and variability as well as stop signal reaction time, but there were no significant effects of medication or treatment type on BOLD signal. These findings challenge the notion of frontostriatal hypoactivation during response inhibition as a biomarker for ADHD and suggest that symptom severity may be associated with response to medication.

neuroscience↗

Transitions in brain-network level information processing dynamics are driven by alterations in neural gain

A key component of the flexibility and complexity of the brain is its ability to dynamically adapt its functional network structure between integrated and segregated brain states depending on the demands of different cognitive tasks. Integrated states are prevalent when performing tasks of high complexity, such as maintaining items in working memory, consistent with models of a global workspace architecture. Recent work has suggested that the balance between integration and segregation is under the control of ascending neuromodulatory systems, such as the noradrenergic system. In a previous large-scale nonlinear oscillator model of neuronal network dynamics, we showed that manipulating neural gain led to a critical transition in phase synchrony that was associated with a shift from segregated to integrated topology, thus confirming our original prediction. In this study, we advance these results by demonstrating that the gain-mediated phase transition is characterized by a shift in the underlying dynamics of neural information processing. Specifically, the dynamics of the subcritical (segregated) regime are dominated by information storage, whereas the supercritical (integrated) regime is associated with increased information transfer (measured via transfer entropy). Operating near to the critical regime with respect to modulating neural gain would thus appear to provide computational advantages, offering flexibility in the information processing that can be performed with only subtle changes in gain control. Our results thus link studies of whole-brain network topology and the ascending arousal system with information processing dynamics, and suggest that the constraints imposed by the ascending arousal system constrain low-dimensional modes of information processing within the brain.\n\nAuthor summaryHigher brain function relies on a dynamic balance between functional integration and segregation. Previous work has shown that this balance is mediated in part by alterations in neural gain, which are thought to relate to projections from ascending neuromodulatory nuclei, such as the locus coeruleus. Here, we extend this work by demonstrating that the modulation of neural gain alters the information processing dynamics of the neural components of a biophysical neural model. Specifically, we find that low levels of neural gain are characterized by high Active Information Storage, whereas higher levels of neural gain are associated with an increase in inter-regional Transfer Entropy. Our results suggest that the modulation of neural gain via the ascending arousal system may fundamentally alter the information processing mode of the brain, which in turn has important implications for understanding the biophysical basis of cognition.

neuroscience↗