Test-Retest Reliability and repeatability of Behavioral and Electrophysiological Markers in an Eriksen Flanker Task

Bogdanov, M.; Scott, J. N.; Esfand, S. M.; Boyle, B. W.; Lees, T.; Li, M.; Woronko, S. E.; Linton, S. R.; Miller, C.; Li, S.; Bolton, P.; Meisner, R. C.; Pizzagalli, D. A.

doi:10.1101/2024.09.28.615624

bioRxiv · 10.1101/2024.09.28.615624

Test-Retest Reliability and repeatability of Behavioral and Electrophysiological Markers in an Eriksen Flanker Task

Bogdanov, M.·Scott, J. N.·Esfand, S. M.·Boyle, B. W.·Lees, T.·Li, M.·Woronko, S. E.·Linton, S. R.·Miller, C.·Li, S.·Bolton, P.·Meisner, R. C.·Pizzagalli, D. A.

View original source ↗Export metadata ↓

Abstract

Cognitive control processes, specifically interference control and error monitoring, are often impaired across neuropsychiatric disorders and have been proposed as transdiagnostic markers of psychopathology and important treatment targets. Accurately probing them, however, requires understanding the psychometric properties of the measures used to assess cognitive control, including their intra- and interindividual stability over time. Using an Eriksen Flanker Task, we tested behavioral and electrophysiological readouts of cognitive control in 36 healthy individuals (26 female, 10 male, M age{+/-}SD=33.18{+/-}14.49, range=19-68) and evaluated their test-retest reliability across 48 hours by calculating Pearson correlations and Intraclass Correlation Coefficients (ICCs) to assess group-level stability. Moreover, we assessed repeatability through Coefficients of Variation (CVs) and Bland-Altman statistics, to investigate the degree of change in participants absolute scores. We found satisfactory-to-excellent test-retest reliability for most cognitive control measures, with condition-specific metrics generally being more reliable than difference scores. Regarding repeatability, we observed considerable intraindividual variability in absolute scores over time, which differed widely between participants. These results demonstrate that measurements of cognitive control may display substantial intraindividual variability across sessions despite demonstrating high test-retest reliability and vice versa. Our findings expand the current literature by providing novel information about the stability of behavioral and physiological markers of cognitive control over time. Moreover, they may have important implications for the application and evaluation of clinical interventions by highlighting the usefulness of considering repeatability measures in addition to the more commonly reported test-retest reliability metrics, when tracking changes over time in clinically relevant processes within single individuals.

Explore related subjects

neuroscience Preprint

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Bogdanov, M., Scott, J. N., Esfand, S. M., Boyle, B. W., Lees, T., Li, M., Woronko, S. E., Linton, S. R., Miller, C., Li, S., Bolton, P., Meisner, R. C., Pizzagalli, D. A.. 2024-09-30. Test-Retest Reliability and repeatability of Behavioral and Electrophysiological Markers in an Eriksen Flanker Task. https://doi.org/10.1101/2024.09.28.615624

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

CoReg, tracking-based motion compensation for in vivo calcium imaging

In vivo calcium imaging enables the observation of neural activity with high spatial and temporal resolution. However, recordings are frequently affected by motion artifacts caused by animal movement, physiological processes, tissue drift, or instability of the imaging setup. These artifacts make signal extraction harder and reduce the consistency of downstream analyses. Current registration methods can correct rigid and non-rigid motion, but often estimate motion from individual frames or image patches and make limited use of temporal information. In addition, activity-driven fluorescence changes can make it difficult to distinguish changes in image appearance from actual motion. Here, we treat motion correction in calcium imaging as a point tracking problem and introduce CoReg, an open-source Python- based software tool with a graphical user interface. We benchmark CoReg against established registration methods using fluorescence imaging datasets from multiple species. CoReg performs competitively with or better than existing approaches across several settings. We further show that its performance is robust to the choice of tracked points, making the method straightforward to apply. CoReg includes implementations of both our method and the evaluated established methods. Our results show that tracking-based registration provides a simple and reliable approach for motion correction in vivo calcium imaging.

neuroscience↗

bioRxiv2026

A shared slowing axis and phenotype-specific rhythms link clinical EEG to FDG-PET dementia phenotypes

Early and accurate identification of neurodegenerative disorders has notable implications for treatment and quality of life. Whereas neuroimaging-based biomarkers can accurately identify neurodegenerative subtypes, EEG represents a low-cost alternative that could expand access to dementia care. Here, we investigated whether six data-driven EEG latent factors, derived by nonnegative tensor decomposition of clinical EEGs, differ systematically across FDG-PET-defined neurodegenerative phenotypes. In 455 patients with EEG and FDG-PET acquired within one year of each other, factor expression was compared across 14 diagnostic classes assigned by StateViewer, a validated artificial intelligence framework for FDG-PET interpretation. To separate disease-general severity from phenotype-specific topography, each factor was also regressed on a subject-level slowing index. Finally, we related the factors to regional FDG uptake and to neuropsychological performance (n = 98) and assessed their potential utility for single-subject classification. Four factors reflecting neurophysiological oscillations (posterior alpha, Rolandic beta, frontotemporal delta-theta and posterior theta-slow alpha) varied significantly across phenotypes, with attenuation of faster and augmentation of slower rhythms most pronounced in dementia with Lewy bodies (DLB), dysexecutive Alzheimer disease (AD) and posterior cortical atrophy, whereas factors dominated by eye-movement and muscle artifact showed no robust phenotypic association. Alpha and beta effects were largely attributable to overall slowing, whereas posterior theta-slow alpha became more phenotype-specific after adjustment (eta-squared 0.082 to 0.147), dissociating the Alzheimer disease spectrum from frontotemporal syndromes. The slowing index tracked with an FDG-PET pattern highly associated with DLB across the cohort, irrespective of assigned phenotype (r = 0.51, P < 0.001). Consistent with a model in which dementia phenotypes reflect altered hippocampal-neocortical oscillatory coupling (stochastic latent oscillatory diffusion), frontotemporal delta-theta tracked a limbocortical axis of metabolic pattern expression, rising with neocortical and falling with limbic-predominant involvement, independent of overall slowing and phenotype. Each factor mapped onto a distinct metabolic topography, with frontotemporal delta-theta resembling Alzheimer-type hypometabolism and posterior theta-slow alpha the medial occipital hypometabolism of DLB. In terms of neuropsychological performance, Rolandic beta was associated with executive functions, and frontotemporal delta-theta with memory, visuospatial and global performance. Using these four factors alone, an exploratory logistic regression classifier separated cognitively unimpaired participants from DLB, posterior cortical atrophy, typical AD, and dysexecutive AD (area under the curve > 0.8) but poorly discriminated frontotemporal dementia phenotypes canonically associated with 4-repeat tau. Thus, data-driven decomposition of clinical EEG separates oscillatory activity from artifact into factors that track metabolic phenotype, regional metabolism and cognition, capturing both overall slowing and phenotype-specific patterns. This work informs the further development of scalable, biology-informed EEG-based phenotyping of neurodegenerative disease.

neuroscience↗

bioRxiv2026

An application of fNIRS for the prediction of hearing thresholds in sleeping infants: a proof of principle

This study applied a two-component-response modelling approach to fNIRS recordings obtained from naturally sleeping infants presented with auditory stimuli at different sound intensities. We investigated whether the relationship between fNIRS response measures and stimulus intensity could be modelled to estimate individual auditory hearing thresholds. In the normal-hearing group, 75% of infants had threshold estimates for the sound /ba/ within the expected normal-hearing range, with an estimated mean equivalent normal loudness (ENL) of 10.72 dB HL (SD 8.64 dB HL). A case study further explored the potential application of this approach in an infant with hearing impairment, highlighting the importance of reliable responses at lower stimulus intensities and appropriate regression model selection. These findings provide preliminary evidence that cortical haemodynamic responses can be quantitatively related to sound intensity for estimating auditory sensitivity.

neuroscience↗