ASAP: An automatic sustained attention prediction method for infants and toddlers using wearable device signals

Zhang, Y.; Martinez-Cedillo, P. A.; Mason, H. T.; Vuong, Q. C.; Garcia-de-Soria, M. C.; Mullineaux, D. R.; Knight, M. I.; Geangu, E.

doi:10.1101/2024.11.16.623211

bioRxiv · 10.1101/2024.11.16.623211

ASAP: An automatic sustained attention prediction method for infants and toddlers using wearable device signals

Zhang, Y.·Martinez-Cedillo, P. A.·Mason, H. T.·Vuong, Q. C.·Garcia-de-Soria, M. C.·Mullineaux, D. R.·Knight, M. I.·Geangu, E.

View original source ↗Export metadata ↓

Abstract

Sustained attention (SA) is a critical cognitive ability that emerges in infancy. The recent development of wearable technology for infants enables the collection of large-scale multimodal data in the natural environment, including physiological signals. To capitalize on these new technologies, psychologists need methods to efficiently extract valid and robust SA measures from large datasets. In this study, we present an innovative automatic sustained attention prediction (ASAP) method that harnesses electrocardiogram (ECG) and accelerometer (Acc) signals recorded with wearable sensors from 75 infants (6-, 9-, 12-, 24- and 36-months). Infants undertook various naturalistic tasks similar to those encountered in their natural environment, including free play with their caregivers. Annotated SA was validated by fixation signals from eye-tracking. ASAP was trained on temporal and spectral features derived from the ECG and Acc signals to detect attention periods, and tested against human-coded SA. ASAPs performance is similar across all age groups, demonstrating its suitability for studying development. We also investigated the relationship between attention periods and low-level perceptual features (visual saliency, visual clutter) extracted from the egocentric videos recorded during caregiver-infant free play. Saliency increased during attention vs inattention periods and decreased with age for attention (but not inattention) periods. Crucially, there was no observable difference in results from ASAP attention detection relative to the human-coded attention. Our results demonstrate that ASAP is a powerful tool for detecting infant SA elicited in natural environments. Alongside the available wearable sensors, ASAP provides unprecedented opportunities for studying infant development in the wild.

Source connections

Published article ↗

Explore related subjects

neuroscience Preprint

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Zhang, Y., Martinez-Cedillo, P. A., Mason, H. T., Vuong, Q. C., Garcia-de-Soria, M. C., Mullineaux, D. R., Knight, M. I., Geangu, E.. 2024-11-17. ASAP: An automatic sustained attention prediction method for infants and toddlers using wearable device signals. https://doi.org/10.1101/2024.11.16.623211

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

A Mechanistic Account of Dedifferentiation in the Aging Visual System

To uncover the mechanisms of age-related dedifferentiation, we simulated neural degradation in a computational model of the ventral visual stream. Severing connections or adding noise, whether in inferotemporal cortex (IT) or upstream, reduced IT differentiation, indicating that dedifferentiation need not originate locally. Degrading peripheral V1, which preferentially drove place-selective IT neurons, selectively reduced place differentiation, a candidate mechanism for the stronger place dedifferentiation reported in aging.

neuroscience↗

bioRxiv2026

Reusing pipettes in Patch-seq: a foundation for automated multimodal profiling

Patch-seq is a technique for single-cell multimodal characterization. It combines whole-cell electrophysiology, single-cell transcriptomics, and morphological reconstruction in single neurons. Patch-seq morphologies are a critical bridge among cell types, genes, physiology, and large-scale connectivity platforms such as EM connectomes and single-cell-resolution projectomes. However, patch-seq experimental complexity and operator dependence limit throughput. Automation could enable scalable Patch-seq but requires procedural adaptations, including detergent-based pipette cleaning, robotic nucleus extraction and collection. The impact of these automations on Patch-seq quality has not been systematically evaluated. Here, we show that each of these modifications preserves or improves key Patch-seq outcomes. Automated nucleus extraction performs comparably to, or better than, expert manual operation, preserving key RNA and morphological metrics. Detergent-cleaned, reused pipettes supported a viable sealing success rate across multiple cleaning cycles and preserved electrophysiological quality and transcriptomic yield without introducing excess contamination. Sonication effectively allows collection of nuclear material without damaging RNA and supports subsequent pipette cleaning and reuse. Enhanced automated sealing and break-in procedures increased throughput regardless of brain region, cell type or species. Together, these results validate the core procedural adaptations required for automated Patch-seq and establish a foundation for high-throughput, standardized multimodal single-cell characterization.

neuroscience↗

bioRxiv2026

Development of direction selectivity in the Xenopus tadpole optic tectum and midbrain tegmentum

Detecting motion direction is a fundamental function performed by direction selective (DS) neurons. DS neurons in the optic tectum (superior colliculus in mammals) enable the tracking of moving objects. DS neurons of the accessory optic system support reflexive eye / head movements that stabilize gaze during self-motion. By developmental stage 48 (10 days postfertilization), Xenopus tadpoles display visually guided behaviors that require both types of DS neurons. Our previous work has shown that these two regions are not only functionally distinct but also follow different developmental programs. Here we characterized and compared how direction selectivity develops in both visual processing centers. Using in vivo electrophysiological recordings during moving bar visual stimulation, we measured DS synaptic inputs and spiking outputs in both regions across three key developmental stages of the retinotectal projection. Tegmental neurons were direction selective ab initio, and both input and output tuning remained stable across development. Tectal neurons were observed to receive DS inputs early, and their input selectivity also remained stable across development. However, their spiking output grew substantially more DS at the later developmental stage. This was due at least in part to a naturally occurring decrease in intrinsic excitability which preferentially dampened overall spike rates, but especially in response to the non-preferred direction of motion, thereby increasing direction selectivity. These results reveal distinct developmental trajectories in parallel visual pathways. Tegmental direction selectivity is established early and stays stable, whereas tectal output tuning sharpens during development through a decrease in intrinsic excitability.

neuroscience↗