Search bioRxiv⌕ Search

Biology subjects

Kabotyanski, K.

Publications and source records attributed to Kabotyanski, K..

3 recordsLinked to original sources

Estimation of neuronal tuning for word meaning from passively recorded naturalistic speech

The ability to derive neural-level language coding models holds great scientific and clinical potential. Current approaches are limited by the scale and ethological validity of input data; applications requiring large, rare, or naturalistic samples in particular would benefit from the ability to infer neural coding from incidental everyday speech. Here we present a novel pipeline designed to leverage spontaneous and incidental naturalistic speech. This pipeline performs transcription, segmentation, and video-assisted diarization, as well as alignment and spike detection of neural data. We apply this pipeline to a dataset derived from 21 patients (6+ days each, over 800 hours and 5 million words total). We benchmark both encoding and decoding models against extensive and rare ground-truth control datasets consisting of human-curated word-level temporal alignment and manually sorted spikes. We further validate our approach by quantifying representational drift, effect of dataset size, and differences between six brain areas. Together, these findings demonstrate that incidental natural speech is sufficiently processed in the brain to enable the estimation neural-level embeddings.

neuroscience↗

Mirror manifolds: partially overlapping neural subspaces for speaking and listening

We utilize internal representations of meaning for two purposes: to understand the words we hear and to generate our own speech. This dual requirement necessitates abstract, modality-agnostic representations. Building on work identifying it as a hub for relational mapping, we hypothesized that the hippocampus supports abstract, cross-person representations, and uses shared semantic geometries to do so. We tested this hypothesis by examining hippocampal activity in a remarkable single-neuron dataset derived from conversational speech. Neurons robustly encoded meanings of both spoken and heard words, and used common geometric embeddings for both, leading to abstract meaning performance. Speaker identity was aligned with meaning via partial subspace alignment, which affords speaker-meaning binding by partitioning meaning by speaker while maintaining cross-speaker generalization. Degrees of subspace rotation varied on a single word level and depended systematically on semantic category. Together, these findings indicate how geometric principles allow for abstract cross-personal meanings while preserving binding to speaker identity.

neuroscience↗

The Healthy Brain Network Biobank: An open resource for transdiagnostic research in pediatric mental health and learning disorders

Technological and methodological innovations are equipping researchers with unprecedented capabilities for detecting and characterizing pathologic processes in the developing human brain. As a result, ambitions to achieve clinically useful tools to assist in the diagnosis and management of mental health and learning disorders are gaining momentum. To this end, it is critical to accrue large-scale multimodal datasets that capture a broad range of commonly encountered clinical psychopathology. The Child Mind Institute has launched the Healthy Brain Network (HBN), an ongoing initiative focused on creating and sharing a biobank of data from 10,000 New York area participants (ages 5-21). The HBN Biobank houses data about psychiatric, behavioral, cognitive, and lifestyle phenotypes, as well as multimodal brain imaging (resting and naturalistic viewing fMRI, diffusion MRI, morphometric MRI), electroencephalography, eye-tracking, voice and video recordings, genetics, and actigraphy. Here, we present the rationale, design and implementation of HBN protocols. We describe the first data release (n = 664) and the potential of the biobank to advance related areas (e.g., biophysical modeling, voice analysis).

neuroscience↗