A high-performance brain-sentence communication designed for logosyllabic language

Feng, C.; Cao, L.; Wu, D.; Zhang, E.; Wang, T.; Jiang, X.; Ding, H.; Zhou, C.; Chen, J.; Wu, H.; Lin, S.; Hou, Q.; Zhu, J.; Yang, J.; Sawan, M.; Zhang, Y.

doi:10.1101/2023.11.05.562313

bioRxiv · 10.1101/2023.11.05.562313

A high-performance brain-sentence communication designed for logosyllabic language

Feng, C.·Cao, L.·Wu, D.·Zhang, E.·Wang, T.·Jiang, X.·Ding, H.·Zhou, C.·Chen, J.·Wu, H.·Lin, S.·Hou, Q.·Zhu, J.·Yang, J.·Sawan, M.·Zhang, Y.

View original source ↗Export metadata ↓

Abstract

Many severe neurological diseases, such as stroke and amyotrophic lateral sclerosis, can impair or destroy the ability of verbal communication. Recent advances in brain-computer interfaces (BCIs) have shown promise in restoring communication by decoding neural signals related to speech or motor activities into text. Existing research on speech neuroprosthesis has predominantly focused on alphabetic languages, leaving a significant gap of logosyllabic languages such as Mandarin Chinese which are spoken by more than 15% of the world population. Logosyllabic languages pose unique challenges to brain-to-text decoding due to extended character sets (e.g., 50,000+ for Mandarin Chinese) and complex mapping between characters and pronunciation. To address these challenges, we established a speech BCI designed for Mandarin, decoding speech-related stereoelectroencephalography (sEEG) signals into coherent sentences. We leverage the unique acoustic features of Mandarin Chinese syllables, constructing prediction models for syllable components (initials, tones, and finals), and employ a language model to resolve pronunciation to character ambiguities according to the semantic context. This method leads to a high-performance decoder with a median character accuracy of 71.00% over the full character set, demonstrating huge potentials for clinical application. To our knowledge, we are the first to report brain-to-sentence decoding for logosyllabic languages over full character set with a large intracranial electroencephalography dataset.

Source connections

Published article ↗

Explore related subjects

neuroscience Preprint

Keep this discovery

Explore connections, maps & timelines

BibTeX RIS

Feng, C., Cao, L., Wu, D., Zhang, E., Wang, T., Jiang, X., Ding, H., Zhou, C., Chen, J., Wu, H., Lin, S., Hou, Q., Zhu, J., Yang, J., Sawan, M., Zhang, Y.. 2023-11-05. A high-performance brain-sentence communication designed for logosyllabic language. https://doi.org/10.1101/2023.11.05.562313

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related preprints

bioRxiv2026

A Mechanistic Account of Dedifferentiation in the Aging Visual System

To uncover the mechanisms of age-related dedifferentiation, we simulated neural degradation in a computational model of the ventral visual stream. Severing connections or adding noise, whether in inferotemporal cortex (IT) or upstream, reduced IT differentiation, indicating that dedifferentiation need not originate locally. Degrading peripheral V1, which preferentially drove place-selective IT neurons, selectively reduced place differentiation, a candidate mechanism for the stronger place dedifferentiation reported in aging.

neuroscience↗

bioRxiv2026

Reusing pipettes in Patch-seq: a foundation for automated multimodal profiling

Patch-seq is a technique for single-cell multimodal characterization. It combines whole-cell electrophysiology, single-cell transcriptomics, and morphological reconstruction in single neurons. Patch-seq morphologies are a critical bridge among cell types, genes, physiology, and large-scale connectivity platforms such as EM connectomes and single-cell-resolution projectomes. However, patch-seq experimental complexity and operator dependence limit throughput. Automation could enable scalable Patch-seq but requires procedural adaptations, including detergent-based pipette cleaning, robotic nucleus extraction and collection. The impact of these automations on Patch-seq quality has not been systematically evaluated. Here, we show that each of these modifications preserves or improves key Patch-seq outcomes. Automated nucleus extraction performs comparably to, or better than, expert manual operation, preserving key RNA and morphological metrics. Detergent-cleaned, reused pipettes supported a viable sealing success rate across multiple cleaning cycles and preserved electrophysiological quality and transcriptomic yield without introducing excess contamination. Sonication effectively allows collection of nuclear material without damaging RNA and supports subsequent pipette cleaning and reuse. Enhanced automated sealing and break-in procedures increased throughput regardless of brain region, cell type or species. Together, these results validate the core procedural adaptations required for automated Patch-seq and establish a foundation for high-throughput, standardized multimodal single-cell characterization.

neuroscience↗

bioRxiv2026

Development of direction selectivity in the Xenopus tadpole optic tectum and midbrain tegmentum

Detecting motion direction is a fundamental function performed by direction selective (DS) neurons. DS neurons in the optic tectum (superior colliculus in mammals) enable the tracking of moving objects. DS neurons of the accessory optic system support reflexive eye / head movements that stabilize gaze during self-motion. By developmental stage 48 (10 days postfertilization), Xenopus tadpoles display visually guided behaviors that require both types of DS neurons. Our previous work has shown that these two regions are not only functionally distinct but also follow different developmental programs. Here we characterized and compared how direction selectivity develops in both visual processing centers. Using in vivo electrophysiological recordings during moving bar visual stimulation, we measured DS synaptic inputs and spiking outputs in both regions across three key developmental stages of the retinotectal projection. Tegmental neurons were direction selective ab initio, and both input and output tuning remained stable across development. Tectal neurons were observed to receive DS inputs early, and their input selectivity also remained stable across development. However, their spiking output grew substantially more DS at the later developmental stage. This was due at least in part to a naturally occurring decrease in intrinsic excitability which preferentially dampened overall spike rates, but especially in response to the non-preferred direction of motion, thereby increasing direction selectivity. These results reveal distinct developmental trajectories in parallel visual pathways. Tegmental direction selectivity is established early and stays stable, whereas tectal output tuning sharpens during development through a decrease in intrinsic excitability.

neuroscience↗