Reading specific memories from human neurons before and after sleep

Abstract

The ability to retrieve a single episode encountered just once is a hallmark of human intelligence and episodic memory[1]. Yet, decoding a specific memory from neuronal activity in the human brain remains a formidable challenge. Here, we develop a transformer neural network model[2, 3] trained on neuronal spikes from intracranial microelectrodes recorded during a single viewing of an audiovisual episode. Combining spikes throughout the brain via cross-channel attention[4], capable of discovering neural patterns spread across brain regions and timescales, individual participant models predict vocalization of specific concepts such as persons or places during out-of-distribution memory recall. Brain regions differentially contribute to memory decoding before and after sleep. Models trained using only medial temporal lobe (MTL) spikes significantly decode concepts before but not after sleep, while models trained using only frontal cortex (FC) spikes decode concepts after but not before sleep, with better FC decoding relating to increased non-REM sleep. These findings suggest a system-wide distribution of information across neural populations that transforms over wake/sleep cycles[5]. Such decoding of internally generated memories suggests a path towards brain-computer interfaces to treat episodic memory disorders through enhancement or muting of specific memories.