Efficient memory sampling by hippocampal attractor dynamics with intrinsic oscillation

Abstract

Hippocampus is known to replay activity patterns to recall and process memories, which is often related to Hopfield-type attractor dynamics. Another line of theoretical studies suggests that hippocampal replay prioritizes replay of experiences to accelerate value learning for efficient decision making. It is unknown how hippocampal attractor dynamics perform prioritized memory sampling, and more broadly, how we can consistently relate dynamical (bottom-up) and functional (top-down) theories of hippocampal replay. In this paper, we propose an extended Hopfield-type attractor network model with momentum, kinetic energy, and conservation of the total energy, which is called momentum Hopfield model. We show that our model can be interpreted as CA3-CA1 network model with intrinsic oscillation, and such network model reproduces hippocampal replay in 1-D and 2-D spatial structures. We also prove that our model functionally works as Markov-chain Monte Carlo sampling in which recall frequencies of memory patterns can be arbitrarily biased. Using this property, we implemented prioritized experience replay using our model, which actually accelerated reinforcement learning for spatial navigation. Our model explains how dynamics of hippocampal circuits realize efficient memory sampling, providing a theoretical link between dynamics and functions of hippocampal replay.