Prefrontal cortex temporally multiplexes slow and fast dynamics in value learning and memory

Abstract

Previous studies have revealed segregated circuitries in basal ganglia for fast learning that enables value adaptability and slow forgetting which underlies stable value memories. However, the mechanisms mediating the conflict between value adaptability vs stability remain unknown. Using a reinforcement learning paradigm involving a brief value reversal for objects with previously stable values, we predicted and confirmed a novel behavioral manifestation of the conflict between adaptability vs stability namely the spontaneous recovery of old values in macaque monkeys. Furthermore, we found that individual neurons in ventrolateral prefrontal cortex (vlPFC) temporally multiplexed slow and fast processes in their early and late responses to objects. The local field potential in vlPFC also reflected the two-rate system. These findings implicate vlPFC as a plexus for the interactions between adaptability vs stability in reinforcement learning and suggest spontaneous recovery of past values caused by a two-rate system to mediate relapse to old habits.