bioRxiv · 10.1101/807800
A theory of actions and habits in free-operant behavior: The interaction of rate correlation and contiguity systems.
Abstract
Contemporary theories of instrumental performance assume that responding can be controlled by two behavioral systems, one goal-directed that encodes the outcome of an action, and one habitual that reinforces the response strength of the same action. Here we present a model of free-operant behavior in which goal-directed control is determined by the correlation between the rates of the action and the outcome whereas the total prediction error generated by contiguous reinforcement by the outcome controls habitual response strength. The outputs of these two systems summate to generate a total response strength. This cooperative model addresses the difference in the behavioral impact of ratio and interval schedules, the transition from goal-directed to habitual control with extended training, the persistence of goal-directed control under choice procedures and following extinction, among other phenomena. In these respects, this dual-system model is unique in its account of free-operant behavior.
Source connections
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Perez, O. D., Dickinson, A.. 2019-10-17. A theory of actions and habits in free-operant behavior: The interaction of rate correlation and contiguity systems.. https://doi.org/10.1101/807800
Cite the original work for its findings. Save a collection to share your selection of sources.