Instability with a purpose: how the visual brain makes decisions in a volatile world

Abstract

In ambiguous or conflicting sensory situations, perception is often multistable in that it changes abruptly at irregular intervals, shifting perpetually between distinct alternatives. Intriguingly, the interval statistics of these alternations exhibits quasi-universal characteristics, suggesting a general mechanism. Here we show that the stereotypical features of multistable perception, exemplified by binocular rivalry, are reproduced in detail by a hierarchical dynamics operating out of equilibrium. Its constitutive elements are discretely stochastic and idealize the metastability of cortical networks. Independent elements accumulate visual evidence at one level, while groups of coupled elements compete for dominance at another level. As soon as one group dominates perception, feedback inhibition suppresses supporting evidence. This mechanism is corroborated compellingly by unexpected serial dependencies of perceptual alternations. Moreover, it satisfies normative constraints of continuous decision-making. We conclude that multistable perception reflects decision-making in a volatile world: integrating evidence over space and time, choosing categorically between hypotheses, while concurrently evaluating alternatives.