Biology subjects

Rikhye, R. V.

Publications and source records attributed to Rikhye, R. V..

5 recordsLinked to original sources

bioRxiv2021

Learning attention-controllable border-ownership for objectness inference and binding

Human visual systems can parse a scene composed of novel objects and infer their surfaces and occlusion relationships without relying on object-specific shapes or textures. Perceptual grouping can bind together spatially disjoint entities to unite them as one object even when the object is entirely novel, and bind other perceptual properties like color and texture to that object using object-based attention. Border-ownership assignment, the assignment of perceived occlusion boundaries to specific perceived surfaces, is an intermediate representation in the mammalian visual system that facilitates this perceptual grouping. Since objects in a scene can be entirely novel, inferring border ownership requires integrating global figural information, while dynamically postulating what the figure is, a chicken-and egg process that is complicated further by missing or conflicting local evidence regarding the presence of boundaries. Based on neuroscience observations, we introduce a model - the cloned Markov random field (CMRF)- that can learn attention-controllable representations for border-ownership. Higher-order contour representations that distinguish border-ownerships emerge as part of learning in this model. When tested with a cluttered scene of novel 2D objects with noisy contour-only evidence, the CMRF model is able to perceptually group them, despite clutter and missing edges. Moreover, the CMRF is able to use occlusion cues to bind disconnected surface elements of novel objects into coherent objects, and able to use top-down attention to assign border ownership to overlapping objects. Our work is a step towards dynamic binding of surface elements into objects, a capability that is crucial for intelligent agents to interact with the world and to form entity-based abstractions.

neuroscience↗

bioRxiv2019

Learning cognitive maps for vicarious evaluation

Cognitive maps are mental representations of spatial and conceptual relationships in an environment. These maps are critical for flexible behavior as they permit us to navigate vicariously, but their underlying representation learning mechanisms are still unknown. To form these abstract maps, hippocampus has to learn to separate or merge aliased observations appropriately in different contexts in a manner that enables generalization, efficient planning, and handling of uncertainty. Here we introduce a specific higher-order graph structure - clone-structured cognitive graph (CSCG) - which forms different clones of an observation for different contexts as a representation that addresses these problems. CSCGs can be learned efficiently using a novel probabilistic sequence model that is inherently robust to uncertainty. We show that CSCGs can explain a variety cognitive map phenomena such as discovering spatial relations from an aliased sensory stream, transitive inference between disjoint episodes of experiences, formation of transferable structural knowledge, and shortcut-finding in novel environments. By learning different clones for different contexts, CSCGs explain the emergence of splitter cells and route-specific encoding of place cells observed in maze navigation, and event-specific graded representations observed in lap-running experiments. Moreover, learning and inference dynamics of CSCGs offer a coherent explanation for a variety of place cell remapping phenomena. By lifting the aliased observations into a hidden space, CSCGs reveal latent modularity that is then used for hierarchical abstraction and planning. Altogether, learning and inference using a CSCG provides a simple unifying framework for understanding hippocampal function, and could be a pathway for forming relational abstractions in artificial intelligence.

neuroscience↗

bioRxiv2019

Memorize-Generalize: An online algorithm for learning higher-order sequential structure with cloned Hidden Markov Models

Sequence learning is a vital cognitive function and has been observed in numerous brain areas. Discovering the algorithms underlying sequence learning has been a major endeavour in both neuroscience and machine learning. In earlier work we showed that by constraining the sparsity of the emission matrix of a Hidden Markov Model (HMM) in a biologically-plausible manner we are able to efficiently learn higher-order temporal dependencies and recognize contexts in noisy signals. The central basis of our model, referred to as the Cloned HMM (CHMM), is the observation that cortical neurons sharing the same receptive field properties can learn to represent unique incidences of bottom-up information within different temporal contexts. CHMMs can efficiently learn higher-order temporal dependencies, recognize long-range contexts and, unlike recurrent neural networks, are able to natively handle uncertainty. In this paper we introduce a biologically plausible CHMM learning algorithm, memorize-generalize, that can rapidly memorize sequences as they are encountered, and gradually generalize as more data is accumulated. We demonstrate that CHMMs trained with the memorize-generalize algorithm can model long-range structure in bird songs with only a slight degradation in performance compared to expectation-maximization, while still outperforming other representations.

neuroscience↗

bioRxiv2019

Different clones for different contexts: Hippocampal cognitive maps as higher-order graphs of a cloned HMM

Hippocampus encodes cognitive maps that support episodic memories, navigation, and planning. Under-standing the commonality among those maps as well as how those maps are structured, learned from experience, and used for inference and planning is an interesting but unsolved problem. We propose higher-order graphs as the general principle and present, as a plausible model, a cloned hidden Markov model (HMM) that can learn these graphs efficiently from experienced sequences. In our experiments, we use the cloned HMM for learning spatial and abstract representations. We show that inference and planning in the learned CHMM encapsulates many of the key properties of hippocampal cells observed in rodents and humans. Cloned HMM thus provides a new frame-work for understanding hippocampal function.

neuroscience↗

bioRxiv2017

Reliable sensory processing in mouse visual cortex through inhibitory interactions between Somatostatin and Parvalbumin interneurons

Cortical neurons often respond to identical sensory stimuli with large variability. However, under certain conditions, the same neurons can also respond highly reliably. The circuit mechanisms that contribute to this modulation, and their influence on behavior remains unknown. Here we used novel double transgenic mice, dual-wavelength calcium imaging and temporally selective optical perturbation to identify an inhibitory neural circuit in visual cortex that can modulate the reliability of pyramidal neurons to naturalistic visual stimuli. Our results, supported by computational models, suggest that somatostatin interneurons (SST-INs) increase pyramidal neuron reliability by suppressing parvalbumin interneurons (PV-INs) via the inhibitory SST[->]PV circuit. Using a novel movie classification task, we further show that, by reducing variability, activating SST-INs can improve the ability of mice to discriminate between ambiguous stimuli. Together, these findings reveal a novel role of the SST[->]PV circuit in modulating the fidelity of neural coding critical for visual perception.

neuroscience↗