Search bioRxiv⌕ Search

Biology subjects

Huk, A. C.

Publications and source records attributed to Huk, A. C..

13 recordsLinked to original sources

Active sensing explains cortical variability and improves visual information

Active vision is often considered at the scale of saccades, with each fixation treated as a static visual sample. Yet the eyes continue to move during fixation, continually transforming the retinal input. Here we measured these movements at high precision while recording neuronal populations in the foveal primary visual cortex of awake marmosets viewing repeated flashed natural images. Fixational eye movements accounted for most conditional firing-rate variability and nearly all shared variability not explained by the trial-averaged response. An image-computable model captured this modulation largely from gaze-dependent retinal input; explicit eye-position and eye-velocity signals added little predictive power. Under natural viewing, retinal motion redistributed image power across temporal frequencies, and motion effects grew when this power engaged spatiotemporal tuning. In model-derived populations, fixational motion increased the spatial information carried per spike relative to stabilized input, with sharpening growing across successive nonlinear stages. Thus, activity commonly assigned to cortical noise is not just structured visual reafference generated by the movement of the observer, but is beneficial signal which sharpens spatial representations.

neuroscience↗

Dynamic interactions between sensory and decision-making circuits shape temporal evidence weighting

Perceptual decisions require the brain to integrate sensory evidence over time, yet the temporal weighting of evidence can be flexibly adjusted according to task demands. How such flexibility emerges from interactions between sensory and decision circuits remains unclear. Here, we combined behavioral and neural measurements with recurrent network modeling to investigate the mechanisms underlying temporal weighting of sensory evidence. Macaques performed a motion-discrimination task in which the temporal statistics of sensory evidence favored early, late or uniform integration. Behavioral psychophysical kernels revealed corresponding shifts in the influence of evidence across time, accompanied by systematic changes in motion discriminability and choice-related activity modulation in visual area MT. We developed a recurrent sensory-decision network incorporating reciprocal feedforward and feedback interactions and a temporally structured modulatory input, resembling an urgency signal. The model reproduced the observed behavioral and neural signatures across temporal weighting conditions. Mechanistically, shifting the onset and dynamics of modulatory inputs systematically reconfigured the temporal profile of evidence weighting without substantially altering sensory response dynamics. Choice-related activity in MT can be decomposed in a bottom-up component with the same time-course as the psychophysical kernel, and a top-down component reflecting the decision build-up. These findings suggest that flexible temporal integration can emerge from dynamic interactions between sensory transmission, recurrent decision circuits and temporally structured urgency modulation, providing a mechanistic framework for how neural systems adapt the computation of sensory evidence to changing task demands.

neuroscience↗

Reassessing Choice Probability: What 59 Macaque Studies Tell Us About Decision-Related Activity in Visual Cortex

Choice probability (CP) quantifies the trial-by-trial covariation between a sensory neurons response and perceptual reports. Despite extensive interest in CP as a window into how perception is linked to the activity of sensory neurons, the usefulness of CP remains debated. On one hand, reported CP magnitudes vary widely across seemingly equivalent studies, questioning its utility as a metric. On the other hand, the absence of clear patterns in CP variability has made it difficult to use it to adjudicate between competing models of visual perception. Here, we performed a meta-analysis of 150 CP estimates from 59 macaque neurophysiology studies to identify factors that systematically influence CP. We confirmed the positive relationship between CP and neuronal sensitivity both across and within individual studies. When controlled for sensitivity, we found remarkable consistency in CP across varying tasks and brain regions with two notable exceptions. First, CPs were higher in tasks involving bistable percepts, reinforcing the link between CP magnitude and subjective perception. Second, CPs were smaller in area V1, supporting prior suggestions about V1s special role in visual processing. We further found a significant effect of stimulus duration on CP, providing evidence against strictly feedforward models and favoring models with substantial feedback and recurrent processing. Finally, we offer recommendations for future studies to enhance the cross-study comparability and theoretical utility of choice signals as the field transitions to large-scale population recordings. More broadly, our findings demonstrate the benefits of meta-studies that expose patterns across many different tasks and animals - yielding insights that complement large-scale population recordings.

neuroscience↗

Active gaze behavior organizes V1 activity in freely-moving marmosets

Human and nonhuman primates rely heavily on vision to actively explore and navigate their environment. Although primate visual cortex has been studied extensively in head-fixed animals, little is known about how the primate visual system supports natural, active vision in freely moving animals. Here, we address this gap in the primary visual cortex (V1) by leveraging a head-mounted eye-tracking system while simultaneously recording the activity of ensembles of single V1 neurons in freely moving marmosets. Our results reveal that primate neural activity is tightly driven by visual input and organized by the temporal structure of natural gaze behavior, and these gaze-related responses are largely abolished in the absence of visual input. We further show that distinct phases of gaze movement, i.e. rapid redirection (gaze shift) and subsequent stabilization (fixation), engage separable suppression and enhancement of the V1 responses. The enhancement during fixation was clearly linked to visual input. Moreover, the amplitudes of naturally-occurring gaze shifts organize RF input across successive fixations, and adaptively shapes fixation-associated enhancement. These findings define the dynamics in V1 that link natural gaze behavior and stimulus-driven responses in freely moving primates. The work opens a previously inaccessible but fundamental regime of primate vision and establishes freely moving paradigms as a foundation for understanding real-world visual processing during ethologically relevant behaviors.

neuroscience↗

Systemic AAV delivery of a calcium indicator in marmosets: functional validation in visual area MT

Functional optical imaging in nonhuman primates provides an important complement to electrophysiological approaches in neuroscience research, but its broader use has been limited by challenges in achieving large-scale, homogeneous expression of genetically encoded reporters, and imaging accessibility in species with gyrencephalic brains with sulci and fissures (e.g., rhesus macaques). Specifically, conventional local intracortical viral injections are invasive and often produce spatially restricted or heterogeneous expression, constraining population-level analyses. Here, we show that systemic intravenous delivery of an adeno-associated virus (AAV) capsid engineered for enhanced blood-brain barrier crossing, AAV.CAP-B10, supports robust and widespread expression of a calcium indicator CAaMP8s in the common marmoset. Intravenous delivery in two marmosets resulted in widespread cortical expression. Using a large cranial window over extrastriate visual area MT (and its satellite areas), we performed widefield single-photon imaging and two-photon cellular-resolution imaging in awake,behaving marmosets to functionally validate activity in this well studied primate visual-motion sensitive cortical area. Population level responses to visual motion and spatial organization measured with widefield imaging, as well as single-cell level motion direction tuning measured with two-photon imaging, were consistent with canonical properties of MT reported in previous electrophysiological studies. Quantitative analyses of lightsheet imaging after whole hemisphere brain clearing further confirmed the broad expression of GCaMP in both cortical and subcortical areas. Together, these results indicate that systemic delivery using AAV.CAP-B10 provides a minimally invasive approach for robust multi-scale functional optical imaging in awake, behaving marmosets.

neuroscience↗

Area MT carries acceleration information in a quickly and directly decodable representation

We sought to better understand the neural representation of visual motion acceleration. A straightforward estimation of acceleration would involve calculating the rate of change of velocity, which itself would be calculated from change in position over time. As it is well-established that neurons in area MT encode velocity, the brain could thus indirectly estimate acceleration by calculating the change in MTs velocity representations. An alternate mechanism, however, could operate more rapidly and directly. In this case, the brain could exploit interactions between MTs standard motion encoding and idiosyncratic temporal dynamics of neural responses. Such direct decoding would thus exploit nonlinearities usually ignored in studies of MT coding. We tested between these two theories by measuring from ensembles of MT neurons while two male awake fixating macaques viewed linearly accelerating motion stimuli. Direct decoding of acceleration from MT was possible on faster time scales, and could be done with higher fidelity, than indirect decoding. Distinct motion acceleration information could thus be efficiently read out from rich and heterogeneous MT ensemble responses, regardless of the mechanisms that give rise to various forms of motion tuning that it exhibits. A similar analysis of activity in the medial superior temporal area (MST) did not suggest this later stage of motion processing has a more refined acceleration representation. Together, these results suggest that the brain may opportunistically exploit nonlinear idiosyncrasies of neural responses to efficiently extract behaviorally relevant information on fast time scales, instead of performing explicit calculation of some variables. Significance StatementThis study aims to understand if linear acceleration information of visual motion is extracted and represented in primate visual motion areas MT and MST. By combining large-scale multi-area neuronal recordings, population-level analyses, and a rich set of moving stimuli, we showed that linear acceleration can be decoded from MT activity. Specifically, our results demonstrate that (1) motion acceleration is encoded in MT, and can be directly and quickly decoded from MT ensemble activity, and (2) area MST, despite being a later stage of motion processing, does not refine acceleration representations. These findings call for revisiting how brain areas might efficiently extract behaviorally relevant information from the environment and highlight the importance of temporal dynamics in visual motion processing.

neuroscience↗

Activity in the peripheral representation within primate V1 is substantially modulated during running

We recently investigated whether activity in primary visual cortex of a primate (Callithrix jacchus) is modulated during running, and found that the effects were small (and suppressive), a notable difference from the large and positive modulations observed in mice. In that first report, we noted that the majority of our data were collected from the retinotopic representation of the fovea, and surmised that running modulations might be different in the peripheral representation. Here, we report that running-correlated modulations of the peripheral representation in marmoset V1 are positive and substantial-- on order of 30%. In light of both the small and negative modulations observed in foveal V1, and the large and positive modulations seen in mouse V1, these results suggest that the foveal representation in primates may be unique. In this domain, non-foveal V1 in primates appears more similar to that of rodents.

neuroscience↗

Temporal integration is a robust feature of perceptual decisions

Making informed decisions in noisy environments requires integrating sensory information over time. However, recent work has suggested that it may be difficult to determine whether an animals decision-making strategy relies on evidence integration or not. In particular, strategies based on extrema-detection or random snapshots of the evidence stream may be difficult or even impossible to distinguish from classic evidence integration. Moreover, such non-integration strategies might be surprisingly common in experiments that aimed to study decisions based on integration. To determine whether temporal integration is central to perceptual decision making, we developed a new model-based approach for comparing temporal integration against alternative "non-integration" strategies for tasks in which the sensory signal is composed of discrete stimulus samples. We applied these methods to behavioral data from monkeys, rats, and humans performing a variety of sensory decision-making tasks. In all species and tasks, we found converging evidence in favor of temporal integration. First, in all observers across studies, the integration model better accounted for standard behavioral statistics such as psychometric curves and psychophysical kernels. Second, we found that sensory samples with large evidence do not contribute disproportionately to subject choices, as predicted by an extrema-detection strategy. Finally, we provide a direct confirmation of temporal integration by showing that the sum of both early and late evidence contributed to observer decisions. Overall, our results provide experimental evidence suggesting that temporal integration is an ubiquitous feature in mammalian perceptual decision-making. Our study also highlights the benefits of using experimental paradigms where the temporal stream of sensory evidence is controlled explicitly by the experimenter, and known precisely by the analyst, to characterize the temporal properties of the decision process.

neuroscience↗

Running modulates primate and rodent visual cortex via common mechanism but quantitatively distinct implementation

When mice run, activity in their primary visual cortex (V1) is strongly modulated. This observation has altered conceptions of a brain region assumed to be a passive image processor. Extensive work has followed to dissect the circuits and functions of running-correlated modulation. However, it remains unclear whether visual processing in primates might similarly change during locomotion. We therefore measured V1 activity in marmosets while they viewed stimuli on a treadmill. In contrast to mouse, running-correlated modulations of marmoset V1 were small, and tended to be slightly suppressive. Population-level analyses revealed trial- to-trial fluctuations of shared gain across V1 in both species, but while strongly correlated with running in mice, gain modulations were smaller and more often negatively correlated with running in marmosets. Thus, population-wide fluctuations of V1 may reflect a common feature of mammalian visual cortical function, but important quantitative differences point to distinct consequences for the relation between vision and action in primates versus rodents.

neuroscience↗

Sensory and choice responses in MT distinct from motion encoding

Macaque area MT is well known for its visual motion selectivity and relevance to motion perception, but the possibility of it also reflecting non-sensory functions has largely been ignored. Manipulating subjects temporal evidence weighting revealed multiple components of MT responses that were, surprisingly, not interpretable as behaviorally-relevant modulations of motion encoding, nor as consequences of readout of motion direction. MTs time-varying motion-driven responses were starkly changed by our strategic manipulation, but with timecourses opposite the subjects temporal weighting strategies. Furthermore, large choice-correlated signals were represented in population activity distinctly from motion responses (even after the stimulus) with multiple phases that both lagged psychophysical readout and preceded motor responses. These results reveal multiple cognitive contributions to MT responses that are task-related but not functionally relevant to encoding or decoding of motion for psychophysical direction discrimination, calling into question its nature as a simple sensory area.

neuroscience↗

Stimulus-choice (mis)alignment in primate MT cortex

For stimuli near perceptual threshold, the trial-by-trial activity of single neurons in many sensory areas is correlated with the animals perceptual report. This phenomenon has often been attributed to feedforward readout of the neural activity by the downstream decision-making circuits. The interpretation of choice-correlated activity is quite ambiguous, but its meaning can be better understood in the light of population-wide correlations among sensory neurons. Using a statistical nonlinear dimensionality reduction technique on single-trial ensemble recordings from the middle temporal area during perceptual-decision-making, we extracted low-dimensional neural tra jectories that captured the population-wide fluctuations. We dissected the particular contributions of sensory-driven versus choice-correlated activity in the low-dimensional population code. We found that the neural trajectories strongly encoded the direction of the stimulus in single dimension with a temporal signature similar to that of single MT neurons. If the downstream circuit were optimally utilizing this information, choice-correlated signals should be aligned with this stimulus encoding dimension. Surprisingly, we found that a large component of the choice information resides in the subspace orthogonal to the stimulus representation inconsistent with the optimal readout view. This misaligned choice information allows the feedforward sensory information to coexist with the decision-making process. The time course of these signals suggest that this misaligned contribution likely is feedback from the downstream areas. We hypothesize that this non-corrupting choice-correlated feedback might be related to learning or reinforcing sensory-motor relations in the sensory population. Author summaryIn sensorimotor decision-making, internal representation of sensory stimuli is utilized for the generation of appropriate behavior for the context. Therefore, the correlation between variability in sensory neurons and perceptual decisions is sometimes explained by a causal, feedforward role of sensory noise in behavior. However, this correlation could also originate via feedback from decision-making mechanisms downstream of the sensory representation. This cannot be resolved by analyzing single unit responses, but requires a population level analysis. Area MT contains both sensory and choice information and is known to be the key sensory area for visual motion perception. Thus the decision-making process may be corrupting the sensory representation. However, we find that the sensory stimuli and choice variables are separate at the population level,contradicting the previous interpretations based on single unit recordings. This new insight postulates how neural systems can maintain a mixed representation while allows learning and adaptation.

neuroscience↗

Discrete stepping and nonlinear ramping dynamics underlie spiking responses of LIP neurons during decision-making

Neurons in macaque area LIP exhibit gradual ramping in their trial-averaged spike responses during sensory decision-making. However, recent work has sparked debate over whether single-trial LIP spike trains are better described by discrete \"stepping\" or continuous drift-diffusion (\"ramping\") dynamics. Here we address this controversy using powerful model-based analyses of LIP spike responses. We extended latent dynamical models of LIP spike trains to incorporate non-Poisson spiking, baseline firing rates, and various nonlinear relationships between the latent variable and firing rate. Moreover, we used advanced model-comparison methods, including cross-validation and a fully Bayesian information criterion, to evaluate and compare models. These analyses revealed that when non-Poisson spiking was incorporated into existing stepping and ramping models, a majority of neurons remained better described by stepping dynamics, even when conditioning on evidence level or choice. However, an extended ramping model with a non-zero baseline and a compressive output nonlinearity accounted for roughly as many neurons as the stepping model. The latent dynamics inferred under this model exhibited high diffusion variance for many neurons, making them qualitatively different than slowly-evolving continuous dynamics. These findings generalized to alternative tasks, suggesting that a robust fraction of LIP neurons are better described by each model class.

neuroscience↗

No cause for pause: new analyses of ramping and stepping dynamics in LIP (Rebuttal to Response to Reply to Comment on Latimer et al. 2015)

We recently presented a statistical comparison between two models of latent dynamics in macaque lateral intraparietal (LIP) area spike trains--a continuous ramping (diffusion-to-bound) model, and a discrete stepping model--and found that a substantial fraction of neurons (recorded in two different studies) were better supported by the stepping model (Latimer et al., 2015). Here, we respond to a recent challenge to the validity of these findings that focuses primarily on the possibility of a lower bound on LIP firing rates (Zylberberg & Shadlen, 2016). The paper in question proposed alternate formulations of the ramping model, and argued (via indirect analyses) that half the neurons in the population were better explained by the new model; if correct, this would lead to an even split in the number of neurons better explained by each model. These analyses, while interesting, do not alter the conclusions of our original paper. Here, we review the criticisms raised by Zylberberg & Shadlen and report several new analyses using models with lower bounds. First, we show that the stepping model continued to provide a better description of LIP spike trains when fit using only an early period of each trial. Second, we performed a direct model comparison between our stepping model and a ramping-with-baseline model proposed by Zylberberg & Shadlen; we found that (in a pleasing moment of agreement) roughly half the neurons were better explained by each model. Interestingly, inspection of the cells that switched classifications revealed that many did not strictly exhibit the classical ramping PSTHs that motivated these analyses in the first place. We also examined two other issues raised in recent discussions of LIP: (1) We show that a non-integrating model is consistent with some core aspects of behavioral data previously offered as evidence for continuous integration; and (2) We examine analyses based on the response covariance (\"CorCE\"), and show that it does not reliably distinguish ramping and stepping dynamics for our dataset. Taken together, these discussions highlight the value of data-driven characterizations of both neural and behavioral dynamics with appropriate statistical tools.

neuroscience↗