Search bioRxiv⌕ Search

Biology subjects

Corona-Strauss, F. I.

Publications and source records attributed to Corona-Strauss, F. I..

5 recordsLinked to original sources

Immersion as inference: An active inference account of induced realities and its relation to the two-competitor model

Immersive technologies are designed for a single target: the human perceptual system. Engineers of virtual and augmented reality have long recognized that a display does not have to replicate the physical world, it only has to provide the inputs that satisfy the senses at the level at which the brain samples them. This engineering intuition is, in fact, a statement about brain function. Here we develop it into a formal account of immersion within the active inference framework. We treat an induced reality (a virtual, augmented, or mixed reality, but also a book or a daydream) as a candidate generative model that competes with the model of the actual reality for the explanation of a shared sensorium and for the control of action. Immersion is then defined as the ensuant belief that the induced reality best explains the current sensory signals and supports the current perceived reality of the winning model, despite any break in immersion by Bayesian model switching driven by a high-precision prediction error that the induced model cannot absorb. Exogenous and endogenous attention, implemented as weights governing stream selection in our earlier two-competitor model, which treated attention as necessary but not sufficient for immersion, appear as two routes of precision allocation: likelihood precision of evolutionarily entrenched sensory events, and precision that follows the expected free energy of policies. Affect and motivation enter through the pragmatic and epistemic value of remaining in the induced reality and through the rate of change of free energy. We show that the two-competitor attentional focus vector and its angle are recovered from the active inference variables, and we reproduce the two scenarios of the original model, a rewarding and a fatiguing activity interrupted by a slamming door, in a minimal simulation. The account links presence, embodiment, cybersickness, and narrative absorption to a single quantity, and it yields concrete predictions for the psychophysiological assessment and closed-loop control of immersion. We discuss implications for neuroergonomic design in which the evolutionarily entrenched core of perception is non-negotiable while its experience-dependent periphery can be trained.

neuroscience↗

Fifty Years After: The N1 Effect Travels Down to the Brainstem

Fifty years ago, it was reported that selective attention affects the N1 wave in auditory event-related potentials. We revisited the original study design but integrated the state of the art knowledge on short auditory stimuli and neural signal processing. In particular, one series of tone bursts has been replaced by chirp stimuli which are optimized to evoke consistent brainstem potentials at low and medium stimulation levels. Auditory selective attention affected the chirp- evoked response in subcortical structures, even at level of the inferior colliculi. A single-trial time-frequency analysis of the full-range (0-250ms) event-related potentials showed that selective attention increases the spectrotemporal consistency across trials in the corticofugal auditory pathway, at least from the N1 wave down to the auditory brainstem response.

neuroscience↗

Electromyographic Correlates of Effortful Listening in the Vestigial Auriculomotor System

Recently, electromyographic (EMG) signals of auricular muscles have been shown to be an indicator of spatial auditory attention in humans, based on a vestigial pinna-orienting system. Because spatial auditory attention in a competing speaker task is closely related to the more gen-eralized concept of attentional effort in listening, the current study inves-tigated the possibility that the EMG activity of auricular muscles could also reflect correlates of effortful listening in general. Twenty subjects were recruited. EMG signals from the left and right superior and poste-rior auricular muscles (SAM, PAM) were recorded while subjects attended a target podcast in a competing speaker paradigm. Three different lev-els of listening effort, low, medium, and high, were generated by varying the number and pitch of distractor streams, as well as the signal-to-noise ratio. All audio streams were either presented from a loudspeaker placed in front of the participants (0{degrees}), or in the back (180{degrees}). Averaged PAM activity was not affected by different levels of listening effort, but was sig-nificantly larger when stimuli were presented from the back, as opposed to the front. Averaged SAM activity, however, was significantly larger in the high listening effort condition, compared to low and medium, but was not affected by stimulus direction. We hypothesize that the increased SAM activity is a response of the vestigial pinna-orienting system to effortful stream segregation task.

neuroscience↗

The Role of Attention in Immersion: The Two-Competitor Model

Currently, we face an exponentially increasing interest in immersion, especially sensory-driven immersion, mainly due to the rapid development of ideas and business models centered around a digital virtual universe as well as the increasing availability of affordable immersive technologies for education, communication, and entertainment. However, a clear definition of immersion, in terms of established neurocognitive concepts and measurable properties, remains elusive, slowing research on the human side of immersive interfaces. To address this problem, we propose a conceptual, taxonomic model of attention in immersion. We argue (a) modeling immersion theoretically as well as studying immersion experimentally requires a detailed characterization of the role of attention in immersion, even though (b) attention, while necessary, cannot be a sufficient condition for defining immersion. Our broader goal is to characterize immersion in terms that will be compatible with established psychophysiolgical measures that could then in principle be used for the assessment and eventually the optimization of an immersive experience. We start from the perspective that immersion requires the projection of attention to an induced reality, and build on accepted taxonomies of different modes of attention for the development of our two-competitor model. The two-competitor model allows for a quantitative implementation and has an easy graphical interpretation. It helps to highlight the important link between different modes of attention and affect in studying immersion.

neuroscience↗

Vestigial Auriculomotor Activity Indicates the Direction of Auditory Attention in Humans

It is commonly assumed that, unlike dogs and cats, we humans do not make ear movements when focusing our attention reflexively toward novel sounds or voluntarily toward those that are goal-relevant. In fact, it has been suggested that we do have a pinna-orienting system. Although this system became vestigial about 25 million years ago, it still exists as a \"neural fossil\" within the brain. Consistent with this hypothesis, we demonstrate for the first time that the direction of auditory attention is reflected in the sustained electrical activity of muscles within the vestigial auriculomotor system.\n\nSurface electromyograms (EMGs) were taken from muscles that either move the pinna or alter its shape. To assess reflexive, stimulus-driven attention we presented novel sounds from speakers at four different lateral locations while the participants silently read a boring text in front of them. To test voluntary, goal-directed attention we instructed participants to listen to a short story coming from one of these speakers, while ignoring a competing story from the corresponding speaker on the opposite side.\n\nIn both experiments, EMG recordings showed larger activity at the ear on the side of the attended stimulus, but with slightly different patterns. Upward movement (perking) differed according to the lateral focus of attention only during voluntary orienting; rearward folding of the pinnas upper-lateral edge exhibited such differences only during reflexive orienting. The existence of a pinna-orienting system in humans, one that is experimentally accessible, offers opportunities for basic as well as applied science. It could lead to a better understanding of the evolution of auditory attention and support the near real-time decoding of auditory attention in technical applications, for example, for attentionally controlled hearing aids that preferentially amplify sounds the user is attempting to listen to.

neuroscience↗