Exploring Brain State Changes Through Reaction Time in a Simultaneity Judgment Task: A Pilot Study on Multisensory Integration

Abstract

Problem statementMultisensory Integration (MSI), the brains ability to merge information from different sensory modalities, relies on the Temporal Binding Window (TBW)--the interval during which stimuli are most likely to be perceived as simultaneous. Beyond its role in perception, MSI may also reflect changes in brain state as task difficulty evolves. In this pilot study, we aimed to explore whether behavioral metrics, particularly reaction time (RT), can capture these brain state changes during a Simultaneity Judgment (SJ) task. Understanding this relationship is critical for developing adaptive Brain-Computer Interfaces (BCIs) that rely on real-time cognitive and perceptual feedback. ApproachTo assess how temporal alignment influences both perception and underlying brain state, we employed a Two-Alternative Forced Choice (2AFC) SJ task using audiovisual stimuli. After estimating individual simultaneity thresholds, we implemented an adaptive task that gradually increased difficulty by manipulating the stimulus onset asynchrony (SOA) closer to the TBW. We hypothesized that as perceptual uncertainty increased, RTs would reflect evolving cognitive states, serving as an observable indicator of underlying neural activity shifts. Materials and MethodsTwo participants were tested with consistent auditory (500 Hz tone) and visual (faded white circle) stimuli. The TE phase used a staircase procedure to determine personalized TBWs. In the subsequent adaptive test phase, SOAs were progressively modulated around these thresholds to induce varying levels of perceptual ambiguity. Behavioral responses were analyzed using psychometric curve fitting, confusion matrices, and detailed RT evolution across trials. Results and DiscussionParticipant 1 showed clear RT modulation near the TBW, suggesting heightened cognitive load and decision uncertainty--a potential signature of brain state transitions. In contrast, Participant 2 exhibited less sensitivity, possibly due to suboptimal thresholding. These preliminary findings suggest that RT holds promise as a behavioral correlate of perceptual state; however, further refinement and standardization of the task are needed before it can be reliably scaled to larger and more controlled studies of MSI-linked brain dynamics.