Auditory-motor synchronization determines the use of predictions in music perception

Abstract

When listening to music, our brain constantly generates predictions about the timing and pitch of upcoming sounds based on the structure of the music. Individual differences in the ability to make such rhythmic and melodic predictions shape music perception. Previous studies show that during rhythmic auditory-motor synchronization tasks, better performance is related to stronger motor system engagement. However, whether individual differences in auditory-motor interactions influence higher-level rhythmic predictions is unknown. Here, we used electroencephalography during a naturalistic music listening task to assess the neural tracking of rhythmic and melodic predictions generated from (short-term) local contextual information and (long-term) experience using the Information Dynamics of Music model. We combined a multivariate temporal response function approach with two behavioral measures of auditory-motor synchronization (whispering and finger tapping). We found that stronger auditory-motor synchronization predicted stronger neural tracking of lower-level temporal aspects of the music signal, i.e. acoustic envelope and note onset. Across participants, higher-level (short- and long-term) predictions were also neurally tracked, with neural tracking stronger for rhythmic than melodic predictions. Importantly, our evidence suggests individual differences in the weighting of musical predictions. Individuals with stronger auditory-motor synchronization showed stronger neural tracking of rhythmic compared to melodic predictions, and this effect was especially pronounced for short-term predictions. Our findings demonstrate that the motor system is critically involved at several processing levels even in purely perceptual music tasks, and pave the way for understanding individual differences in the weighting of rhythmic and melodic predictions during music listening. Significance statementOur ability to make musical predictions affects our perception of music. Understanding individual differences in predictive processing may allow for differential diagnostics and interventions in clinical disorders such as rhythm disorders or hearing impairment. In an electrophysiological study, we found evidence that the motor system is implicated in predictive processes during perception of music. Specifically, we find advanced neural processing of acoustic temporal features and stronger weighting of short- and long-term rhythmic musical predictions in individuals who recruit the motor system more strongly. Likely, in individuals with high compared to low auditory-motor synchronization strength, the motor system facilitates temporal processing at different levels: at the level of acoustic temporal structure processing, and at higher-level processing of rhythmic musical predictions.