Validation of video engagement assessments using electrodermal activity

Abstract

Engagement is widely recognised as central to learning and academic achievement. Electrodermal activity (EDA) has emerged as an objective physiological indicator of engagement, as it measures sympathetic nervous system activation. However, the high cost of wearable EDA sensors has limited its widespread application. This study answers the call for affordable, high-temporal-resolution engagement measures by validating a video-based quantitative assessment method. Researchers collected 75 minutes of synchronised EDA and video data from 12 upper secondary students (aged 17-18) during regular instruction. Novel software was developed to analyse student movement and sound level for academically relevant content. The OpenPose AI model for pose estimation was also applied. This approach produced six distinct movement variables: two AI-based and four non-AI-based. Six linear models using varying movement variables and sound level were tested to predict tonic EDA levels. All models effectively predicted EDA levels, with non-AI-based movement metrics outperforming AI-based alternatives. The four non-AI-based movement models showed similar performance, indicating that compressed versions reduced computational time without sacrificing predictive power. These findings validate a novel, objective method for comparing engagement across learning activities on short timescales. This method is particularly useful for collaborative learning environments and enables controlling for movement and sound in quantitative classroom analyses.