Quantitative Motion Analysis for Non-Contact Affective and Neurocognitive Assessment

Abstract

Qualitative motion analysis with motion magnification techniques opened a new dimension to videos by revealing imperceptible information hidden in small movements. Those movements can contain information on neurocognitive and affective states and thus could be a novel source of information during driving or neurocognitive experiments, complementing secondary sensors in the respective setup. While motion magnification techniques are tools for visualization of small movements, dense optical flow can quantify those movements with sub-pixel precision. In this work, we discuss how quantitative motion analysis with dense optical flow fields from video recordings can be used for online non-contact affective and neurocognitive assessment.