Remote Heart Rate Variability for Emotional State Monitoring

Yannick Benezeth, Peixi Li, Richard Macwan1, Keisuke Nakamura2, Randy Gomez2, Fan Yang3

  • 1Universit? de Bourgogne
  • 2Honda Research Institute Japan Co., Ltd.
  • 3Univ. Bourgogne Franche-Comté

Details

18:15 - 20:15 | Mon 5 Mar | Caribbean ABC | MoPO.32

Session: Poster Session # 1 and BSN Innovative Health Technology Demonstrations

Abstract

Several researches have been conducted to recognize emotions using various modalities such as facial expressions, gestures, speech or physiological signals. Among all these modalities, physiological signals are especially interesting because they are mainly controlled by the autonomic nervous system. It has been shown for example that there is an undeniable relationship between emotional state and Heart Rate Variability (HRV). In this paper, we present a methodology to monitor emotional state from physiological signals acquired remotely. The method is based on a remote photoplethysmography (rPPG) algorithm that estimates remote Heart Rate Variability (rHRV) using a simple camera. We first show that the rHRV signal can be estimated with a high precision. Then, frequency-feature of rHRV is calculated and we show that there is a strong correlation between the rHRV feature and different emotional states. This observation has been validated on 12 out of 16 volunteers and video-induced emotions which opens the way to contactless monitoring of emotions from physiological signals.