Emotion Recognition by Point Process Characterization of Heartbeat Dynamics

Akshay S. Ravindran, Sho Nakagome, Dilranjan Wickramasuriya1, José Contreras-Vidal1, Rose T. Faghih1

  • 1University of Houston

Details

Category

Poster Session

Theme

Health and Wellness Across the Lifespan

Sessions

12:15 - 14:15 | Wed 20 Nov | Upper Foyer Balcony | A1P-B

Poster Session - Health and Wellness Across the Lifespan 1

Full Text

Abstract

Recognizing human emotion from heartbeat information alone is a challenging but ongoing research area. Here, we utilize a point process model to characterize heartbeat dynamics and use it to extract instantaneous heart rate variability (HRV) features. These features are then fed into a convolutional neural network (CNN) to characterize different emotional states from small windows. On average, we achieved over 60% classification accuracy and as high as 77% in some subjects. This is comparable to other studies that use a combination of physiological signals as opposed to only HRV measures as done here. Informative features were identified for the different affective states. These findings enable the possibility of augmenting electrocardiogram or photoplethysmogram monitoring wearable devices with automated human emotion recognition capabilities for mental health applications. They also allow for the use of instantaneous estimation of HRV features to be used in combination with models that use other types of physiological signals for instantaneous emotion recognition.

Additional Information

No information added

Video

No videos found