Loughborough University
Leicestershire, UK
LE11 3TU
+44 (0)1509 263171
Loughborough University

Loughborough University Institutional Repository

Please use this identifier to cite or link to this item: https://dspace.lboro.ac.uk/2134/26823

Title: A study of the dynamic relation between physiological changes and spontaneous expressions
Authors: Yang, Fenglei
Hu, Sijung
Li, Baomin
Dwyer, Vincent M.
Hassan, Harnani
Wei, Dongqing
Shi, Ping
Keywords: Biomedical engineering
Computer science
Information technology
Medical imaging
Issue Date: 2017
Publisher: Nature Publishing Group © The Author(s)
Citation: YANG, F. ... et al, 2017. A study of the dynamic relation between physiological changes and spontaneous expressions. Scientific Reports, 7, 7081.
Abstract: Recent progress in Affective Computing (AC) has enabled integration of physiological cues and spontaneous expressions to reveal a subject’s emotional state. Due to the lack of an effective technique for evaluating multimodal correlations, experience and intuition play a main role in present AC studies when fusing affective cues or modalities, resulting in unexpected outcomes. This study seeks to demonstrate a dynamic correlation between two such affective cues, physiological changes and spontaneous expressions, which were obtained by a combination of stereo vision based tracking and imaging photoplethysmography (iPPG), with a designed protocol involving 20 healthy subjects. The two cues obtained were sampled into a Statistical Association Space (SAS) to evaluate their dynamic correlation. It is found that the probability densities in the SAS increase as the peaks in two cues are approached. Also the complex form of the high probability density region in the SAS suggests a nonlinear correlation between two cues. Finally the cumulative distribution on the zero time-difference surface is found to be small (<0.047) demonstrating a lack of simultaneity. These results show that the two cues have a close interrelation, that is both asynchronous and nonlinear, in which a peak of one cue heralds a peak in the other.
Description: This is an Open Access Article. It is published by Nature under the Creative Commons Attribution 4.0 International Licence (CC BY). Full details of this licence are available at: http://creativecommons.org/licenses/by/4.0/
Sponsor: NSFC (Grant No: 61371149).
Version: Published
DOI: 10.1038/s41598-017-07122-x
URI: https://dspace.lboro.ac.uk/2134/26823
Publisher Link: https://doi.org/10.1038/s41598-017-07122-x
ISSN: 2045-2322
Appears in Collections:Published Articles (Mechanical, Electrical and Manufacturing Engineering)

Files associated with this item:

File Description SizeFormat
Study+of+the+Dynamic+Relation_.pdfPublished version4.08 MBAdobe PDFView/Open


SFX Query

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.