Nonverbal Social Withdrawal in Depression: Evidence from Manual and Automatic Analyses
Publication Date
12-15-2013
Document Type
Article
Organizational Units
Daniel Felix Ritchie School of Engineering and Computer Science, Electrical and Computer Engineering
Keywords
Depression, Multimodal, FACS, Facial expression, Head motion
Abstract
The relationship between nonverbal behavior and severity of depression was investigated by following depressed participants over the course of treatment and video recording a series of clinical interviews. Facial expressions and head pose were analyzed from video using manual and automatic systems. Both systems were highly consistent for FACS action units (AUs) and showed similar effects for change over time in depression severity. When symptom severity was high, participants made fewer affiliative facial expressions (AUs 12 and 15) and more non-affiliative facial expressions (AU 14). Participants also exhibited diminished head motion (i.e., amplitude and velocity) when symptom severity was high. These results are consistent with the Social Withdrawal hypothesis: that depressed individuals use nonverbal behavior to maintain or increase interpersonal distance. As individuals recover, they send more signals indicating a willingness to affiliate. The finding that automatic facial expression analysis was both consistent with manual coding and revealed the same pattern of findings suggests that automatic facial expression analysis may be ready to relieve the burden of manual coding in behavioral and clinical science.
Publication Statement
Copyright held by author or publisher. User is responsible for all copyright compliance.
Recommended Citation
Girard, Jeffrey M, et al. “Nonverbal Social Withdrawal in Depression: Evidence from Manual and Automatic Analyses.” Image and Vision Computing, vol. 32, no. 10, 2014, pp. 641–647. doi: 10.1016/j.imavis.2013.12.007.