Nonverbal Social Sensing in Action: Unobtrusive Recording and Extracting of Nonverbal Behavior in Social Interactions Illustrated with a Research Example

Details

Serval ID
serval:BIB_CABE49D9F6DB
Type
Article: article from journal or magazin.
Collection
Publications
Institution
Title
Nonverbal Social Sensing in Action: Unobtrusive Recording and Extracting of Nonverbal Behavior in Social Interactions Illustrated with a Research Example
Journal
Journal of Nonverbal Behavior. Special Issue: Contemporary Perspectives in Nonverbal Research
Author(s)
Frauendorfer D., Schmid Mast M., Nguyen L., Gatica-Perez D.
ISSN
0191-5886
Publication state
Published
Issued date
06/2014
Peer-reviewed
Oui
Volume
38
Number
2
Pages
231-245
Language
english
Abstract
Nonverbal behavior coding is typically conducted by "hand". To remedy this time and resource intensive undertaking, we illustrate how nonverbal social sensing, defined as the automated recording and extracting of nonverbal behavior via ubiquitous social sensing platforms, can be achieved. More precisely, we show how and what kind of nonverbal cues can be extracted and to what extent automated extracted nonverbal cues can be validly obtained with an illustrative research example. In a job interview, the applicant's vocal and visual nonverbal immediacy behavior was automatically sensed and extracted. Results show that the applicant's nonverbal behavior can be validly extracted. Moreover, both visual and vocal applicant nonverbal behavior predict recruiter hiring decision, which is in line with previous findings on manually coded applicant nonverbal behavior. Finally, applicant average turn duration, tempo variation, and gazing best predict recruiter hiring decision. Results and implications of such a nonverbal social sensing for future research are discussed.
Keywords
Ubiquitous social sensing platform, Automated extraction, Applicant nonverbal behavior, Hiring decision, Job interview
Web of science
Create date
20/10/2014 9:56
Last modification date
20/08/2019 16:45
Usage data