Skip to main content

2021 | Buch

Detecting Trust and Deception in Group Interaction

herausgegeben von: Dr. V. S. Subrahmanian, Dr. Judee K. Burgoon, Dr. Norah E. Dunbar

Verlag: Springer International Publishing

Buchreihe : Terrorism, Security, and Computation

insite
SUCHEN

Über dieses Buch

This book analyzes the multimodal verbal and nonverbal behavior of humans in both an artificial game, based on the well-known Mafia and Resistance games, as well as selected other settings. This book develops statistical results linking different types of facial expressions (e.g. smile, pursed lips, raised eyebrows), vocal features (e.g., pitch, loudness) and linguistic features (e.g., dominant language, turn length) with both unary behaviors (e.g. is person X lying?) to binary behaviors (Is person X dominant compared to person Y? Does X trust Y? Does X like Y?). In addition, this book describes machine learning and computer vision-based algorithms that can be used to predict deception, as well as the visual focus of attention of people during discussions that can be linked to many binary behaviors. It is written by a multidisciplinary team of both social scientists and computer scientists.

Meetings are at the very heart of human activity. Whether you are involved in a business meeting or in a diplomatic negotiation, such an event has multiple actors, some cooperative and some adversarial. Some actors may be deceptive, others may have complex relationships with others in the group. This book consists of a set of 11 chapters that describe the factors that link human behavior in group settings and attitudes to facial and voice characteristics.

Researchers working in social sciences (communication, psychology, cognitive science) with an interest in studying the link between human interpersonal behavior and facial/speech/linguistic characteristics will be interested in this book. Computer scientists, who are interested in developing machine learning and deep learning based models of human behavior in group settings will also be interested in purchasing this book.

Inhaltsverzeichnis

Frontmatter

Theory Underlying Investigating Deception in Groups

Frontmatter
Chapter 1. Prelude: Relational Communication and the Link to Deception
Abstract
This prelude to the Socio-Cultural Attitudinal Networks project, funded by the U.S. Army Research Office Multi-University Research Initiative, introduces the concept of relational communication and its relationship to interpersonal deception. The research protocol is described wherein groups of interactants engaged in a multi-round game of Resistance during which truthful and deceptive group members (in the role of Villagers or Spies) tried to win or fail the missions. Presented are results of repeated measures regression analyses of group members’ perceptions of one another on relational dimensions of dominance, arousal, and trustworthiness, rated after every two rounds. Discriminant analyses identified final-round trust, baseline dominance, round four trust, and final round trust as the significant predictors of who were the deceivers (Spies) or truth tellers (Villagers). Cross-validated accuracy was 81% for Villagers and 65% for Spies.
Judee K. Burgoon
Chapter 2. An Integrated Spiral Model of Trust
Abstract
Trust is an integral part of interpersonal relationships. Achieving trust is a goal in most relationships, although there are occasions when wariness and distrust are warranted instead. This chapter presents a new model of trust called the “Spiral Model of Trust” which incorporates concepts from a wide range of disciplinary perspectives. The theory’s propositions are meant to shed light on the extent to which trust, once established, remains relatively fixed, or spirals over time in response to the verbal and nonverbal behaviors of participants. Contexts for the application of the Spiral Model of Trust are explored.
Judee K. Burgoon, Norah E. Dunbar, Matthew L. Jensen
Chapter 3. The Impact of Culture in Deception and Deception Detection
Abstract
This chapter examines the role of culture in deception. It opens by explaining how culture has been measured in the research literature, along with the consequences and critiques of those measurement strategies. Next, it explores how culture has been studied previously in the context of deception and addresses variations in those analyses such as interactions within and between people of different cultures. After establishing the current state of research on deception detection by reviewing recent advances, the chapter then explores the role of cultural differences and similarities in modern theorizing about deception. Finally, we discuss the challenges inherent to bridging intercultural communication studies and deception detection research, outline both the pitfalls and best practices for this work, and illustrate how we have chosen to conduct our research in the SCAN project.
Matt Giles, Mohemmad Hansia, Miriam Metzger, Norah E. Dunbar

The SCAN Project

Frontmatter
Chapter 4. A System for Multi-person, Multi-modal Data Collection in Behavioral Information Systems
Abstract
The majority of deception research to date has focused on deception in the context of dyadic communication. Among this body of research are efforts to identify what signals can be used to discriminate deceivers from non-deceivers. The general form of this research involves observing (typically recording to observe and/or manually code after the fact) relevant behaviors of individuals with ground truth knowledge of which individuals are deceiving and which are not. In this chapter, the general process is discussed, and considerations for extending it from dyadic to group observation are considered. Additionally, this chapter provides details of the particular implementation from which many results described in the remainder of this book are found.
Bradley Dorn, Norah E. Dunbar, Judee K. Burgoon, Jay F. Nunamaker, Matt Giles, Brad Walls, Xunyu Chen, Xinran (Rebecca) Wang, Saiying (Tina) Ge, V. S. Subrahmanian
Chapter 5. Dominance in Groups: How Dyadic Power Theory Can Apply to Group Discussions
Abstract
Power is an integral part of group dynamics and when deception is involved, it affects the process of group decision-making as well as the outcomes of those decisions. We examined 95 groups playing a popular party card game called Mafia in which some players were randomly assigned the role of Spies, and others, the role of Villagers. Spies concealed their identity and deceived the other naïve players (the Villagers), who were assumed to be truthful. Data were collected from University students around the world, including in Israel, Singapore, Hong Kong, Fiji, Zambia, and three locations within the U.S. The results revealed differences in the way that players from those different cultural locations exhibited dominance and rated the trustworthiness of other players. In general, more dominant players were seen as more trustworthy, although that was moderated by the cultural location. Spies (deceivers) were viewed as less dominant than Villagers (truth-tellers). Males were rated as more dominant, especially when in the Spy role. The implications for this study on the study of groups and power relations among group members are discussed.
Norah E. Dunbar, Bradley Dorn, Mohemmad Hansia, Becky Ford, Matt Giles, Miriam Metzger, Judee K. Burgoon, Jay F. Nunamaker, V. S. Subrahmanian
Chapter 6. Behavioral Indicators of Dominance in an Adversarial Group Negotiation Game
Abstract
Adversarial group negotiations often involve contentious strategies such as deception and dominance. Understanding characteristics of language and voice associated with deception and dominance helps negotiators identify the use of these strategies and achieve higher self-interests in various use cases, including business negotiations and law enforcement. We aim to expand traditional research on these characteristics from dyadic interactions to group communication. This study follows the same group experiment, a modified Mafia game, as described in the other chapters. Linguistic and vocalic features were extracted from the recorded audio files, and several models were built to examine the predictors of perceived dominance and deceptive cues. Our results show that some features are significantly correlated with dominance as suggested by the existing research, such as lower fundamental frequency, greater variability in loudness, higher voice quality, longer turn-at-talk duration, larger dominance ratio and a greater number of words. However, some features turn out not to be significantly correlated with dominance, such as mean level of loudness, polarity of emotions, hedging ratio and disfluency ratio, though the existing research predicts these relationships. Among our explored features, only turn-at-talk duration is significantly correlated with deceptive status. Our research shows preliminary evidence for the similarities and differences of signals of dominance and deception in dyads and groups and has implications for negotiators in real life.
Steven J. Pentland, Lee Spitzley, Xunyu Chen, Xinran (Rebecca) Wang, Judee K. Burgoon, Jay F. Nunamaker
Chapter 7. Attention-Based Facial Behavior Analytics in Social Communication
Abstract
In this study, we address a cross-domain problem of applying computer vision approaches to reason about human facial behavior when people play The Resistance game. To capture the facial behaviors, we first collect several hours of video where the participants playing The Resistance game assume the roles of deceivers (spies) vs truth-tellers (villagers). We develop a novel attention-based neural network (NN) that advances the state of the art in understanding how a NN predicts the players’ roles. This is accomplished by discovering through learning those pixels and related frames which are discriminative and contributed the most to the NN’s inference. We demonstrate the effectiveness of our attention-based approach in discovering the frames and facial Action Units (AUs) that contributed to the NN’s class decision. Our results are consistent with the current communication theory on deception.
Lezi Wang, Chongyang Bai, Maksim Bolonkin, Judee K. Burgoon, Norah E. Dunbar, V. S. Subrahmanian, Dimitris Metaxas
Chapter 8. Iterative Collective Classification for Visual Focus of Attention Prediction
Abstract
Identifying the visual focus of attention (VFOA) in multi-person discussions is related to many types of social interactions such as dominance/deference, like/dislike, and trust/distrust relationships. However, identifying the VFOA of a person is challenging since it changes rapidly in dynamic discussions. We propose ICAF (Iterative Collective Attention Focus), a system that simultaneously tracks the VFOA and speaking probabilities of all people. In order to apply the system previously unseen videos, we propose a lightly supervised technique to train the model in ICAF with performance which is only slightly worse than in the fully supervised case. Our system can visualize the predicted VFOA and speaking probabilities and interaction networks in videos.
Chongyang Bai, Srijan Kumar, Jure Leskovec, Miriam Metzger, Jay F. Nunamaker, V. S. Subrahmanian

SCAN Project Foundations: Preceding Empirical Investigations of Deception

Frontmatter
Chapter 9. Effects of Modality Interactivity and Deception on Communication Quality and Task Performance
Abstract
This study examines the joint impact of modality interactivity and deception on the quality of group communication and subsequent group outcomes. Communication quality was examined as three meta-dimensions of relational communication, interactional communication, and task communication qualities. Results from two experiments indicated that audio communication performed as well as or better than face-to-face interaction and far better than text on all three communication quality factors. Deception did not impair communication qualities but did impair performance, suggesting that deceivers successfully led group members astray in their decision-making without noticeably damaging the group’s communication. Communication quality meta-dimensions were positively correlated with both perceived and actual task performance.
Joel Helquist, Karl Wiers, Judee K. Burgoon
Chapter 10. Incremental Information Disclosure in Qualitative Financial Reporting: Differences Between Fraudulent and Non-fraudulent Companies
Abstract
This research investigates how fraudulent companies differ in their narrative disclosure strategies across multiple reporting venues. Fraudulent companies must avoid discussing fraud-relevant items, or they must present a fabricated version of their story. To reduce involuntary information disclosure and attempt to convince their audience that what they say is true, fraudulent firms may have greater language similarity than non-fraudulent firms between their quarterly earnings calls and the subsequent Management’s Discussion & Analysis section of the quarterly financial statement. I measure language similarity between a company’s earnings calls and their corresponding financial statements. I find that the Chief Financial Officers of fraudulent companies have significantly higher language similarity between disclosure venues than their non-fraudulent peers. I also test the predictive ability of these measures using several classification schemes, achieving fraud-detection accuracy levels between 53% and 71%. The paper concludes with a discussion of the findings and avenues for future research.
Lee Spitzley
Chapter 11. Cultural Influence on Deceptive Communication
Abstract
The literature on indicators of deception is extensive, yet few rigorous investigations have documented the deceptive communication behavior associated with culture. Notwithstanding, culture can play a profound role in affecting the emotional and cognitive factors that are theorized to differentiate behavioral patterns between deceivers and truth-tellers. To close the considerable gap in our knowledge about deception in cross-cultural contexts, in this chapter, we measured several culturally relevant concepts and tested the relationship among cultural factors, deception, and deception detection. The beginning of the chapter reviews a number of cultural factors and instantiates culture into two prongs: the group-level and the individual-level. Then, we conducted an experiment with the rapid credibility assessment method involving 220 participants across more than ten ethnicity groups to explore how culture affects deception and its detection. Physiological and behavioral indicators have been studied to suggest how culture relates to deceivers’ motivation, cognitive difficulty, and nervousness, as well as their kinesic, vocalic, and linguistic behaviors. The study also examined influences of culture in deceivers’ success and tested behavior measures that could help to predict deception. This investigation establishes the foundation for the SCAN project and paves the way for the future research of culture influence on deceptive communication.
Judee K. Burgoon, Dimitris Metaxas, Jay F. Nunamaker Jr, Saiying (Tina) Ge
Metadaten
Titel
Detecting Trust and Deception in Group Interaction
herausgegeben von
Dr. V. S. Subrahmanian
Dr. Judee K. Burgoon
Dr. Norah E. Dunbar
Copyright-Jahr
2021
Electronic ISBN
978-3-030-54383-9
Print ISBN
978-3-030-54382-2
DOI
https://doi.org/10.1007/978-3-030-54383-9

Premium Partner