Emblem Recognition: Cultural Coaching Software via Hand Gestures

Negotiations and casual exchanges that involve different cultures may often lead to misunderstandings and eventually adverse outcomes. These conflicts can be easily avoided if both parties are familiarized with each other’s culture. This paper proposes a novel way of tackling this problem by using computer vision and identifying hand gestures that are particular to a culture. Such gestures, also known as emblems, are used frequently during interaction. There is a certain complexity to emblems, and their identification could provide vital information during communication if recognized accurately. An example for this case is the “thumbs up” gesture, where the thumb is extended while the other fingers are curled up. This gesture, while positive in the West, can be insulting in other countries. The implemented computer vision software was able to detect five distinct hand gestures that had one specific meaning in the United States, as well as other connotations in other countries. This helped inform participants with residency in the United States about additional meanings of familiar hand gestures that are commonly used in North America. The main purpose of culturally-sensitive technology is to help a user get acquainted with socio-cultural particularities of another group. Possible applications are discussed further, such as serving as a cultural interpreter during a diplomatic or business exchange or aiding in cultural sensibility training for tourists traveling to a new country.