Hyeonggeun Yun
Auejin Ham
ABSTRACT
Use of chatbots for emotional exchange is recently increasing in various domains. However, as existing chatbots have been considered in terms of natural language processing techniques for interaction with text-based chatting, chatbot interaction with users is lacking in terms of considering the emotions of users and managing turn-taking in conversation. This paper suggests an interaction technique having touch interactions with graphic interfaces (TwG) to solve these problems. In the system, users send their emotions and manage turn-taking through TwG technique. We conducted a Wizard of Oz study to evaluate user experience on emotional expression and turn-taking with TwG technique. Results showed that TwG interaction improved emotional expression compared to a traditional text-based chatbot interaction. Furthermore, the results showed that TwG positively affects natural turn-taking of the conversation.
- Ali Ahmadvand, Jason Ingyu Choi, and Eugene Agichtein. 2019. Contextual Dialogue Act Classification for Open-Domain Conversational Agents. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '19). Association for Computing Machinery, New York, NY, USA, 1273--1276. DOI:https://doi.org/10.1145/3331184.3331375Google Scholar
Digital Library
- Juan Felipe Beltran, Ziqi Huang, Azza Abouzied, and Arnab Nandi. 2017. Don't just swipe left, tell me why: Enhancing gesture-based feedback with reason bins. In Proceedings of the 22nd International Conference on Intelligent User Interfaces (IUI '17). Association for Computing Machinery, New York, NY, USA, 469--480. DOI:https://doi.org/10.1145/3025171.3025212Google ScholarDigital Library
- Joyce Chai, Veronika Horvath, Nicolas Nicolov, Margo Stys, Nanda Kambhatla, Wlodek Zadrozny, and Prem Melville. 2002. Natural language assistant: A dialog system for online product recommendation. AI Magazine 23, 2 (2002), 63. DOI:https://doi.org/10.1609/aimag.v23i2.1641Google ScholarDigital Library
- Shammur Absar Chowdhury, Evgeny A. Stepanov, and Giuseppe Riccardi. 2016. Predicting User Satisfaction from Turn-Taking in Spoken Conversations. In INTERSPEECH. 2910--2914. DOI:10.21437/Interspeech.2016--859Google Scholar
- Daantje Derks, Arjan E.R. Bos, and Jasper Von Grumbkow. 2007. Emoticons and social interaction on the Internet: the importance of social context. Computers in human behavior 23, 1 (2007), 842--849. DOI:https://doi.org/10.1016/j.chb.2004.11.013Google Scholar
- Shichuan Du, Yong Tao, and Aleix M Martinez. 2014. Compound facial expressions of emotion. Proceedings of the National Academy of Sciences 111, 15 (2014). E1454-E1462. DOI:https://doi.org/10.1073/pnas.1322355111Google ScholarCross Ref
- Paul Ekman. 1992. An argument for basic emotions. Cognition & emotion 6, 3-4 (1992), 169--200. DOI:https://doi.org/10.1080/02699939208411068Google Scholar
- Emer Gilmartin and Carl Vogel. 2018. Chat, Chunk and Topic in Casual Conversation. In Proceedings 14th Joint ACL-ISO Workshop on Interoperable Semantic Annotation. 45--52.Google Scholar
- Matthew J. Hertenstein, Rachel Holmes, Margaret McCullough, and Dacher Keltner. 2009. The communication of emotion via touch. Emotion, 9(4), 566. DOI:https://doi.org/10.1037/a0016108Google ScholarCross Ref
- Ursula Hess and Agneta Fischer. 2014. Emotional mimicry: Why and when we mimic emotions. Social and Personality Psychology Compass 8, 2 (2014), 45--57. DOI:https://doi.org/10.1111/spc3.12083Google ScholarCross Ref
- Naz Kaya and Helen H. Epps. 2004. Relationship between color and emotion: A study of college students. College Student Journal 38, 3 (2004), 396--405.Google Scholar
- Hemkesh Vijaya Kumar, Jeevan Nagaraj, Mohammed Irfan, Nilisha Maheshwari, Pooja Balusani, Pratik Chatterjee, and Gowri Srinivasa. 2018. PESUBot: An Empathetic Goal Oriented Chatbot. In 2018 International Conference on Advances in Computing, Communications and Informatics (ICACCI). IEEE, 1083--1089. DOI:10.1109/ICACCI.2018.8554916Google Scholar
- Joon Young Lee, Nahi Hong, Soomin Kim, Jonghwan Oh, and Joonhwan Lee. 2016. Smiley face: why we use emoticon stickers in mobile messaging. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). Association for Computing Machinery, New York, NY, USA, 760--766. DOI:https://doi.org/10.1145/2957265.2961858Google ScholarDigital Library
- Shao-Kang Lo. 2008. The nonverbal communication functions of emoticons in computer-mediated communication. CyberPsychology & Behavior 11, 5 (2008), 595--597. DOI: https://doi.org/10.1089/cpb.2007.0132Google ScholarCross Ref
- R. M. Maatman, Jonathan Gratch, and Stacy Marsella. 2005. Natural behavior of a listening agent. In International Workshop on Intelligent Virtual Agents. Springer, 25--36. DOI: https://doi.org/10.1007/11550617_3Google ScholarDigital Library
- Young-Woo Park, Kyoung-Min Baek, and Tek-Jin Nam. 2013. The roles of touch during phone conversations: long-distance couples' use of POKE in their homes. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). Association for Computing Machinery, New York, NY, USA, 1679--1688. DOI:https://doi.org/10.1145/2470654.2466222Google ScholarDigital Library
- Volker Roth and Thea Turner. 2009. Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). Association for Computing Machinery, New York, NY, USA, 1523--1526. DOI:https://doi.org/10.1145/1518701.1518933Google ScholarDigital Library
- Sherry Ruan, Liwei Jiang, Justin Xu, Bryce Joe-Kun Tham, Zhengneng Qiu, Yeshuang Zhu, Elizabeth L Murnane, Emma Brunskill, and James A. Landay. 2019. QuizBot: A Dialogue-based Adaptive Learning System for Factual Knowledge. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, New York, NY, USA, Paper 357, 1--13. DOI:https://doi.org/10.1145/3290605.3300587Google ScholarDigital Library
- Joseph B. Walther and Lisa C. Tidwell. 1995. Nonverbal cues in computer-mediated communication, and the effect of chronemics on relational communication. Journal of Organizational Computing and Electronic Commerce 5, 4 (1995), 355--378. DOI:https://doi.org/10.1080/10919399509540258Google ScholarCross Ref
- Ziang Xiao, Michelle X. Zhou, and Wat-Tat Fu. 2019. Who should be my teammates: Using a conversational agent to understand individuals and help teaming. In Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI '19). Association for Computing Machinery, New York, NY, USA, 437--447. DOI:https://doi.org/10.1145/3301275.3302264Google ScholarDigital Library
- Anbang Xu, Zhe Liu, Yufan Guo, Vibha Sinha, and Rama Akkiraju. 2017. A new chatbot for customer service on social media. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). Association for Computing Machinery, New York, NY, USA, 3506--3510. DOI:https://doi.org/10.1145/3025453.3025496Google ScholarDigital Library
Index Terms
- Chatbot with Touch and Graphics: An Interaction of Users for Emotional Expression and Turn-taking
Recommendations
Action-a-Bot: Exploring Human-Chatbot Conversations for Actionable Instruction Giving and Following
CSCW'22 Companion: Companion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social ComputingConversation serves as one critical mechanism for knowledge-sharing and instruction-giving in collaborative work. Conversation allows people to take turns to make contributions, plan joint actions, align shared understanding of work status and resolve ...
Emojifying chatbot interactions: An exploration of emoji utilization in human-chatbot communications
Highlights- Emojis increase chatbots' service satisfaction, mediated by warmth perception. This effect is weaker for chatbots than humans.
- The study contributes a nuanced understanding of the CASA paradigm regarding inconsistencies in social ...
AbstractThe prevalence of chatbots in human–computer communication has significantly increased. Emojis, as a form of emotional disclosure, have gained significant attention for their potential to boost chatbot service satisfaction. However, how and when ...
Online Psychological Counseling Chatbot for Seniors
ICAAI '22: Proceedings of the 6th International Conference on Advances in Artificial IntelligenceWe introduce an online psychological counseling chatbot that uses the Task-Oriented Dialogue (TOD) system and the open-domain dialogue (ODD) system to communicate and recommend content as an emotion recognition result. If you use the TOD system, which ...
Comments