Skip to main content

2014 | Buch

Conversational Informatics

A Data-Intensive Approach with Emphasis on Nonverbal Communication

verfasst von: Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad

Verlag: Springer Japan

insite
SUCHEN

Über dieses Buch

This book covers an approach to conversational informatics which encompasses science and technology for understanding and augmenting conversation in the network age. A major challenge in engineering is to develop a technology for conveying not just messages but also underlying wisdom. Relevant theories and practices in cognitive linguistics and communication science, as well as techniques developed in computational linguistics and artificial intelligence, are discussed.

Inhaltsverzeichnis

Frontmatter
Chapter 1. Artificial Intelligence and Conversational Intelligence
Abstract
Conversation is indispensable in our intellectual life. People may make conversation either to achieve a social goal, to create a joint story, or to just enjoy a language game. Although a conversation has a fairly sophisticated structure and dynamism, people are sufficiently proficient in expressing their thoughts and interpreting utterances of their partners. In this chapter, we will introduce conversational informatics as a new interdisciplinary study that focuses on understanding and augmenting conversations. We will discuss why conversational informatics is important in the history of artificial intelligence research and show our long-term research strategy.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 2. Conversation: Above and Beneath the Surface
Abstract
Conversation is complex. It is amazing how easily participants coordinate their actions to establish a discourse and make points often with little conscious effort in daily conversation save for a few special cases. To date, numerous authors have investigated conversations from a wide variety of angles. In this chapter, we overview major theories that enable us to understand conversation in a structured manner.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 3. History of Conversational System Development
Abstract
Conversational system development dates back to the early days of computer science when pioneering researchers started to take up serious projects aimed at having computers interact with people using natural language. Their endeavors have produced a broad range of theories, techniques, and systems, ranging from basic research to applications, from text to multimodal signals, from dialogue to story, and from computational to cognitive. In this chapter, we will present a bird’s eye view of these activities and highlight epochs relevant to conversational informatics.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 4. Methodologies for Conversational System Development
Abstract
When we build a conversational system, it is necessary to understand that a full-fledged system may become fairly complex if we are to address all the issues related to uncertainty and noise, coherency and consistency in strong time constraints, and a wide spectrum of phenomena across multiple levels of hierarchies. A strong methodological approach is necessary. In this chapter, we discuss a technical basis from a past research regarding architecture, scripting and markup languages, corpus-based approaches, and evaluations.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 5. Conversation Quantization
Abstract
Conversation quantization is a conceptual framework used for capturing and reusing shared meanings and expressions in a conversation. As a generic framework, it encompasses different implementations ranging in granularity, depth and breadth of annotation, representational fidelity, and generality. In this chapter, we discuss the scope and requirements of conversation quantization, the range of basic functions necessary for individual implementation, and the space of potential implementation. We also sketch out the idea of a portable conversation space for maximizing the potential of conversation quantization.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 6. Smart Conversation Space
Abstract
The spatial environment surrounding participants in conversation has a critical, if not conclusive, influence on the qualitative and quantitative aspects of conversation conducted therein. Imagine how awful the conversation would be if one had to converse with a stranger in a vacuum with only the two of you present. A contrastive situation would be one in which the conversation takes place in a cheerful cafe surrounded by other people with a soft wind blowing off the distant mountains and a relaxing atmosphere on the nearby beach. The role of a smart conversation space is twofold: to improve a given space with augmented reality or build a virtual space to support conversation and second, to record and measure conversation not only for better user services, but also for better scientific investigation of conversation in both ordinary and smart spaces.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 7. Computer Vision Techniques for Conversational Interaction
Abstract
In this chapter, we focus on the computer vision, image understanding and image synthesis approaches related to develop the conversation systems, namely, finding human faces, recognizing facial expressions and gestures, and synthesizing facial expressions and body gestures. In Chaps. 2–4, we introduce the theory, history and techniques for organizing conversation systems, then show the concept of the conversational quantization in the Chap. 5. In developing these systems in the real world, visual information is one of the most important input because it can be applied for varieties of tasks including the recognition of conversational interactions, and the capturing and synthesis of conversational contents.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 8. Measurement, Analysis and Modeling
Abstract
Better understanding of conversation paves the way towards better conversational systems. In this chapter we shed light on the practical aspects of multi-modal interaction analysis towards a better understanding of conversation as a phenomenon. On the one hand, investigators need to take great care of methodological issues, since conversation involves plenty of subtleties. Incorporating physiological signals allows us to base our understanding on a more solid foundation than merely depending on audio-visual data, which is extrinsic from the viewpoint of mental processes. Collaborative support tools help annotators share their experiences thereby improving the efficiency and quality of the annotation process. On the other hand, investigators are encouraged to learn from past experiences in terms of how experiments were conducted to derive useful insights. For this reason we report in this chapter three case studies that showcase different issues in measurement, analysis and modeling of conversation and interaction in general.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 9. From Observation to Interaction
Abstract
In this chapter, we will describe a framework of learning by mimicking for converting observation into proficient conversational behaviors. Individuals of some species can utilize the learning capacities of other individuals by mimicking their behavior. When this happens, biologists speak about culture. Humans are arguably the most sophisticated cultured species on earth and learning by imitation or mimicry lies at the root of their cultural abilities within which interaction and conversational behavior exists. This chapter starts by providing a general framework for learning by imitation covering its architecture and algorithmic details. It then moves on to describe applications of this framework in learning interactive behavior both as implicit and explicit interaction protocols. The insights learned from theoretical and experimental considerations are then utilized to provide a general framework for fluid agent-initiated imitation in the following chapter.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 10. Applications of Simulation and Imitation for Interaction Learning
Abstract
In this chapter, we will describe two case studies that utilized the architecture presented in Chap. 9 which utilizes ideas from the simulation theory of mind for behavior generation during interaction and imitation learning as a technique to develop the required computational processes needed. The first case study will be concerned with gaze behavior during face-to-face interactions while the second will be concerned with a newly proposed paradigm for learning from demonstration that we call fluid imitation. Fluid imitation allows the agent to learn interactive behavior (or any kind of behavior) not only through intended demonstrations but from unintended ones during day-to-day operation. The chapter concludes with some ideas for other possible applications of the architecture to other aspects of conversational informatics.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 11. Cognitive Design for Discussion Support
Abstract
Conversation is not only a joint activity in itself, but also a means for joint activity. Discussions can benefit from augmented conversation in stimulating, editing, disseminating, and reusing conversations. Conversational intelligence empowered by conversational agents allows wisdom exchanged in conversation to be shared and evolved in a community. Cognitive design allows for deeper support for discussions by allowing conversational agents to sense social signals, estimating the tacit intentions of discussants, and even leading discussions in a direction potentially preferred by the discussants. In this chapter, we present some pilot studies on grounding conversational support at the cognitive level.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 12. Discussions
Abstract
In this chapter, we discuss some high-level issues left beyond the scope of this book but deemed critical for future research. We first place conversational intelligence and conversational informatics in a larger picture of conversational knowledge circulation and social intelligence design to discuss issues from a wider perspective. We then single out ethical issues as centric to social issues and discuss the role of conversational informatics in the context of moral agents in human-agent symbiotic society. Finally, we come back to empathic agents as discussed in Chap. 1 and elaborate a road map for future study.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Chapter 13. Conclusion
Abstract
This book is the first systematic presentation of conversational informatics. It not only compiled the major outcomes resulting from research and development activities of our group, it also identified the foundations on which we have been relying so far as well as potential directions of future research on this subject. Topics are laid from the fundamentals to the advanced technical issues followed by discussions about future work.
Toyoaki Nishida, Atsushi Nakazawa, Yoshimasa Ohmoto, Yasser Mohammad
Backmatter
Metadaten
Titel
Conversational Informatics
verfasst von
Toyoaki Nishida
Atsushi Nakazawa
Yoshimasa Ohmoto
Yasser Mohammad
Copyright-Jahr
2014
Verlag
Springer Japan
Electronic ISBN
978-4-431-55040-2
Print ISBN
978-4-431-55039-6
DOI
https://doi.org/10.1007/978-4-431-55040-2

Neuer Inhalt