Skip to main content

2014 | Buch

An Evaluation Framework for Multimodal Interaction

Determining Quality Aspects and Modality Choice

insite
SUCHEN

Über dieses Buch

This book presents (1) an exhaustive and empirically validated taxonomy of quality aspects of multimodal interaction as well as respective measurement methods, (2) a validated questionnaire specifically tailored to the evaluation of multimodal systems and covering most of the taxonomy‘s quality aspects, (3) insights on how the quality perceptions of multimodal systems relate to the quality perceptions of its individual components, (4) a set of empirically tested factors which influence modality choice, and (5) models regarding the relationship of the perceived quality of a modality and the actual usage of a modality.

Inhaltsverzeichnis

Frontmatter
Chapter 1. Introduction
Abstract
Multimodal systems have come a long way since Bolt presented his “Put-that-there-demonstrator” in the 1980s (Bolt 1980). For a long time multimodal interfaces were of interest only to academics and industrial researchers, with the majority of commercial interactive systems allowing input only via the keyboard or through direct manipulation of devices such as a mouse, and offering only graphical output.
Ina Wechsung
Chapter 2. What Are Multimodal Systems? Why Do They Need Evaluation?—Theoretical Background
Abstract
The following section introduces relevant concepts and definitions. After that, the cognitive foundations of multimodal interaction are briefly described. Next current evaluation methods are introduced and reviewed with respect to their appropriateness regarding multimodal systems.
Ina Wechsung
Chapter 3. What to Evaluate? A Taxonomy of Quality Aspects of Multimodal Interfaces
Abstract
Apart from the lack of evaluation methods specifically addressing multimodal interfaces, it is often not defined, which aspects need to be taken into consideration when evaluating a multimodal systems quality. This is partly due to the characteristic of multimodal interaction, making it necessary to measure additional concepts like the appropriateness of modality and context or interference between different modalities. Apart from these multimodality specific issues, also new topics, like emotions in the context of HCI and hedonic qualities of user interfaces, made it obvious that the traditional concept of usability might not be sufficient to ensure quality or user satisfaction.
Ina Wechsung
Chapter 4. How to Evaluate? Development of the MMQQ (MultiModal Quality Questionnaire)
Abstract
In the this chapter the development of the MultiModal Quality Questionnaire (MMQQ) is described. One aim was to build a psychometrically validated, reliable instrument for assessing the quality of multimodal interaction; second aim was to validate and, if necessary adapt, the taxonomy of Möller et al. (2009), Wechsung et al. (2012a). Accordingly, the taxonomy presented in Möller et al. (2009) served as the theoretical base of the questionnaire.
Ina Wechsung
Chapter 5. Is the Whole the Sum of its Parts?—Predicting the Quality of Multimodal Systems Based on Judgments of Single Modalities
Abstract
In this chapter, three studies are described aiming to investigate whether ratings of the individual components of multimodal systems are suitable to estimate the quality of the whole system. With respect to early development stages such an approach could be especially beneficial in getting a rough approximation of the quality of a system, without the need of deploying complex evaluation procedures, which currently are often required for testing multimodal systems.
Ina Wechsung
Chapter 6. What Determines Modality Selection Strategies?—Identifying Factors Influencing Modality Selection and Perceived Quality
Abstract
The following chapter is divided into three sections, each of which focuses on a specific factor assumed to influence modality selection strategies, as well as performance and quality perceptions. Each section reviews relevant previous work in the field that provides a theoretical basis for the empirical studies which follow.
Ina Wechsung
Chapter 7. Is Modality Selection Predictable?—Using Quality Ratings to Predict Modality Selection in Multimodal Systems
Abstract
According to the studies presented in Chap. 5, the quality ratings for a multimodal system are equal to the weighted sum of the quality ratings of its individual modalities, with the modality that is more frequently used having a stronger influence. These findings suggest that, if the choice of modality can be predicted, an estimation of the quality of the multimodal systems is possible based solely on an evaluation of its component modalities. In Chap. 6 the relative efficiency in terms of interaction steps, situational demands, and user characteristics were identified as factors influencing modality selection. Considering all those factors would result in a highly complex user study.
Ina Wechsung
Chapter 8. Summary and Outlook
Abstract
This thesis started with an introduction of key concepts of multimodal interaction and a review of currently available evaluation methods (Chapter 2). It was concluded that although multimodal systems have entered the mass market, evaluation methods specifically tailored to multimodal systems are rather rare and that a widely accepted standard method is not available. Hence, the constructs assessed when evaluating multimodal systems are quite diverse and therefore difficult to compare.
Ina Wechsung
Backmatter
Metadaten
Titel
An Evaluation Framework for Multimodal Interaction
verfasst von
Ina Wechsung
Copyright-Jahr
2014
Electronic ISBN
978-3-319-03810-0
Print ISBN
978-3-319-03809-4
DOI
https://doi.org/10.1007/978-3-319-03810-0

Neuer Inhalt