Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
KI - Künstliche Intelligenz
Published in: KI - Künstliche Intelligenz 2/2012

01-05-2012 | Fachbeitrag

Collaborative Multimodality

Author: Daniel Sonntag

Published in: KI - Künstliche Intelligenz | Issue 2/2012

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This essay is a personal reflection from an Artificial Intelligence (AI) perspective on the term HCI. Especially for the transfer of AI-based HCI into industrial environments, we survey existing approaches and examine how AI helps to solve fundamental problems of HCI technology. The user and the system must have a collaborative goal. The concept of collaborative multimodality could serve as the missing link between traditional HCI and intuitive human-centred designs in the form of, e.g., natural language interfaces or intelligent environments. Examples are provided in the medical imaging domain.
previous article Analysing Interactivity in Information Visualisation
next article Designing for a Moving Target

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

KI - Künstliche Intelligenz

The Scientific journal "KI – Künstliche Intelligenz" is the official journal of the division for artificial intelligence within the "Gesellschaft für Informatik e.V." (GI) – the German Informatics Society - with constributions from troughout the field of artificial intelligence.

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
Show more products
Footnotes
1
A comprehensive overview of ontology-based dialogue processing and the systematic realisation of these properties can be found in [30], pp. 71–131.
 
2
For the identification of these usability issues, the binocular view (AI and HCI) of interactive intelligent systems might be interesting to the reader (discussed in detail in [14]).
 
Literature
1.
Anind Dey SR, Veloso M (2009) Using interaction to improve intelligence: How intelligent systems should ask users for input. In: Proceedings of the IJCAI workshop on intelligence and interaction
2.
Brown P, Levinson SC (1987) Politeness: some universals in language usage. Studies in Interactional Sociolinguistics. Cambridge University Press, Cambridge
3.
Bunt H, Beun RJ (2001) Cooperative multimodal communication. In: Bunt H, Beun RJ (eds) Cooperative multimodal communication, revised papers. Lecture notes in computer science, vol 2155. Springer, Berlin CrossRef
4.
Bunt H, Kipp M, Maybury MT, Wahlster W (2003) Fusion and coordination for multimodal interactive information presentation. In: Stock O, Zancanaro M (eds) Intelligent information presentation. Kluwer Academic, Norwell
5.
van Dam H (2003) Dialogue acts in GUIs. PhD thesis, Eindhoven University of Technology
6.
Fensel D, Hendler JA, Lieberman H, Wahlster W (eds) (2003) Spinning the semantic web: bringing the world wide web to its full potential. MIT Press, Cambridge
7.
Gajos KZ, Wobbrock JO, Weld DS (2008) Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces. In: Proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems (CHI ’08). ACM, New York, pp 1257–1266 CrossRef
8.
Goebel R, Williams MA (2011) The expansion continues: Stitching together the breadth of disciplines impinging on artificial intelligence. Artif Intell 175(5–6):929 MathSciNetCrossRef
9.
Hammond T, Davis R (2005) Ladder, a sketching language for user interface developers. Comput Graph 28:518–532 CrossRef
10.
Hanson P, Rich C (2010) A non-modal approach to integrating dialogue and action. In: Proceedings of the sixth AAAI conference on artificial intelligence and interactive digital entertainment (AIIDE). AAAI Press, Menlo Park
11.
Hitzler P, Krötzsch M, Rudolph S (2009) Foundations of semantic web technologies. Chapman & Hall/CRC, London
12.
Horvitz E (1999) Uncertainty, action, and interaction: In pursuit of mixed-initiative computing. IEEE Intell Syst 14:17–20
13.
14.
Jameson AD, Spaulding A, Yorke-Smith N (2009) Introduction to the special issue on “Usable AI”. AI Mag 3(4):11–16
15.
Kaizer S, Bunt H (2006) Multidimensional dialogue management. In: Proceedings of the 7th SigDial workshop on discourse and dialogue, Sydney, Australia
16.
Lieberman H (2009) User interface goals, AI opportunities. AI Mag 30(4):16–22
17.
Maybury M, Wahlster W (eds) (1998) Intelligent user interfaces. Morgan Kaufmann, San Francisco
18.
Maybury MT, Stock O, Wahlster W (2006) Intelligent interactive entertainment grand challenges. In: Proc of IEEE intelligent systems pp. 14–18
19.
20.
Mitchell TM (1997) Machine learning. McGraw-Hill, New York MATH
21.
Möller M, Regel S, Sintek M (2009) Radsem: semantic annotation and retrieval for medical images. In: Proc of the 6th annual European semantic web conference (ESWC2009)
22.
Nelson TO, Narens L, Bower GH (eds) (1990) The psychology of learning and motivation: advances in research and theory, vol 26, chap: Metamemory: a theoretical framework and new findings. Academic Press, San Diego, pp 125–169
23.
Oviatt S (1999) Ten myths of multimodal interaction. Commun ACM 42(11):74–81 URL: citeseer.nj.nec.com/oviatt99ten.html CrossRef
24.
Paley WB (2009) Interface and mind—a “paper lecture” about a domain-specific design methodology based on contemporary mind science (Benutzerschnittstelle und Verstand – Über eine Design-Methodik basierend auf aktuellen Erkenntnissen der Psychologie). Inf Technol 51(3):131–141
25.
Reithinger N, Fedeler D, Kumar A, Lauer C, Pecourt E, Romary L (2005) MIAMM—a multimodal dialogue system using haptics. In: van Kuppevelt J, Dybkjaer L, Bernsen NO (eds) Advances in natural multimodal dialogue systems. Springer, Berlin
26.
Reithinger N, Sonntag D (2005) An integration framework for a mobile multimodal dialogue system accessing the semantic web. In: Proceedings of INTERSPEECH, Lisbon, Portugal, pp 841–844
27.
Rich C, Sidner CL, Lesh N (2001) Collagen: applying collaborative discourse theory to human-computer interaction. AI Mag 22(4):15–26
28.
Russell S, Norvig P (2003) Artificial intelligence: a modern approach, 2nd edn. Prentice-Hall, Englewood Cliffs
29.
Sonntag D (2009) Introspection and adaptable model integration for dialogue-based question answering. In: Proceedings of the twenty-first international joint conferences on artificial intelligence (IJCAI).
30.
Sonntag D (2010) Ontologies and adaptivity in dialogue for question answering. AKA/IOS Press, Heidelberg MATH
31.
Sonntag D (2011) Computing with instinct. Chap.: Intuition as instinctive dialogue. Lecture notes in artificial intelligence, vol 5897. Springer, Heidelberg, pp 82–106
32.
Sonntag D, Engel R, Herzog G, Pfalzgraf A, Pfleger N, Romanelli M, Reithinger N (2007) SmartWeb handheld—multimodal interaction with ontological knowledge bases and semantic web services. Lecture notes in computer science, vol 4451. Springer, Berlin, pp 272–295
33.
Sonntag D, Reithinger N, Herzog G, Becker T (2010) Proceedings of IWSDS—spoken dialogue systems for ambient environment, Chap.: A discourse and dialogue Infrastructure for industrial dissemination. Lecture notes in artificial intelligence, vol 44. Springer, Berlin, pp 132–143
34.
Wahlster W (ed) (2000) VERBMOBIL: foundations of speech-to-speech translation. Springer, Berlin MATH
35.
Wahlster W (2003) SmartKom: symmetric multimodality in an adaptive and reusable dialogue shell. In: Krahl R, Günther D (eds) Proceedings of the human computer interaction status conference 2003. DLR, Berlin, pp 47–62
Metadata
Title
Collaborative Multimodality
Author
Daniel Sonntag
Publication date
01-05-2012
Publisher
Springer-Verlag
Published in
KI - Künstliche Intelligenz / Issue 2/2012
Print ISSN: 0933-1875
Electronic ISSN: 1610-1987
DOI
https://doi.org/10.1007/s13218-012-0169-4

Other articles of this Issue 2/2012

KI - Künstliche Intelligenz 2/2012 Go to the issue

Interview

Interview with Alan Kay

Interview

Question/Answering Systems

Editorial

Künstliche und natürliche Intelligenz

Diskussion

Jubiläums-Fragen – Zum 25. Jahrgang von KI

Community

News

Projekt

Visual Versus Verbal Location Information on the iPhone

Premium Partner

    Image Credits