nach oben

KI - Künstliche Intelligenz

Erschienen in:

01.05.2012 | Fachbeitrag

Collaborative Multimodality

verfasst von: Daniel Sonntag

Erschienen in: KI - Künstliche Intelligenz | Ausgabe 2/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

This essay is a personal reflection from an Artificial Intelligence (AI) perspective on the term HCI. Especially for the transfer of AI-based HCI into industrial environments, we survey existing approaches and examine how AI helps to solve fundamental problems of HCI technology. The user and the system must have a collaborative goal. The concept of collaborative multimodality could serve as the missing link between traditional HCI and intuitive human-centred designs in the form of, e.g., natural language interfaces or intelligent environments. Examples are provided in the medical imaging domain.

Vorheriger Artikel Analysing Interactivity in Information Visualisation

Nächster Artikel Designing for a Moving Target

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

KI - Künstliche Intelligenz

The Scientific journal "KI – Künstliche Intelligenz" is the official journal of the division for artificial intelligence within the "Gesellschaft für Informatik e.V." (GI) – the German Informatics Society - with constributions from troughout the field of artificial intelligence.

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

A comprehensive overview of ontology-based dialogue processing and the systematic realisation of these properties can be found in [30], pp. 71–131.

For the identification of these usability issues, the binocular view (AI and HCI) of interactive intelligent systems might be interesting to the reader (discussed in detail in [14]).

http://www.youtube.com/watch?v=uBiN119_wvg.

Anind Dey SR, Veloso M (2009) Using interaction to improve intelligence: How intelligent systems should ask users for input. In: Proceedings of the IJCAI workshop on intelligence and interaction

Brown P, Levinson SC (1987) Politeness: some universals in language usage. Studies in Interactional Sociolinguistics. Cambridge University Press, Cambridge

Bunt H, Beun RJ (2001) Cooperative multimodal communication. In: Bunt H, Beun RJ (eds) Cooperative multimodal communication, revised papers. Lecture notes in computer science, vol 2155. Springer, Berlin CrossRef

Bunt H, Kipp M, Maybury MT, Wahlster W (2003) Fusion and coordination for multimodal interactive information presentation. In: Stock O, Zancanaro M (eds) Intelligent information presentation. Kluwer Academic, Norwell

van Dam H (2003) Dialogue acts in GUIs. PhD thesis, Eindhoven University of Technology

Fensel D, Hendler JA, Lieberman H, Wahlster W (eds) (2003) Spinning the semantic web: bringing the world wide web to its full potential. MIT Press, Cambridge

Gajos KZ, Wobbrock JO, Weld DS (2008) Improving the performance of motor-impaired users with automatically-generated, ability-based interfaces. In: Proceeding of the twenty-sixth annual SIGCHI conference on human factors in computing systems (CHI ’08). ACM, New York, pp 1257–1266 CrossRef

Goebel R, Williams MA (2011) The expansion continues: Stitching together the breadth of disciplines impinging on artificial intelligence. Artif Intell 175(5–6):929 MathSciNetCrossRef

Hammond T, Davis R (2005) Ladder, a sketching language for user interface developers. Comput Graph 28:518–532 CrossRef

10.

Hanson P, Rich C (2010) A non-modal approach to integrating dialogue and action. In: Proceedings of the sixth AAAI conference on artificial intelligence and interactive digital entertainment (AIIDE). AAAI Press, Menlo Park

11.

Hitzler P, Krötzsch M, Rudolph S (2009) Foundations of semantic web technologies. Chapman & Hall/CRC, London

12.

Horvitz E (1999) Uncertainty, action, and interaction: In pursuit of mixed-initiative computing. IEEE Intell Syst 14:17–20

13.

Ingwersen P (1992) Information retrieval interaction. Taylor Graham, London. URL: citeseer.ist.psu.edu/ingwersen92information.html

14.

Jameson AD, Spaulding A, Yorke-Smith N (2009) Introduction to the special issue on “Usable AI”. AI Mag 3(4):11–16

15.

Kaizer S, Bunt H (2006) Multidimensional dialogue management. In: Proceedings of the 7th SigDial workshop on discourse and dialogue, Sydney, Australia

16.

Lieberman H (2009) User interface goals, AI opportunities. AI Mag 30(4):16–22

17.

Maybury M, Wahlster W (eds) (1998) Intelligent user interfaces. Morgan Kaufmann, San Francisco

18.

Maybury MT, Stock O, Wahlster W (2006) Intelligent interactive entertainment grand challenges. In: Proc of IEEE intelligent systems pp. 14–18

19.

McQuiggan SW, Lester JC (2007) Modeling and evaluating empathy in embodied companion agents. Int J Hum-Comput Stud 65(4):348–360. doi:10.1016/j.ijhcs.2006.11.015 CrossRef

20.

Mitchell TM (1997) Machine learning. McGraw-Hill, New York MATH

21.

Möller M, Regel S, Sintek M (2009) Radsem: semantic annotation and retrieval for medical images. In: Proc of the 6th annual European semantic web conference (ESWC2009)

22.

Nelson TO, Narens L, Bower GH (eds) (1990) The psychology of learning and motivation: advances in research and theory, vol 26, chap: Metamemory: a theoretical framework and new findings. Academic Press, San Diego, pp 125–169

23.

Oviatt S (1999) Ten myths of multimodal interaction. Commun ACM 42(11):74–81 URL: citeseer.nj.nec.com/oviatt99ten.html CrossRef

24.

Paley WB (2009) Interface and mind—a “paper lecture” about a domain-specific design methodology based on contemporary mind science (Benutzerschnittstelle und Verstand – Über eine Design-Methodik basierend auf aktuellen Erkenntnissen der Psychologie). Inf Technol 51(3):131–141

25.

Reithinger N, Fedeler D, Kumar A, Lauer C, Pecourt E, Romary L (2005) MIAMM—a multimodal dialogue system using haptics. In: van Kuppevelt J, Dybkjaer L, Bernsen NO (eds) Advances in natural multimodal dialogue systems. Springer, Berlin

26.

Reithinger N, Sonntag D (2005) An integration framework for a mobile multimodal dialogue system accessing the semantic web. In: Proceedings of INTERSPEECH, Lisbon, Portugal, pp 841–844

27.

Rich C, Sidner CL, Lesh N (2001) Collagen: applying collaborative discourse theory to human-computer interaction. AI Mag 22(4):15–26

28.

Russell S, Norvig P (2003) Artificial intelligence: a modern approach, 2nd edn. Prentice-Hall, Englewood Cliffs

29.

Sonntag D (2009) Introspection and adaptable model integration for dialogue-based question answering. In: Proceedings of the twenty-first international joint conferences on artificial intelligence (IJCAI).

30.

Sonntag D (2010) Ontologies and adaptivity in dialogue for question answering. AKA/IOS Press, Heidelberg MATH

31.

Sonntag D (2011) Computing with instinct. Chap.: Intuition as instinctive dialogue. Lecture notes in artificial intelligence, vol 5897. Springer, Heidelberg, pp 82–106

32.

Sonntag D, Engel R, Herzog G, Pfalzgraf A, Pfleger N, Romanelli M, Reithinger N (2007) SmartWeb handheld—multimodal interaction with ontological knowledge bases and semantic web services. Lecture notes in computer science, vol 4451. Springer, Berlin, pp 272–295

33.

Sonntag D, Reithinger N, Herzog G, Becker T (2010) Proceedings of IWSDS—spoken dialogue systems for ambient environment, Chap.: A discourse and dialogue Infrastructure for industrial dissemination. Lecture notes in artificial intelligence, vol 44. Springer, Berlin, pp 132–143

34.

Wahlster W (ed) (2000) VERBMOBIL: foundations of speech-to-speech translation. Springer, Berlin MATH

35.

Wahlster W (2003) SmartKom: symmetric multimodality in an adaptive and reusable dialogue shell. In: Krahl R, Günther D (eds) Proceedings of the human computer interaction status conference 2003. DLR, Berlin, pp 47–62

Titel: Collaborative Multimodality
verfasst von: Daniel Sonntag
Publikationsdatum: 01.05.2012
Verlag: Springer-Verlag
Erschienen in: KI - Künstliche Intelligenz / Ausgabe 2/2012
Print ISSN: 0933-1875
Elektronische ISSN: 1610-1987
DOI: https://doi.org/10.1007/s13218-012-0169-4

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

KI - Künstliche Intelligenz

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 2/2012

Measuring Subjectivity

Yorick Wilks (ed.): “Close Engagements with Artificial Companions” (2010)

Jubiläums-Fragen – Zum 25. Jahrgang von KI

Incorporating Usability Evaluation in Software Development Environments

Sol: An Agent-Based Framework for Cyber Situation Awareness

Visual Versus Verbal Location Information on the iPhone

Premium Partner