Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
Journal on Multimodal User Interfaces
Erschienen in: Journal on Multimodal User Interfaces 3/2015

01.09.2015 | Original Paper

Multimodal interaction with virtual worlds XMMVR: eXtensible language for MultiModal interaction with virtual reality worlds

verfasst von: Hector Olmedo, David Escudero, Valentín Cardeñoso

Erschienen in: Journal on Multimodal User Interfaces | Ausgabe 3/2015

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Based on a philosophy of integrating components from multimodal interaction applications with 3D graphical environments, reusing already defined markup language for describing graphics, graphical and spoken interactions based on the interactive movie metaphor, a markup language for modeling scenes, behavior and interaction is sought. With the definition of this language, we hope to have a common framework for developing applications that allow multimodal interaction at 3D stages. Thus we have defined the basis of an architecture that allows us to integrate the components of such multimodal interaction applications in 3D virtual environments.
Nächster Artikel Typing performance evaluation with multimodal soft keyboard completely integrated in commercial mobile devices

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Literatur
1.
Martin J-C (1998) Tycoon: theoretical and software tools for multimodal interfaces.In: Lee J (ed) Intelligence and Multimodality in Multimedia Interfaces. AAAI Press, California
2.
3.
Dumas B, Lalanne D, Oviatt S (2009) Human machine interaction, In: ch. Multimodal interfaces: a survey of principles, models and frameworks. Springer, Berlin, Heidelberg pp 3–26
4.
Amditis A, Bimpas M, Blach R (2007) Towards networked and structured vr european research area: Intuition network of excellence and future research challenges. MMI Interakt Hum 1:43– 54
5.
Salisbury MW, Hendrickson JH, Lammers TL, Fu C, Moody SA (1990) Talk and draw: bundling speech and graphics. Computer 23:59–65CrossRef
6.
Mcglashan S, Axling T (1996) Talking to agents in virtual worlds. In: Proc of 3rd UK VR-SIG Conference
7.
Billinghurst M (1998) Put that where? Voice and gesture at the graphics interface. SIGGRAPH Comput Graph 32(4):60–63CrossRef
8.
Kaplan RM (1975) On process models for sentence comprehension. Explorations in congnition, San Francisco
9.
Oviatt S, Cohen P (2000) Multimodal interfaces that process what comes naturally. Commun ACM 43:45–53
10.
Gustafson J, Bell L, Beskow J, Boye J, Carlson R, Edlund J, Granström B, House D, Wirn M (2000) AdApt: a multimodal conversational dialogue system in an apartment domain. In: Proceedings of ICSLP 2000, pp 134–137
11.
Nugues P (2000) Verbal interactions in virtual worlds. CoRR, vol. cs.CL/0006027
12.
van Ballegooij A, Eliéns A (2001) Navigation by query in virtual worlds. In: Web3D 01: Proceedings of the sixth international conference on 3D Web technology, (New York, NY, USA), pp 77–83, ACM
13.
Corradini A, Mehta M, ole Bernsen N, Charfuelan M (2005) Animating an interactive conversational character for an educational game system. In: Proceedings of the 10th Int. Conf. on Intelligent User Interfaces, pp 183–190
14.
Kaiser E, Olwal A, McGee D, Benko H, Corradini A, Li X, Cohen P, Feiner S (2003) Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality. In: Proceedings of the 5th international conference on Multimodal interfaces, ICMI ’03, (New York, NY, USA), pp 12–19, ACM
15.
Bouchet J, Nigay L (2004) Icare: a component-based approach for the design and development of multimodal interfaces. In: Dykstra-Erickson E, Tscheligi M (eds) CHI Extended Abstracts, pp 1325–1328, ACM
16.
Bouchet J ( 2004) Icare software components for rapidly developing multimodal interfaces. pp 251–258, ACM Press, Pennsylvania
17.
Serrano M, Nigay L, Lawson J-Y L, Ramsay A, Murray-Smith R, Denef S ( 2004) The openinterface framework: a tool for multimodal interaction. In: CHI ’08 Extended Abstracts on Human Factors in Computing Systems, CHI EA ’08, (New York, NY, USA), pp 3501–3506, ACM
18.
Kipp M, Heloir A, Schröder M, Gebhard P (2010) Realizing multimodal behavior: closing the gap between behavior planning and embodied agent presentation. In: Proceedings of the 10th international conference on Intelligent virtual agents, IVA’10, pp 57–63, Springer, Berlin, Heidelberg
19.
Cerekovic A, Pejsa T, Pandzic IS (2009) Realactor: Character animation and multimodal behavior realization system. In: Proceedings of the 9th International Conference on Intelligent Virtual Agents, IVA ’09, pp 486–487, Springer, Berlin, Heidelberg
20.
van Welbergen H, Reidsma D, Ruttkay ZM, Zwiers J (2010) Elckerlyc-a bml realizer for continuous, multimodal interaction with a virtual human. J Multimodal User Interfaces 3:271–284CrossRef
21.
22.
Mauro Dos Santos Anjo EP, Feuerstack S (2012) A real-time system to recognize static hand gestures of brazilian sign language (libras) alphabet using kinect. In: Proceedings of IHC 2012, the 6th Latin American Conference on Human-Computer Interaction, (Cuiabá/Mato Grosso, Brazil), Nov 5–9 (2012)
23.
Feuerstack S, Pizzolato E (2011) Building multimodal interfaces out of executable, model-based interactors and mappings. In: Proceedings of the HCI International 2011; 14th International Conference on Human-Computer Interaction; Human-Computer Interaction, Part I (J. Jacko, ed.), no. LNCS 6761, (Hilton Orlando Bonnet Creek, Orlando, Florida, USA), pp 221–228, Springer, Heidelberg (2011), Jul 9–14 (2011)
24.
Feuerstack S, Oliveira A, Araujo R (2011) Model-based design of interactions that can bridge realities the augmented drag-and-drop. In: Proceedings of the 13th Symposium on Virtual and Augmented Reality (SVR 2011), (Uberlândia, Minas Gerais, Brazil), 23–26 May 2011. ISSN 2177–676
25.
26.
27.
28.
29.
Hartman J, Wernecke J (1996) The VRML 2.0 handbook: building moving worlds on the web. Addison-Wesley, California
30.
31.
Dachselt R, Rukzio E (2003) BEHAVIOR3D: An XML-Based Framework for 3D Graphics Behavior. In: Web3D 03: Proceeding of the eighth international conference on 3D Web technology, ACM, p 101 (Press)
32.
33.
34.
Erickson TD (1995) Human-computer interaction. In: Working with interface metaphors. Morgan Kaufmann Publishers Inc, San Francisco, CA, USA pp 147–151
35.
36.
Dachselt R (2000) Action spaces: a metaphorical concept to support navigation and interaction in 3d interfaces. In: Workshop Usability Centred Design and Evaluation of Virtual 3D Environments
37.
Mcglashan S, Axling T (1996) A speech interface to virtual environments. In: International Workshop SPEECH AND COMPUTER
38.
Bolt RA (1980) Put-that-there: voice and gesture at the graphics interface. In: SIGGRAPH 80: Proceedings of the 7th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, pp 262–270
39.
40.
41.
42.
43.
44.
45.
Gabbard JL, Hix D, Swan JE (1999) User-centered design and evaluation of virtual environments. IEEE Comput Graph Appl 19:51–59CrossRef
46.
Lund AM (2001) Measuring usability with the use questionnaire
47.
48.
49.
50.
51.
52.
53.
54.
55.
56.
Bevan N (2008) Classifying and selecting UX and usability measures. In: Proceedings of Meaningful Measures: Valid Useful User Experience Measurement (VUUM), 5th COST294-MAUSE Open Workshop
57.
de Lera E, Garreta-Domingo M (2007) Ten emotion heuristics: Guidelines for assessing the user’s affective dimension easily and cost-effectively. In: Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...But Not As We Know It, vol 2, BCS-HCI ’07, British Computer Society, Swinton, UK, UK, pp 163–166
58.
Desmet PMA, Overbeeke CJ, Tax SJET (2001) Designing products with added emotional value: development and application of an approach for research through design. Design J 4(1):32–47CrossRef
Metadaten
Titel
Multimodal interaction with virtual worlds XMMVR: eXtensible language for MultiModal interaction with virtual reality worlds
verfasst von
Hector Olmedo
David Escudero
Valentín Cardeñoso
Publikationsdatum
01.09.2015
Verlag
Springer Berlin Heidelberg
Erschienen in
Journal on Multimodal User Interfaces / Ausgabe 3/2015
Print ISSN: 1783-7677
Elektronische ISSN: 1783-8738
DOI
https://doi.org/10.1007/s12193-015-0176-5

Weitere Artikel der Ausgabe 3/2015

Journal on Multimodal User Interfaces 3/2015 Zur Ausgabe

Original Paper

Synchronizing multimodal recordings using audio-to-audio alignment

Original Paper

Evaluating metaphor reification in tangible interfaces

Original Paper

LMNN metric learning and fuzzy nearest neighbour classifier for hand gesture recognition

Original Paper

Voice activity detection based on facial movement

Original Paper

Learning multimodal behavioral models for face-to-face social interaction

Survey

Nonverbal interaction contextualized in collaborative virtual environments