Skip to main content

Journal on Multimodal User Interfaces OnlineFirst articles

Open Access 04-04-2024 | Original Paper

Towards the development of an automated robotic storyteller: comparing approaches for emotional story annotation for non-verbal expression via body language

Storytelling is a long-established tradition and listening to stories is still a popular leisure activity. Caused by technization, storytelling media expands, e.g., to social robots acting as multi-modal storytellers, using different multimodal …

Authors:
Sophia C. Steinhaeusser, Albin Zehe, Peggy Schnetter, Andreas Hotho, Birgit Lugrin

20-11-2019 | Original Paper

Comparison of spatial and temporal interaction techniques for 3D audio trajectory authoring

With the popularity of immersive media, developing usable tools for content development is important for the production process. In the context of 3D audio production, user interfaces for authoring and editing 3D audio trajectories enable content …

Authors:
Justin D. Mathew, Stéphane Huot, Brian F. G. Katz

20-11-2019 | Survey

A comparative assessment of Wi-Fi and acoustic signal-based HCI methods on the practicality

Wi-Fi and acoustic signal-based human–computer interaction (HCI) methods have received growing attention in academia. However, there still are issues to be addressed despite their flourishing. In this work, we evaluate the practicality of the …

Authors:
Hayoung Jeong, Taeho Kang, Jiwon Choi, Jong Kim

16-10-2019 | Original Paper

Analysis of conversational listening skills toward agent-based social skills training

Listening skills are critical for human communication. Social skills training (SST), performed by human trainers, is a well-established method for obtaining appropriate skills in social interaction. Previous work automated the process of social …

Authors:
Hiroki Tanaka, Hidemi Iwasaka, Hideki Negoro, Satoshi Nakamura

24-07-2019 | Original Paper

Are older people any different from younger people in the way they want to interact with robots? Scenario based survey

Numerous projects, normally run by younger people, are exploring robot use by older people. But are older any different from younger people in the way they want to interact with robots? Understanding older compared to younger people’s preferences …

Authors:
Mriganka Biswas, Marta Romeo, Angelo Cangelosi, Ray B. Jones

20-07-2019 | Original Paper

Elderly users’ acceptance of mHealth user interface (UI) design-based culture: the moderator role of age

In the Arab world, mobile health (mHealth) applications are an effective way to provide health benefits to medically needy in the absence of health services. However, end users around the world use technology to perform tasks in a way that appears …

Authors:
Ahmed Alsswey, Hosam Al-Samarraie

19-07-2019 | Original Paper

Gaze-based interactions in the cockpit of the future: a survey

Flying an aircraft is a mentally demanding task where pilots must process a vast amount of visual, auditory and vestibular information. They have to control the aircraft by pulling, pushing and turning different knobs and levers, while knowing …

Authors:
David Rudi, Peter Kiefer, Ioannis Giannopoulos, Martin Raubal

17-07-2019 | Original Paper

Multi-modal facial expression feature based on deep-neural networks

Emotion recognition based on facial expression is a challenging research topic and has attracted a great deal of attention in the past few years. This paper presents a novel method, utilizing multi-modal strategy to extract emotion features from …

Authors:
Wei Wei, Qingxuan Jia, Yongli Feng, Gang Chen, Ming Chu