Skip to main content
Top

2019 | OriginalPaper | Chapter

Exploration of Ideal Interaction Scheme on Smart TV: Based on User Experience Research of Far-Field Speech and Mid-air Gesture Interaction

Authors : Xuan Li, Daisong Guan, Jingya Zhang, Xingtong Liu, Siqi Li, Hui Tong

Published in: Design, User Experience, and Usability. User Experience in Advanced Technological Environments

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

TV, as an important entertainment appliance in family, its interaction is typical of other screen-equipped devices. Far-field speech and mid-air gesture are the new trends in smart TV interaction. Previous studies have explored the characteristics of far-field speech and mid-air gesture interactions in TV used scenes, but rarely studied the user experience in the interaction process for the two interactive modes and directly compared them. What is the ideal interactive mode for TV in the future when these two can be realized? We know very little about this. Therefore, in Study 1, we quantitatively compared the user experience of far-field speech and mid-air gesture through experiment. The results showed that there were no significant differences between the two interactive modes, and implicated their advantages and disadvantages for different operations. And then, in study 2, we explored the user preference for interaction in different operations. The results showed that there were certain regularities about the participants’ preference for the two interaction channel in different situations. Based on the results mentioned above, we finally proposed the design principles of multichannel interaction fusion for different operations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Cong-Xian, Z.: Research on speech emotion recognition based on deep learning. A thesis submitted to Southeast University (2016) Cong-Xian, Z.: Research on speech emotion recognition based on deep learning. A thesis submitted to Southeast University (2016)
2.
go back to reference Zaiţi, I.A., Ştefan-Gheorghe, P., Radu-Daniel, V.: On free-hand TV control: experimental results on user-elicited gestures with Leap Motion. Pers. Ubiquit. Comput. 19(5–6), 821–838 (2015)CrossRef Zaiţi, I.A., Ştefan-Gheorghe, P., Radu-Daniel, V.: On free-hand TV control: experimental results on user-elicited gestures with Leap Motion. Pers. Ubiquit. Comput. 19(5–6), 821–838 (2015)CrossRef
3.
go back to reference Connolly, K.J.: Psychobiology of the Hand. Cambridge University Press, Cambridge (1998) Connolly, K.J.: Psychobiology of the Hand. Cambridge University Press, Cambridge (1998)
4.
go back to reference Kopp, S.: The spatial specificity of iconic gestures. In: Proceedings of the 7th International Conference of the German Cognitive Science Society, pp. 112–117 (2005) Kopp, S.: The spatial specificity of iconic gestures. In: Proceedings of the 7th International Conference of the German Cognitive Science Society, pp. 112–117 (2005)
5.
go back to reference Shin, Y.K., Choe, J.H.: Remote control interaction for individual environment of smart TV. In: IEEE International Symposium on Personal IEEE Xplore (2011) Shin, Y.K., Choe, J.H.: Remote control interaction for individual environment of smart TV. In: IEEE International Symposium on Personal IEEE Xplore (2011)
6.
go back to reference Reissner, U.: Gestures and speech in cars. In: Electronic Proceedings of Joint Advanced Student School (2007) Reissner, U.: Gestures and speech in cars. In: Electronic Proceedings of Joint Advanced Student School (2007)
7.
go back to reference Angelini, L., Baumgartner, J., Carrino, F., Carrino, S., Caon, M., et al.: Comparing gesture, speech and touch interaction modalities for in-vehicle infotainment systems. In: Actes de la 28ième conférence francophone sur l’Interaction Homme-Machine, October 2016, Fribourg, Switzerland, pp. 188–196 (2016) Angelini, L., Baumgartner, J., Carrino, F., Carrino, S., Caon, M., et al.: Comparing gesture, speech and touch interaction modalities for in-vehicle infotainment systems. In: Actes de la 28ième conférence francophone sur l’Interaction Homme-Machine, October 2016, Fribourg, Switzerland, pp. 188–196 (2016)
8.
go back to reference Pfleging, B., Schneegass, S., Schmidt, A.: Multimodal interaction in the car: combining speech and gestures on the steering wheel. In: International Conference on Automotive User Interfaces & Interactive Vehicular Applications. ACM (2012) Pfleging, B., Schneegass, S., Schmidt, A.: Multimodal interaction in the car: combining speech and gestures on the steering wheel. In: International Conference on Automotive User Interfaces & Interactive Vehicular Applications. ACM (2012)
9.
go back to reference Morris, M.R.: Web on the wall: insights from a multimodal interaction elicitation study. In: ACM International Conference on Interactive Tabletops & Surfaces. ACM (2012) Morris, M.R.: Web on the wall: insights from a multimodal interaction elicitation study. In: ACM International Conference on Interactive Tabletops & Surfaces. ACM (2012)
10.
go back to reference Ramis, S., Perales, F.J., Manresa-Yee, C., Bibiloni, A.: Usability study of gestures to control a smart-tv. In: Third Iberoamerican Conference (2014) Ramis, S., Perales, F.J., Manresa-Yee, C., Bibiloni, A.: Usability study of gestures to control a smart-tv. In: Third Iberoamerican Conference (2014)
11.
go back to reference Panger, G.: Kinect in the kitchen: testing depth camera interactions in practical home environments. In: Chi 12 Extended Abstracts on Human Factors in Computing Systems. ACM (2012) Panger, G.: Kinect in the kitchen: testing depth camera interactions in practical home environments. In: Chi 12 Extended Abstracts on Human Factors in Computing Systems. ACM (2012)
12.
go back to reference Bobeth, J., Schrammel, J., Deutsch, S., Klein, M., Drobics, M., Hochleitner, C., et al.: Tablet, gestures, remote control?: influence of age on performance and user experience with iTV applications. In: Proceedings of the 2014 ACM International Conference on Interactive Experiences for TV and Online Video - TVX 2014, pp. 139–146 (2014) Bobeth, J., Schrammel, J., Deutsch, S., Klein, M., Drobics, M., Hochleitner, C., et al.: Tablet, gestures, remote control?: influence of age on performance and user experience with iTV applications. In: Proceedings of the 2014 ACM International Conference on Interactive Experiences for TV and Online Video - TVX 2014, pp. 139–146 (2014)
13.
go back to reference Brush, A.J., Johns, P., Inkpen, K., Meyers, B.: Speech@home: an exploratory study. In: ACM Conference on Computer-Human Interaction (2011) Brush, A.J., Johns, P., Inkpen, K., Meyers, B.: Speech@home: an exploratory study. In: ACM Conference on Computer-Human Interaction (2011)
14.
go back to reference Ying, C., Wei, Z., Bo, H.: User experience research on voice function of smart TV. Design 22 (2017) Ying, C., Wei, Z., Bo, H.: User experience research on voice function of smart TV. Design 22 (2017)
15.
go back to reference Martin, B., Hanington, B.: Universal Methods of Design. Rockport Publishers, Beverly (2012) Martin, B., Hanington, B.: Universal Methods of Design. Rockport Publishers, Beverly (2012)
16.
go back to reference Rico, J., Brewster, S.: Gesture and voice prototyping for early evaluations of social acceptability in multimodal interfaces. In: International Conference on Multimodal Interfaces. DBLP (2010) Rico, J., Brewster, S.: Gesture and voice prototyping for early evaluations of social acceptability in multimodal interfaces. In: International Conference on Multimodal Interfaces. DBLP (2010)
17.
go back to reference Klemmer, S.R., Sinha, A.K., Chen J., Landay, J.A., Aboobaker, N., Wang, A.: Suede: a wizard of Oz prototyping tool for speech user interfaces. In: ACM Symposium on User Interface Software & Technology (2000) Klemmer, S.R., Sinha, A.K., Chen J., Landay, J.A., Aboobaker, N., Wang, A.: Suede: a wizard of Oz prototyping tool for speech user interfaces. In: ACM Symposium on User Interface Software & Technology (2000)
18.
go back to reference Peng, B.: An overview of the researches on technology acceptance model. Res. Libr. Sci. 1, 2–6 (2012) Peng, B.: An overview of the researches on technology acceptance model. Res. Libr. Sci. 1, 2–6 (2012)
19.
go back to reference Jaimes, A., Sebe, N.: Multimodal Human-Computer Interaction: A Survey, Computational Vision and Image Understanding, pp. 116–134. Elsevier Science Inc., New York (2007) Jaimes, A., Sebe, N.: Multimodal Human-Computer Interaction: A Survey, Computational Vision and Image Understanding, pp. 116–134. Elsevier Science Inc., New York (2007)
20.
go back to reference Xiao-long, S., Hong-ni, G., Feng, H.: Multimodal interaction technology in the holographic display and control interfaces. Packag. Eng. 4, 120–124 (2016) Xiao-long, S., Hong-ni, G., Feng, H.: Multimodal interaction technology in the holographic display and control interfaces. Packag. Eng. 4, 120–124 (2016)
Metadata
Title
Exploration of Ideal Interaction Scheme on Smart TV: Based on User Experience Research of Far-Field Speech and Mid-air Gesture Interaction
Authors
Xuan Li
Daisong Guan
Jingya Zhang
Xingtong Liu
Siqi Li
Hui Tong
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-23541-3_12