Skip to main content
Top

2018 | OriginalPaper | Chapter

An Adaptive Speech Interface for Assistance in Maintenance and Changeover Procedures

Authors : Frieder Loch, Julia Czerniak, Valeria Villani, Lorenzo Sabattini, Cesare Fantuzzi, Alexander Mertens, Birgit Vogel-Heuser

Published in: Human-Computer Interaction. Interaction Technologies

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Machine operators remain important in future production environments and need intuitive and powerful interaction techniques. Many assistance and support applications for machine operators use speech-based interfaces since they are suitable during manual tasks and when visual attention cannot be occupied. Due to developments like the demographic change or the need for skilled personnel, the skills and capabilities of the workers will become increasingly diverse. Speech-based interfaces therefore need to be adaptable to the capabilities, limitations and preferences of individual operators. This paper addresses this requirement and proposes an adaptive speech interface that supports machine operators during maintenance and changeover procedures. All aspects of the proposed application can be adapted to the requirements of the user. The system uses a process model, instruction templates, a user model, and a model of the input vocabulary to describe the components of the application. This allows a flexible adaptation of the speech interface and the provided instructions to the requirements of individual users and to further use cases.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Oborski, P.: Man-machine interactions in advanced manufacturing systems. Int. J. Adv. Manuf. Technol. 23(3–4), 227–232 (2004)CrossRef Oborski, P.: Man-machine interactions in advanced manufacturing systems. Int. J. Adv. Manuf. Technol. 23(3–4), 227–232 (2004)CrossRef
3.
go back to reference Shneiderman, B., Plaisant, C.: Designing the User Interface. Pearson, London (2010) Shneiderman, B., Plaisant, C.: Designing the User Interface. Pearson, London (2010)
4.
go back to reference Medhi, I., Sagar, A., Toyama, K.: Text-free user interfaces for illiterate and semiliterate users. Inf. Technol. Int. Dev. 4(1), 37–50 (2008)CrossRef Medhi, I., Sagar, A., Toyama, K.: Text-free user interfaces for illiterate and semiliterate users. Inf. Technol. Int. Dev. 4(1), 37–50 (2008)CrossRef
5.
go back to reference Gorecky, D., Schmitt, M., Loskyll, M., Zühlke, D.: Human-machine-interaction in the industry 4.0 era. In: 2014 12th IEEE International Conference on Industrial Informatics (INDIN), Porto Alegre RS, Brazil, pp. 289–294 (2014) Gorecky, D., Schmitt, M., Loskyll, M., Zühlke, D.: Human-machine-interaction in the industry 4.0 era. In: 2014 12th IEEE International Conference on Industrial Informatics (INDIN), Porto Alegre RS, Brazil, pp. 289–294 (2014)
6.
go back to reference Scherff, B.: Software for multi-modal HCI including speech for skilled industrial workers. In: Bullinger, H.-J. (ed.) Human Aspects in Computing: Design and Use of Interactive Systems and Work with Terminals, pp. 506–511. Elsevier Science Publishers, Amsterdam (1991) Scherff, B.: Software for multi-modal HCI including speech for skilled industrial workers. In: Bullinger, H.-J. (ed.) Human Aspects in Computing: Design and Use of Interactive Systems and Work with Terminals, pp. 506–511. Elsevier Science Publishers, Amsterdam (1991)
7.
go back to reference de Vries, J., de Koster, R., Stam, D.: Exploring the role of picker personality in predicting picking performance with pick by voice, pick to light and RF-terminal picking. Int. J. Prod. Res. 54(8), 2260–2274 (2015)CrossRef de Vries, J., de Koster, R., Stam, D.: Exploring the role of picker personality in predicting picking performance with pick by voice, pick to light and RF-terminal picking. Int. J. Prod. Res. 54(8), 2260–2274 (2015)CrossRef
8.
go back to reference Lolling, A.: Fehlerraten verschiedener Kommissionersysteme in der Praxis. Zeitschrift für Arbeitswissenschaft 56, 112–115 (2002) Lolling, A.: Fehlerraten verschiedener Kommissionersysteme in der Praxis. Zeitschrift für Arbeitswissenschaft 56, 112–115 (2002)
9.
go back to reference Fischer, J., Pantförder, D., Vogel-Heuser, B.: Improvement of maintenance through speech interaction in cyber-physical production systems. In: 2017 IEEE 15th International Conference on Industrial Informatics (INDIN), Emden, Germany. IEEE (2017) Fischer, J., Pantförder, D., Vogel-Heuser, B.: Improvement of maintenance through speech interaction in cyber-physical production systems. In: 2017 IEEE 15th International Conference on Industrial Informatics (INDIN), Emden, Germany. IEEE (2017)
10.
go back to reference Overmeyer, L., Podszus, F., Dohrmann, L.: Multimodal speech and gesture control of AGVs, including EEG-based measurements of cognitive workload. CIRP Ann. Manuf. Technol. 65(1), 425–428 (2016)CrossRef Overmeyer, L., Podszus, F., Dohrmann, L.: Multimodal speech and gesture control of AGVs, including EEG-based measurements of cognitive workload. CIRP Ann. Manuf. Technol. 65(1), 425–428 (2016)CrossRef
12.
go back to reference Dix, A., Finlay, J., Abowd, G.D., Beale, R.: Human-Computer Interaction. Pearson/Prentice Hall, Harlow (2004)MATH Dix, A., Finlay, J., Abowd, G.D., Beale, R.: Human-Computer Interaction. Pearson/Prentice Hall, Harlow (2004)MATH
13.
go back to reference Stuerzlinger, W., Chapuis, O., Phillips, D., Roussel, N.: User interface facades: towards fully adaptable user interfaces. In: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, pp. 309–318. ACM, New York (2006) Stuerzlinger, W., Chapuis, O., Phillips, D., Roussel, N.: User interface facades: towards fully adaptable user interfaces. In: Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology, pp. 309–318. ACM, New York (2006)
14.
go back to reference Sheridan, T.B., Parasurman, R.: Human-automation interaction. Rev. Hum. Factors Ergon. 1(1), 89–129 (2005)CrossRef Sheridan, T.B., Parasurman, R.: Human-automation interaction. Rev. Hum. Factors Ergon. 1(1), 89–129 (2005)CrossRef
15.
go back to reference Dey, A.K.: Understanding and using context. Pers. Ubiquit. Comput. 5(1), 4–7 (2001)CrossRef Dey, A.K.: Understanding and using context. Pers. Ubiquit. Comput. 5(1), 4–7 (2001)CrossRef
16.
go back to reference Gröger, C., Stach, C.: The mobile manufacturing dashboard. In: IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), 2014, Budapest, Hungary, pp. 138–140. IEEE, Piscataway (2014) Gröger, C., Stach, C.: The mobile manufacturing dashboard. In: IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), 2014, Budapest, Hungary, pp. 138–140. IEEE, Piscataway (2014)
17.
go back to reference Funk, M., Dingler, T., Cooper, J., Schmidt, A.: Stop helping me - I’m bored! In: Mase, K., Langheinrich, M., Gatica-Perez, D., Gellersen, H., Choudhury, T., Yatani, K. (eds.) Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings, Osaka, Japan, pp. 1269–1273. ACM, New York (2015) Funk, M., Dingler, T., Cooper, J., Schmidt, A.: Stop helping me - I’m bored! In: Mase, K., Langheinrich, M., Gatica-Perez, D., Gellersen, H., Choudhury, T., Yatani, K. (eds.) Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings, Osaka, Japan, pp. 1269–1273. ACM, New York (2015)
18.
go back to reference Fischer, G.: User modeling in human-computer interaction. User Model. User-Adapt. Interact. 11, 65–86 (2001)CrossRef Fischer, G.: User modeling in human-computer interaction. User Model. User-Adapt. Interact. 11, 65–86 (2001)CrossRef
19.
go back to reference Calvary, G., Coutaz, J., Thevenin, D., Bouillon, L., Florins, M., Limbourg, Q., Souchon, N., Canderdonckt, J., Marucci, L., Paterno, F., Cantoro, C.: The CAMELEON reference framework (2002) Calvary, G., Coutaz, J., Thevenin, D., Bouillon, L., Florins, M., Limbourg, Q., Souchon, N., Canderdonckt, J., Marucci, L., Paterno, F., Cantoro, C.: The CAMELEON reference framework (2002)
20.
go back to reference Villani, V., Sabattini, L., Czerniak, J.N., Mertens, A., Vogel-Heuser, B., Fantuzzi, C.: Towards modern inclusive factories: a methodology for the development of smart adaptive human-machine interfaces. In: Proceedings of the 22nd IEEE International Conference on Emerging Technologies and Factory Automation (2017) Villani, V., Sabattini, L., Czerniak, J.N., Mertens, A., Vogel-Heuser, B., Fantuzzi, C.: Towards modern inclusive factories: a methodology for the development of smart adaptive human-machine interfaces. In: Proceedings of the 22nd IEEE International Conference on Emerging Technologies and Factory Automation (2017)
21.
go back to reference Staggers, N., Norcio, A.F.: Mental models: concepts for human-computer interaction research. Int. J. Man Mach. Stud. 38(4), 587–605 (1993)CrossRef Staggers, N., Norcio, A.F.: Mental models: concepts for human-computer interaction research. Int. J. Man Mach. Stud. 38(4), 587–605 (1993)CrossRef
22.
go back to reference Luczak, H.: Wesen menschlicher Leistung. In: Arbeitsgestaltung in Produktion und Verwaltung, pp. 39–64. Wirtschaftsverlag Bachem, Köln (1989) Luczak, H.: Wesen menschlicher Leistung. In: Arbeitsgestaltung in Produktion und Verwaltung, pp. 39–64. Wirtschaftsverlag Bachem, Köln (1989)
24.
go back to reference Marsiske, M., Am Delius, J., Maas, I., Lindenberger, U., Scherer, H., Tesch-Römer, C.: Sensorische Systeme im Alter. In: Die Berliner Altersstudie, pp. 403–427. Akademie Verlag (2010) Marsiske, M., Am Delius, J., Maas, I., Lindenberger, U., Scherer, H., Tesch-Römer, C.: Sensorische Systeme im Alter. In: Die Berliner Altersstudie, pp. 403–427. Akademie Verlag (2010)
25.
go back to reference DIN: Acoustics - Statistical distribution of hearing thresholds related to age and gender (2017) DIN: Acoustics - Statistical distribution of hearing thresholds related to age and gender (2017)
26.
go back to reference Davletcharova, A., Sugathan, S., Abraham, B., James, A.P.: Detection and analysis of emotion from speech signals. Procedia Comput. Sci. 58, 91–96 (2015)CrossRef Davletcharova, A., Sugathan, S., Abraham, B., James, A.P.: Detection and analysis of emotion from speech signals. Procedia Comput. Sci. 58, 91–96 (2015)CrossRef
Metadata
Title
An Adaptive Speech Interface for Assistance in Maintenance and Changeover Procedures
Authors
Frieder Loch
Julia Czerniak
Valeria Villani
Lorenzo Sabattini
Cesare Fantuzzi
Alexander Mertens
Birgit Vogel-Heuser
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-91250-9_12