Skip to main content

2017 | Supplement | Buchkapitel

Affordances for Capturing and Re-enacting Expert Performance with Wearables

verfasst von : Will Guest, Fridolin Wild, Alla Vovk, Mikhail Fominykh, Bibeg Limbu, Roland Klemke, Puneet Sharma, Jaakko Karjalainen, Carl Smith, Jazz Rasool, Soyeb Aswat, Kaj Helin, Daniele Di Mitri, Jan Schneider

Erschienen in: Data Driven Approaches in Digital Education

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The WEKIT.one prototype is a platform for immersive procedural training with wearable sensors and Augmented Reality. Focusing on capture and re-enactment of human expertise, this work looks at the unique affordances of suitable hard- and software technologies. The practical challenges of interpreting expertise, using suitable sensors for its capture and specifying the means to describe and display to the novice are of central significance here. We link affordances with hardware devices, discussing their alternatives, including Microsoft Hololens, Thalmic Labs MYO, Alex Posture sensor, MyndPlay EEG headband, and a heart rate sensor. Following the selection of sensors, we describe integration and communication requirements for the prototype. We close with thoughts on the wider possibilities for implementation and next steps.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Gibson, J.J.: The theory of affordances. In: Shaw, R., Bransford, J. (eds.) Perceiving, Acting, and Knowing: Toward an Ecological Psychology, pp. 67–82 (1977) Gibson, J.J.: The theory of affordances. In: Shaw, R., Bransford, J. (eds.) Perceiving, Acting, and Knowing: Toward an Ecological Psychology, pp. 67–82 (1977)
3.
Zurück zum Zitat Rizzo, A.: The origin and design of intentional affordances. In: Proceedings 6th Conference Designing Interactive Systems, University Park, PA, USA, pp. 239–240. ACM, New York (2006) Rizzo, A.: The origin and design of intentional affordances. In: Proceedings 6th Conference Designing Interactive Systems, University Park, PA, USA, pp. 239–240. ACM, New York (2006)
4.
Zurück zum Zitat Ericsson, K.A., Smith, J.: Prospects and limits of the empirical study of expertise: an introduction. In: Ericsson, K.A., Smith, J. (eds.) Toward a General Theory of Expertise: Prospects and Limits, pp. 1–39. Cambridge University Press, Cambridge (1991) Ericsson, K.A., Smith, J.: Prospects and limits of the empirical study of expertise: an introduction. In: Ericsson, K.A., Smith, J. (eds.) Toward a General Theory of Expertise: Prospects and Limits, pp. 1–39. Cambridge University Press, Cambridge (1991)
5.
Zurück zum Zitat Newell, A., Simon, H.A.: Human Problem Solving. Prentice Hall, Englewood Cliffs (1972) Newell, A., Simon, H.A.: Human Problem Solving. Prentice Hall, Englewood Cliffs (1972)
6.
Zurück zum Zitat Fominykh, M., Wild, F., Smith, C., Alvarez, V., Morozov, M.: An overview of capturing live experience with virtual and augmented reality. In: Preuveneers, D. (ed.) Workshop Proceedings of the 11th International Conference on Intelligent Environments, pp. 298–305. IOS Press, Amsterdam (2015) Fominykh, M., Wild, F., Smith, C., Alvarez, V., Morozov, M.: An overview of capturing live experience with virtual and augmented reality. In: Preuveneers, D. (ed.) Workshop Proceedings of the 11th International Conference on Intelligent Environments, pp. 298–305. IOS Press, Amsterdam (2015)
7.
Zurück zum Zitat Limbu, B., Fominykh, M., Klemke, R., Specht, M., Wild, F.: Supporting training of expertise with wearable technologies: the WEKIT reference framework. In: The International Handbook of Mobile and Ubiquitous Learning. Springer, New York (2017) Limbu, B., Fominykh, M., Klemke, R., Specht, M., Wild, F.: Supporting training of expertise with wearable technologies: the WEKIT reference framework. In: The International Handbook of Mobile and Ubiquitous Learning. Springer, New York (2017)
8.
Zurück zum Zitat Bacca, J., Baldiris, S., Fabregat, R., Graf, S.: Kinshuk: augmented reality trends in education: a systematic review of research and applications. Educ. Technol. Soc. 17(4), 133–149 (2014) Bacca, J., Baldiris, S., Fabregat, R., Graf, S.: Kinshuk: augmented reality trends in education: a systematic review of research and applications. Educ. Technol. Soc. 17(4), 133–149 (2014)
9.
Zurück zum Zitat Bower, M., Sturman, D.: What are the educational affordances of wearable technologies? Comput. Educ. 88, 343–353 (2015)CrossRef Bower, M., Sturman, D.: What are the educational affordances of wearable technologies? Comput. Educ. 88, 343–353 (2015)CrossRef
10.
Zurück zum Zitat Wagner, R.K., Sternberg, R.J.: Practical intelligence in real-world pursuits: the role of tacit knowledge. J. Pers. Soc. Psychol. 49(2), 436–458 (1985)CrossRef Wagner, R.K., Sternberg, R.J.: Practical intelligence in real-world pursuits: the role of tacit knowledge. J. Pers. Soc. Psychol. 49(2), 436–458 (1985)CrossRef
11.
Zurück zum Zitat Wei, Y., Yan, H., Bie, R., Wang, S., Sun, L.: Performance monitoring and evaluation in dance teaching with mobile sensing technology. Pers. Ubiquit. Comput. 18(8), 1929–1939 (2014)CrossRef Wei, Y., Yan, H., Bie, R., Wang, S., Sun, L.: Performance monitoring and evaluation in dance teaching with mobile sensing technology. Pers. Ubiquit. Comput. 18(8), 1929–1939 (2014)CrossRef
12.
Zurück zum Zitat Li, H., Lu, M., Chan, G., Skitmore, M.: Proactive training system for safe and efficient precast installation. Autom. Constr. 49(Part A), 163–174 (2015)CrossRef Li, H., Lu, M., Chan, G., Skitmore, M.: Proactive training system for safe and efficient precast installation. Autom. Constr. 49(Part A), 163–174 (2015)CrossRef
13.
Zurück zum Zitat Prabhu, V.A., Elkington, M., Crowley, D., Tiwari, A., Ward, C.: Digitisation of manual composite layup task knowledge using gaming technology. Compos. Part B: Eng. 112, 314–326 (2017)CrossRef Prabhu, V.A., Elkington, M., Crowley, D., Tiwari, A., Ward, C.: Digitisation of manual composite layup task knowledge using gaming technology. Compos. Part B: Eng. 112, 314–326 (2017)CrossRef
14.
Zurück zum Zitat Jang, S.-A., Kim, H.-i., Woo, W., Wakefield, G.: AiRSculpt: a wearable augmented reality 3D sculpting system. In: Streitz, N., Markopoulos, P. (eds.) DAPI 2014. LNCS, vol. 8530, pp. 130–141. Springer, Cham (2014). doi:10.1007/978-3-319-07788-8_13 CrossRef Jang, S.-A., Kim, H.-i., Woo, W., Wakefield, G.: AiRSculpt: a wearable augmented reality 3D sculpting system. In: Streitz, N., Markopoulos, P. (eds.) DAPI 2014. LNCS, vol. 8530, pp. 130–141. Springer, Cham (2014). doi:10.​1007/​978-3-319-07788-8_​13 CrossRef
15.
Zurück zum Zitat Meleiro, P., Rodrigues, R., Jacob, J., Marques, T.: Natural user interfaces in the motor development of disabled children. Procedia Technol. 13, 66–75 (2014)CrossRef Meleiro, P., Rodrigues, R., Jacob, J., Marques, T.: Natural user interfaces in the motor development of disabled children. Procedia Technol. 13, 66–75 (2014)CrossRef
16.
Zurück zum Zitat Araki, A., Makiyama, K., Yamanaka, H., Ueno, D., Osaka, K., Nagasaka, M., Yamada, T., Yao, M.: Comparison of the performance of experienced and novice surgeons. Surg. Endosc. 31(4), 1999–2005 (2017)CrossRef Araki, A., Makiyama, K., Yamanaka, H., Ueno, D., Osaka, K., Nagasaka, M., Yamada, T., Yao, M.: Comparison of the performance of experienced and novice surgeons. Surg. Endosc. 31(4), 1999–2005 (2017)CrossRef
17.
Zurück zum Zitat Asadipour, A., Debattista, K., Chalmers, A.: Visuohaptic augmented feedback for enhancing motor skills acquisition. Vis. Comput. 33(4), 401–411 (2017)CrossRef Asadipour, A., Debattista, K., Chalmers, A.: Visuohaptic augmented feedback for enhancing motor skills acquisition. Vis. Comput. 33(4), 401–411 (2017)CrossRef
18.
Zurück zum Zitat Kim, S., Dey, A.K.: Augmenting human senses to improve the user experience in cars. Multimed. Tools Appl. 75(16), 9587–9607 (2016)CrossRef Kim, S., Dey, A.K.: Augmenting human senses to improve the user experience in cars. Multimed. Tools Appl. 75(16), 9587–9607 (2016)CrossRef
19.
Zurück zum Zitat Ke, F., Lee, S., Xu, X.: Teaching training in a mixed-reality integrated learning environment. Comput. Hum. Behav. 62, 212–220 (2016)CrossRef Ke, F., Lee, S., Xu, X.: Teaching training in a mixed-reality integrated learning environment. Comput. Hum. Behav. 62, 212–220 (2016)CrossRef
20.
Zurück zum Zitat Duente, T., Pfeiffer, M., Rohs, M.: On-skin technologies for muscle sensing and actuation. In: Proceedings of UbiComp 2016, pp. 933–936. ACM, New York (2016) Duente, T., Pfeiffer, M., Rohs, M.: On-skin technologies for muscle sensing and actuation. In: Proceedings of UbiComp 2016, pp. 933–936. ACM, New York (2016)
21.
Zurück zum Zitat Kwon, Y., Lee, S., Jeong, J., Kim, W.: HeartiSense: a novel approach to enable effective basic life support training without an instructor. In: CHI 2014 Extended Abstracts on Human Factors in Computing Systems, pp. 431–434. ACM, New York (2014) Kwon, Y., Lee, S., Jeong, J., Kim, W.: HeartiSense: a novel approach to enable effective basic life support training without an instructor. In: CHI 2014 Extended Abstracts on Human Factors in Computing Systems, pp. 431–434. ACM, New York (2014)
22.
Zurück zum Zitat Benedetti, F., Catenacci Volpi, N., Parisi, L., Sartori, G.: Attention training with an easy–to–use brain computer interface. In: Shumaker, R., Lackey, S. (eds.) VAMR 2014. LNCS, vol. 8526, pp. 236–247. Springer, Cham (2014). doi:10.1007/978-3-319-07464-1_22 Benedetti, F., Catenacci Volpi, N., Parisi, L., Sartori, G.: Attention training with an easy–to–use brain computer interface. In: Shumaker, R., Lackey, S. (eds.) VAMR 2014. LNCS, vol. 8526, pp. 236–247. Springer, Cham (2014). doi:10.​1007/​978-3-319-07464-1_​22
23.
Zurück zum Zitat Kowalewski, K.-F., Hendrie, J.D., Schmidt, M.W., Garrow, C.R., Bruckner, T., Proctor, T., Paul, S., Adigüzel, D., Bodenstedt, S., Erben, A., Kenngott, H., Erben, Y., Speidel, S., Müller-Stich, B.P., Nickel, F.: Development and validation of a sensor-and expert model-based training system for laparoscopic surgery: the iSurgeon. Surg. Endosc. 31, 1–11 (2016) Kowalewski, K.-F., Hendrie, J.D., Schmidt, M.W., Garrow, C.R., Bruckner, T., Proctor, T., Paul, S., Adigüzel, D., Bodenstedt, S., Erben, A., Kenngott, H., Erben, Y., Speidel, S., Müller-Stich, B.P., Nickel, F.: Development and validation of a sensor-and expert model-based training system for laparoscopic surgery: the iSurgeon. Surg. Endosc. 31, 1–11 (2016)
24.
Zurück zum Zitat Sanfilippo, F.: A multi-sensor fusion framework for improving situational awareness in demanding maritime training. Reliabil. Eng. Syst. Saf. 161, 12–24 (2017)CrossRef Sanfilippo, F.: A multi-sensor fusion framework for improving situational awareness in demanding maritime training. Reliabil. Eng. Syst. Saf. 161, 12–24 (2017)CrossRef
25.
Zurück zum Zitat Sharma, P., Wild, F., Klemke, R., Helin, K., Azam, T.: Requirement analysis and sensor specifications: First version. WEKIT, D3.1 (2016) Sharma, P., Wild, F., Klemke, R., Helin, K., Azam, T.: Requirement analysis and sensor specifications: First version. WEKIT, D3.1 (2016)
Metadaten
Titel
Affordances for Capturing and Re-enacting Expert Performance with Wearables
verfasst von
Will Guest
Fridolin Wild
Alla Vovk
Mikhail Fominykh
Bibeg Limbu
Roland Klemke
Puneet Sharma
Jaakko Karjalainen
Carl Smith
Jazz Rasool
Soyeb Aswat
Kaj Helin
Daniele Di Mitri
Jan Schneider
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-66610-5_34