ABSTRACT
With increasing complexity of assembly tasks and an increasing number of product variants, instruction systems providing cognitive support at the workplace are becoming more important. Different instruction systems for the workplace provide instructions on phones, tablets, and head-mounted displays (HMDs). Recently, many systems using in-situ projection for providing assembly instructions at the workplace have been proposed and became commercially available. Although comprehensive studies comparing HMD and tablet-based systems have been presented, in-situ projection has not been scientifically compared against state-of-the-art approaches yet. In this paper, we aim to close this gap by comparing HMD instructions, tablet instructions, and baseline paper instructions to in-situ projected instructions using an abstract Lego Duplo assembly task. Our results show that assembling parts is significantly faster using in-situ projection and locating positions is significantly slower using HMDs. Further, participants make less errors and have less perceived cognitive load using in-situ instructions compared to HMD instructions.
Supplemental Material
Available for Download
Supplemental material.
- A Bannat, F Wallhoff, G Rigoll, F Friesdorf, H Bubb, S Stork, HJ Müller, A Schubö, M Wiesbeck, and MF Zäh. 2008. Towards optimal worker assistance: a framework for adaptive selection and presentation of assembly instructions. In Proceedings of the 1st international workshop on cognition for technical systems, Cotesys.Google Scholar
- Mark Billinghurst, Mika Hakkarainen, and Charles Woodward. 2008. Augmented assembly using a mobile phone. In Proceedings of the 7th International Conference on Mobile and Ubiquitous Multimedia. ACM, 84--87. DOI:http://dx.doi.org/10.1145/1543137.1543153 Google ScholarDigital Library
- Sebastian Büttner, Oliver Sand, and Carsten Röcker. 2015. Extending the Design Space in Industrial Manufacturing Through Mobile Projection. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. ACM, 1130--1133. DOI:http://dx.doi.org/10.1145/2786567.2794342 Google ScholarDigital Library
- Thomas P Caudell and David W Mizell. 1992. Augmented reality: An application of heads-up display technology to manual manufacturing processes. In System Sciences, 1992. Proceedings of the Twenty-Fifth Hawaii International Conference on, Vol. 2. IEEE, 659--669. DOI:http://dx.doi.org/10.1109/HICSS.1992.183317Google ScholarCross Ref
- Florian Echtler, Fabian Sturm, Kay Kindermann, Gudrun Klinker, Joachim Stilla, Joern Trilk, and Hesam Najafi. 2004. The intelligent welding gun: Augmented reality for experimental vehicle construction. In Virtual and augmented reality applications in manufacturing. Springer, 333--360. DOI:http://dx.doi.org/10.1007/978-1-4471-3873-0_17Google Scholar
- Markus Funk, Thomas Kosch, Scott W Greenwald, and Albrecht Schmidt. 2015a. A benchmark for interactive augmented reality instructions for assembly tasks. In Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia. ACM, 253--257. DOI:http://dx.doi.org/10.1145/2836041.2836067 Google ScholarDigital Library
- Markus Funk, Sven Mayer, and Albrecht Schmidt. 2015b. Using In-Situ Projection to Support Cognitively Impaired Workers at the Workplace. In Proceedings of the 17th international ACM SIGACCESS conference on Computers & accessibility. ACM. DOI:http://dx.doi.org/10.1145/2700648.2809853 Google ScholarDigital Library
- Markus Funk, Alireza Sahami Shirazi, Sven Mayer, Lars Lischke, and Albrecht Schmidt. 2015c. Pick from here!: an interactive mobile cart using in-situ projection for order picking. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 601--609. DOI:http://dx.doi.org/10.1145/2750858.2804268 Google ScholarDigital Library
- Nirit Gavish, Teresa Gutiérrez, Sabine Webel, Jorge Rodríguez, Matteo Peveri, Uli Bockholt, and Franco Tecchia. 2013. Evaluating virtual reality and augmented reality training for industrial maintenance and assembly tasks. Interactive Learning Environments ahead-of-print (2013), 1--21. DOI:http://dx.doi.org/10.1080/10494820.2013.815221Google Scholar
- Ankit Gupta, Dieter Fox, Brian Curless, and Michael Cohen. 2012. DuploTrack: a real-time system for authoring and guiding duplo block assembly. In Proceedings of the 25th annual ACM symposium on User interface software and technology. ACM, 389--402. DOI:http://dx.doi.org/10.1145/2380116.2380167 Google ScholarDigital Library
- Sandra G Hart. 2006. NASA-task load index (NASA-TLX); 20 years later. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 50. Sage Publications, 904--908. DOI:http://dx.doi.org/10.1177/154193120605000909Google ScholarCross Ref
- Steven J Henderson and Steven Feiner. 2009. Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. In Mixed and Augmented Reality, 2009. ISMAR 2009. 8th IEEE International Symposium on. IEEE, 135--144. DOI:http://dx.doi.org/10.1109/ISMAR.2009.5336486 Google ScholarDigital Library
- Steven J Henderson and Steven K Feiner. 2011. Augmented reality in the psychomotor phase of a procedural task. In Mixed and Augmented Reality (ISMAR), 2011 10th IEEE International Symposium on. IEEE, 191--200. DOI:http://dx.doi.org/10.1109/ISMAR.2011.6092386 Google ScholarDigital Library
- Oliver Korn, Albrecht Schmidt, and Thomas Hörz. 2013. The potentials of in-situ-projection for augmented workplaces in production: a study with impaired persons. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. ACM, 979--984. DOI:http://dx.doi.org/10.1145/2468356.2468531 Google ScholarDigital Library
- Michael R Marner, Andrew Irlitti, and Bruce H Thomas. 2013. Improving procedural task performance with Augmented Reality annotations. In Mixed and Augmented Reality (ISMAR), 2013 IEEE International Symposium on. IEEE, 39--48. DOI:http://dx.doi.org/10.1109/ISMAR.2013.6671762Google ScholarCross Ref
- GI McCalla, JE Greer, VS Kumar, P Meagher, JA Collins, R Tkatch, and B Parkinson. 1997. A peer help system for workplace training. B. d. Boulay, & R. Mizoguchi (Eds.), AI-ED 97, 8 (1997), 183--190.Google Scholar
- Nobuchika Sakata, Takeshi Kurata, Takekazu Kato, Masakatsu Kourogi, and Hideaki Kuzuoka. 2003. WACL: Supporting Telecommunications Using Wearable Active Camera with Laser Pointer. In Proceedings of the 7th IEEE International Symposium on Wearable Computers (ISWC '03). IEEE Computer Society, Washington, DC, USA, 53--. http://dl.acm.org/citation.cfm?id=946249.946870 Google ScholarDigital Library
- Nobuchika Sakata, Takeshi Kurata, and Hideaki Kuzuoka. 2006. Visual assist with a laser pointer and wearable display for remote collaboration. (2006).Google Scholar
- Björn Schwerdtfeger, Rupert Reif, Willibald Günthner, Gudrun Klinker, Daniel Hamacher, Lutz Schega, Irina Böckelmann, Fabian Doil, Johannes Tümler, and others. 2009. Pick-by-Vision: A first stress test. In Mixed and Augmented Reality, 2009. ISMAR 2009. 8th IEEE International Symposium on. IEEE, 115--124. DOI:http://dx.doi.org/10.1109/ISMAR.2009.5336484 Google ScholarDigital Library
- Arthur Tang, Charles Owen, Frank Biocca, and Weimin Mou. 2003. Comparative effectiveness of augmented reality in object assembly. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 73--80. DOI:http://dx.doi.org/10.1145/642611.642626 Google ScholarDigital Library
- Xianjun Sam Zheng, Cedric Foucault, Patrik Matos da Silva, Siddharth Dasari, Tao Yang, and Stuart Goose. 2015. Eye-wearable technology for machine maintenance: Effects of display position and hands-free operation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2125--2134. DOI:http://dx.doi.org/10.1145/2702123.2702305 Google ScholarDigital Library
Index Terms
- Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions
Recommendations
Ethnographic study of a commercially available augmented reality HMD app for industry work instruction
PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive EnvironmentsIndustrial applications of Augmented Reality (AR) are becoming increasingly commonplace but there are only a small number of published user studies examining the use of commercially available AR technologies, like AR HMDs, with real workers in real ...
Experiencing Social Augmented Reality in Public Spaces
UbiComp/ISWC '21 Adjunct: Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable ComputersWe present various views on the future use of augmented reality in public spaces. The views address enhanced walking, social activity, appropriation of public spaces, and futuristic social aspects of future outdoor augmented reality. Although we often ...
FoveAR: Combining an Optically See-Through Near-Eye Display with Projector-Based Spatial Augmented Reality
UIST '15: Proceedings of the 28th Annual ACM Symposium on User Interface Software & TechnologyOptically see-through (OST) augmented reality glasses can overlay spatially-registered computer-generated content onto the real world. However, current optical designs and weight considerations limit their diagonal field of view to less than 40 degrees, ...
Comments