Susanna Aromaa
Eija Kaasinen
ABSTRACT
Industrial maintenance is an increasingly complex and knowledge intensive field. Although new technologies in maintenance have been studied extensively, their usage is still lacking in the industry. We have studied knowledge-sharing solutions using augmented reality (AR) and wearable technologies in actual industry cases to find out if maintenance technicians find them useful and usable in their everyday work. Two test cases were included: the use of a wearable system consisting of three devices in the crane industry, and the use of AR guidance in the marine industry. In both cases two maintenance technicians tested the technologies and data were collected using questionnaires, interviews and observation. The maintenance technicians were positive towards the use of these technologies in their work. However, some practical issues were raised concerning the simultaneous use of multiple devices and the placement of the devices. A more system-level approach to designing wearable and AR technologies could be applied to ensure their utility in the field. Findings from this study can be used when designing and implementing wearable and AR technologies in maintenance, but also in other industry domains like the manufacturing industry.
- Aromaa, S., Väätänen, A., Aaltonen, I., and Heimonen, T. 2015. A model for gathering and sharing knowledge in maintenance work. In Proceedings of the 33rd Annual Conference of the European Association of Cognitive Ergonomics (Warsaw, Poland, July 1--3, 2015). ECCE '15, Article 28. Google Scholar
Digital Library
- European Committee for Standardization 2010. EN 13306.Google Scholar
- Reason, J. 1997. Managing the Risks of Organizational Accidents. Ashgate Publishing Ltd.Google Scholar
- Franssila, H. 2008. Franssila, Sähköisen tietämyksenhallinnan mukauttaminen ja integrointi työkäytäntöihin asennus- ja huoltotyössä (Integrating digital knowledge management in assembly and maintenance work).Google Scholar
- Starner, T., Mann, S., Rhodes, B., Levine, J., Healey, J., Kirsch, D., Picard, R., and Pentland, A. 1997. Augmented Reality through Wearable Computing. Presence Teleoperators Virtual Environ. 6, 4, 386--398. Google ScholarDigital Library
- Mann, S. 1997. Wearable computing: A first step toward personal imaging. Computer (Long. Beach. Calif). 30, 2, 25--32. DOI=http://doi.org/10.1109/2.566147. Google ScholarDigital Library
- Billinghurst, M. 1999. New ways to manage information. Computer (Long. Beach. Calif). 32, 1, 57--64. DOI=http://doi.org/10.1109/2.738305. Google ScholarDigital Library
- Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., and MacIntyre, B. 2001. Recent Advances in. Comput. Graph. Appl. 21, 6, 34--47. DOI=http://doi.org/10.1007/978-81-322-2235-4. Google ScholarDigital Library
- Barfield, W. (Ed.). 2015. Fundamentals of wearable computers and augmented reality. CRC Press.Google Scholar
- Lukowicz, P., Timm-Giel, A., Lawo, M., and Herzog, O. 2007. WearIT@work: Toward Real-World Industrial Wearable Computing. Pervasive Computing. 6, 4, 8--13. Google ScholarDigital Library
- Laarni, J., Heinilä, J., Häkkinen, J., Kalakoski, V., Kallinen, K., Lukander, K., Löppönen, P., Palomäki, T., Ravaja, N., Savioja, P., and Väätänen, A. 2009. Supporting situation awareness in demanding operating environments through wearable user interfaces. In 8th International Conference of Engineering Psychology and Cognitive Ergonomics (EPCE) (San Diego, CA, USA, July 19 -- 24, 2009), 13--21. DOI=http://doi.org/10.1007/978-3-642-02728-4_2. Google ScholarDigital Library
- Elliott, L. R., Van Erp, J., Redden, E. S., and Duistermaat, M. 2010. Field-based validation of a tactile navigation device. IEEE Trans. Haptics. 3, 2, 78--87. DOI=http://doi.org/10.1109/TOH.2010.3. Google ScholarDigital Library
- Wang, X., Ong, S. K., and Nee, A. Y. C. 2016. A comprehensive survey of augmented reality assembly research. Adv. Manuf. 4, 1, 1--22. DOI=http://doi.org/10.1007/s40436-015-0131-4.Google ScholarCross Ref
- Nee, A. Y. C., Ong, S. K., Chryssolouris, G., and Mourtzis, D. 2012. Augmented reality applications in design and manufacturing. CIRP Ann. - Manuf. Technol. 61, 2, 657--679. DOI=http://doi.org/10.1016/j.cirp.2012.05.010.Google ScholarCross Ref
- Ong, S. K., Yuan, M. L., and Nee, A. Y. C. 2008. Augmented reality applications in manufacturing: a survey. Int. J. Prod. Res. 46, 10, 2707--2742. DOI=http://doi.org/10.1080/00207540601064773.Google ScholarCross Ref
- Aromaa, S., Aaltonen, I., and Väätänen, A. 2016. Technology Concepts to Improve Knowledge Sharing During Maintenance. In The Ninth International Conference on Advances in Computer-Human Interactions (Venice, Italy April 24--28, 2016). ACHI'16.Google Scholar
- Baird, K. M., and Barfield, W. 1999. Evaluating the Effectiveness of Augmented Reality Displays for a Manual Assembly Task. Virtual Real. 4, 250--259.Google ScholarDigital Library
- Day, P. N., Ferguson, G., Holt, P. O. B., Hogg, S., and Gibson, D. 2005. Wearable augmented virtual reality for enhancing information delivery in high precision defence assembly: An engineering case study. Virtual Real. 8, 3, 177--184. DOI=http://doi.org/10.1007/s10055-004-0147-8. Google ScholarDigital Library
- Kunze, K., Wagner, F., and Kartal, E. 2009. Does context matter?-a quantitative evaluation in a real world maintenance scenario. Pervasive Comput. 372--389. Google ScholarDigital Library
- Henderson, S. J., and Feiner, S. 2009. Evaluating the benefits of augmented reality for task localization in maintenance of an armored personnel carrier turret. In Science and Technology Proceedings - IEEE 2009 International Symposium on Mixed and Augmented Reality, ISMAR 2009 (Orlando, Florida, USA, October 19 -- 22, 2009), 135--144. DOI=http://doi.org/10.1109/ISMAR.2009.5336486. Google ScholarDigital Library
- Henderson, S., and Feiner, S. 2011. Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans. Vis. Comput. Graph. 17, 10, 1355--1368. DOI=http://doi.org/10.1109/TVCG.2010.245. Google ScholarDigital Library
- Tang, A., Owen, C., Biocca, F., and Mou, W. 2003. Comparative effectiveness of augmented reality in object assembly. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florida, USA, April 5--10, 2003). CHI '03. 5, 73--80. Google ScholarDigital Library
- Schwerdtfeger, B., and Klinker, G. 2008. Supporting order picking with augmented reality. In Proceedings --- 7th IEEE International Symposium on Mixed and Augmented Reality (Cambridge, UK, September 15 -- 18, 2008). ISMAR'08. 91--94. DOI=http://doi.org/10.1109/ISMAR.2008.4637331. Google ScholarDigital Library
- Funk, M., Kosch, T., and Schmidt, A. 2016. Interactive Worker Assistance: Comparing the Effects of In-Situ Projection, Head-Mounted Displays, Tablet, and Paper Instructions. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing (Heidelberg, Germany, 2016), 0--5. DOI=http://doi.org/10.1145/2971648.2971706. Google ScholarDigital Library
- Grubert, J., Hamacher, D., Mecke, R., Böckelmann, I., Schega, L., Huckauf, A., Urbina, M., Schenk, M., Doil, F., and Tümler, J. 2010. Extended investigations of user-related issues in mobile industrial AR. In Proceedings of the 9th IEEE International Symposium on Mixed and Augmented Reality 2010: Science and Technology (Seoul, Korea, October 13--16). ISMAR'10. 229--230. DOI=http://doi.org/10.1109/ISMAR.2010.5643581.Google ScholarCross Ref
- Re, G. M., and Bordegoni, M. 2014. An augmented reality framework for supporting and monitoring operators during maintenance tasks. Virtual, Augment. Mix. Real. 443--454. DOI=http://doi.org/10.1007/978-3-319-07464-1_41.Google Scholar
- Ferrise, F., Caruso, G., and Bordegoni, M. 2013. Multimodal training and tele-assistance systems for the maintenance of industrial products. Virtual Phys. Prototyp. 8, 2, 113--126. DOI=http://doi.org/10.1080/17452759.2013.798764.Google ScholarCross Ref
- Capodieci, A., Mainetti, L., and Alem, L. 2015. An Innovative Approach to Digital Engineering Services Delivery: An Application in Maintenance. 2015 11th Int. Conf. Innov. Inf. Technol. 336--343. Google ScholarDigital Library
- Funk, M., and Korn, O. 2014. Assisitive Augmentation at the Manual Assembly Workplace using In-Situ Projection. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems (Toronto, Canada, April 26--May 1,2014). CHI'14.Google Scholar
- Ziegler, J., Heinze, S., and Urbas, L. 2015. The potential of smartwatches to support mobile industrial maintenance tasks. IEEE Int. Conf. Emerg. Technol. Fact. Autom. ETFA. 2015--Octob. DOI=http://doi.org/10.1109/ETFA.2015.7301479.Google Scholar
- Zheng, X. S., Silva, P. M. da, Foucault, C., Dasari, S., Yuan, M., and Goose, S. 2015. Wearable Solution for Industrial Maintenance. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (Seoul, Korea, April 18--23, 2015). CHI'15. 311--314. DOI=http://doi.org/10.1145/2702613.2725442. Google ScholarDigital Library
- Zheng, X. S., Foucault, C., Silva, P. M. da, Dasari, S., Yang, T., and Goose, S. 2015. Eye-Wearable Technology for Machine Maintenance: Effects of Display Position and Hands-free Operation. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (Seoul, Korea, April 18--23, 2015). CHI'15. 1, 2125--2134. DOI=http://doi.org/10.1145/2702123.2702305. Google ScholarDigital Library
- Grubert, J., Kranz, M., and Quigley, A. 2015. Design and Technology Challenges for Body Proximate Display Ecosystems. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Copenhagen, Denmark, August 24--27, 2015). MobileHCI'15. 951--954. DOI=http://doi.org/10.1145/2786567.2794310. Google ScholarDigital Library
- Quigley, A., and Grubert, J. 2015. Perceptual and Social Challenges in Body Proximate Display Ecosystems. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Copenhagen, Denmark, August 24--27, 2015). MobileHCI'15. 1168--1174. DOI=http://doi.org/10.1145/2786567.2794349. Google ScholarDigital Library
- Nicolai, T., Sindt, T., Witt, H., Reimerdes, J., and Kenn, H. 2006. Wearable computing for aircraft maintenance: Simplifying the user interface. Proceedings of 3rd Int. Forum Appl. Wearable Comput. (IFAWC). 15 -- 16.Google Scholar
- Witt, H., Nicolai, T., and Kenn, H. 2006. Designing a wearable user interface for hands-free interaction in maintenance applications. In Proceedings of the 4th Annual IEEE International Conference on Pervasive Computing and Communications Workshop-PerCom Workshop (Pisa, Italy, March 13--17, 2006). 652--655. DOI=http://doi.org/10.1109/PERCOMW.2006.39. Google ScholarDigital Library
- Nicolai, T., Sindt, T., Kenn, H., and Witt, H. 2006. Case Study of Wearable Computing for Aircraft Maintenance. In 3rd International Forum on Applied Wearable Computing (2006), 1--12.Google Scholar
- Navab, N. 2004. Developing killer apps for industrial augmented reality. IEEE Comput. Graph. Appl. 24, 3, 16--20. DOI=http://doi.org/10.1109/MCG.2004.1297006. Google ScholarDigital Library
- Siegel, J., and Bauer, M. 1997. A field usability evaluation of a wearable system. Dig. Pap. First Int. Symp. Wearable Comput. 1, 18--22. DOI=http://doi.org/10.1109/ISWC.1997.629914. Google ScholarDigital Library
- Mynttinen, R. 2010. Evaluating spatially directing cues on a wearable user interface in a field setup. Doctoral dissertation. Uniwien.Google Scholar
- Ward, J. A., Lukowicz, P., Tröster, G., and Starner, T. E. 2006. Activity recognition of assembly tasks using body-worn microphones and accelerometers. IEEE Trans. Pattern Anal. Mach. Intell. 28, 10, 1553--1566. DOI=http://doi.org/10.1109/TPAMI.2006.197. Google ScholarDigital Library
- Brooke J. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry 189.Google Scholar
- Davis, F. D. 1989. Perceived Usefulness, Perceived Ease of Use, and User Acceptance of. Inf. Technol. MIS Q. 13, 3, 319--340. Google ScholarDigital Library
- Rashid, U., Nacenta, M. A., and Quigley, A. 2012. The Cost of Display Switching: A Comparison of Mobile, Large Display and Hybrid UI Configurations. In Proceedings of the International Working Conference on Advanced Visual Interfaces (Capri Island, Italy, May 22--25, 2012). AVI'12. 99--106. DOI=http://doi.org/10.1145/2254556.2254577. Google ScholarDigital Library
- Funk, M., Dingler, T., Cooper, J., and Schmidt, A. 2015. Stop Helping Me --- I'M Bored!: Why Assembly Assistance Needs to Be Adaptive. In Adjunct Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the ACM International Symposium on Wearable Computers (Osaka, Japan, September 7--11, 2015). UbiComp'15. 1269--1273. DOI=http://doi.org/10.1145/2800835.2807942. Google ScholarDigital Library
- Ronkainen, S., Koskinen, E., Liu, Y., and Korhonen, P. 2010. Environment Analysis as a Basis for Designing Multimodal and Multidevice User Interfaces. Human-Computer Interact. 25, 2, 148--193. DOI=http://doi.org/10.1080/07370020903586712.Google ScholarCross Ref
- Amft, O., Lauffer, M., Ossevoort, S., Macaluso, F., Lukowicz, P., and Tr, G. 2004. Design of the QBIC wearable computing platform. In Application-Specific Systems, Architectures and Processors, 15th IEEE International Conference on. IEEE (2004), 398--410. Google ScholarDigital Library
- Gemperle, F., Kasabach, C., Stivoric, J., Bauer, M., and Martin, R. 1998. Design for wearability. Dig. Pap. Second Int. Symp. Wearable Comput. (Cat. No.98EX215). 116--122. DOI=http://doi.org/10.1109/ISWC.1998.729537. Google ScholarDigital Library
- Gemperle, F., Ota, N., and Siewiorek, D. 2001. Design of a wearable tactile display. In Proceedings of the 5th International Symposium on Wearable Computers (Zurich, Switzerland, October 8--9, 2001). ISWC'01. 5--12. DOI=http://doi.org/10.1109/ISWC.2001.962082. Google ScholarDigital Library
- Knight, J. F., Deen-Williams, D., Arvanitis, T. N., Baber, C., Sotiriou, S., Anastopoulou, S., and Gargalakos, M. 2006. Assessing the wearability of wearable computers. In Proceedings of the International Symposium on Wearable Computers (Montreux, Switzerland, October 11--14, 2006). ISWC'06. 75--82. DOI=http://doi.org/10.1109/ISWC.2006.286347.Google Scholar
- Dünser, A., Grasset, R., Seichter, H., and Billinghurst, M. 2007. Applying HCI Principles to AR Systems Design. In Proceedings of 2nd International Workshop on Mixed Reality User Interfaces: Specification, Authoring, Adaptation (North Carolina, USA, March 11, 2007). MRUI '07.Google Scholar
- Billinghurst, M., and Grasset, R. 2005. Designing Augmented Reality Interfaces Physical Elements Input Interaction Metaphor Display Elements Output. ACM Siggraph Comput. Graph. 39, 1, 17--22. Google ScholarDigital Library
- Kourouthanassis, P. E., Boletsis, C., and Lekakos, G. 2013. Demystifying the design of mobile augmented reality applications. Multimed. Tools Appl. 74, 3, 1045--1066. DOI=http://doi.org/10.1007/s11042-013-1710-7. Google ScholarDigital Library
Index Terms
- Use of wearable and augmented reality technologies in industrial maintenance work
Recommendations
Industrial maintenance with augmented reality: two case studies
VRST '16: Proceedings of the 22nd ACM Conference on Virtual Reality Software and TechnologyRemote maintenance of industrial manipulators often is performed via telephone support. Recent approaches in the context of the 'Industry 4.0' consider internet technologies and Augmented Reality (AR) to enhance situation awareness between external ...
Condition-based maintenance and production speed optimization under limited maintenance capacity
AbstractMany industrial facilities consist of multiple units working in parallel to reach a production target or to maximize production revenues. These units deteriorate due to stress that is often dependent on the production speed, and thus maintenance ...
Highlights- Simultaneous optimization of condition-based maintenance and production speed.
- Maintenance takes considerable time; at most one unit can be maintained at a time.
- Deterioration levels of units are desynchronized when there is a ...
Ethnographic study of a commercially available augmented reality HMD app for industry work instruction
PETRA '19: Proceedings of the 12th ACM International Conference on PErvasive Technologies Related to Assistive EnvironmentsIndustrial applications of Augmented Reality (AR) are becoming increasingly commonplace but there are only a small number of published user studies examining the use of commercially available AR technologies, like AR HMDs, with real workers in real ...
Comments