Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Fundamentals of All the Realities: Virtual, Augmented, Mediated, Multimediated, and Beyond Read chapter Read first chapter

2023 | OriginalPaper | Chapter

23. Augmented Reality in Maintenance: A Review of the State-of-the-Art and Future Challenges

Authors : Soh Khim Ong, C. Y. Siew, Andrew Yeh Ching Nee

Published in: Springer Handbook of Augmented Reality

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In maintenance, the use of augmented reality (AR) has often been perceived as a solution in resolving the various problems faced by the industrial sector. For any reliable production line, maintenance is crucial in order to ensure the safe, continued, and productive operation of the entire manufacturing process. However, the difficulty of maintaining modern machinery and products is increasing exponentially such that operators may not be able to cope. As a human-computer interaction (HCI) tool, AR can potentially provide the competitive advantage to the maintenance operators to keep up with this rate of increase. This chapter presents new research and application developments in AR in maintenance. The chapter provides a holistic literature review on the recent developments in the state of the art of AR in maintenance. Current research directions and future developments are discussed.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter An Augmented Reality Platform for Interactive Finite Element Analysis
next chapter Augmented Reality for Maintenance and Repair
Literature
1.
Higgins, L.R., Mobley, R.K., Smith, R.: Maintenance Engineering Handbook. McGraw-Hill Professional, New York (2002)
2.
Lee, J., Holgado, M., Kao, H.A., Macchi, M.: New thinking paradigm for maintenance innovation design. IFAC-PapersOnline. 19, 7104–7109 (2014)
3.
Henderson, S.J., Feiner, S.: Evaluating the benefits of augmented reality for task localization in maintenance of an Armored Personnel Carrier Turret. In: Proceedings of the 8th IEEE International Symposium on Mixed and Augmented Reality, Orlando, FL, pp. 135–144 (2009)
4.
Nee, A.Y.C., Ong, S.K., Chryssolouris, G., Mourtzis, D.: Augmented reality applications in design and manufacturing. Ann. CIRP. 61, 657–679 (2012)
5.
Azuma, R.: A survey of augmented reality. Presence Teleop. Virt. 6, 355–385 (1997)
6.
Henderson, S.J., Feiner, S.: Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans. Vis. Comput. Graph. 17(10), 1355–1368 (2011)
7.
De Crescenzio, F., Fantini, M.: Implementing augmented reality to aircraft maintenance: A daily inspection case study. In: Proceedings of the IDMME Virtual Concept Conference, Bordeaux, France, pp. 1–5 (2010)
8.
Dalle, M., Roy, R., Dini, G.: Improving efficiency of industrial maintenance with context aware adaptive authoring in augmented reality. Ann. CIRP. 66, 465–468 (2017)
9.
Zhu, J., Ong, S.K., Nee, A.Y.C.: A context-aware augmented reality system to assist the maintenance operators. Int. J. Interact. Des. Manuf. 8, 293–304 (2014)
10.
Bottecchia, S., Cieutat, J.M., Jessel, J.P.: T.A.C: Augmented reality system for collaborative tele-assistance in the field of maintenance through internet. In: Proceedings of the 1st International Conference on Augmented Human, Megeve, France, pp. 1–14 (2010)
11.
De Crescenzio, F., Fantini, M., Persiani, F., Di Stefano, L., Salti, S., Azzari, P.: Augmented reality for aircraft maintenance training and operations support. IEEE Comput. Graph. Appl. 31, 96–101 (2010)
12.
Perdikakis, A., Araya, A., Kiritsis, D.: Introducing augmented reality in next generation industrial learning tools: a case study on electric and hybrid vehicles. Procedia Eng. 132, 251–258 (2015)
13.
Caudell, T.P., Mizell, D.W.: Augmented reality: An application of heads-up display technology to manual manufacturing processes. In: Proceedings of the 25th International Conference on System Sciences, Hawaii, pp. 659–669 (1992)
14.
Dünser, A., Grasset, R., Seichter, H., Billinghurst, M.: Applying HCI principles to AR systems design. In: Proceedings of the 2nd International Workshop on Mixed Reality User Interfaces: Specification, Authoring, Adaptation, Charlotte, NC, pp. 37–42 (2007)
15.
Grabowski, M., Rowen, A., Rancy, J.P.: Evaluation of wearable immersive augmented reality technology in safety-critical systems. Saf. Sci. 103, 23–32 (2018)
16.
Lamberti, F., Manuri, F., Sanna, A., Paravati, G., Pezzolla, P., Montuschi, P.: Challenges, opportunities, and future trends of emerging techniques for augmented reality-based maintenance. IEEE Trans. Emerg. Top. Comput. 2, 411–421 (2014)
17.
Martinetti, A., Rajabalinejad, M., Van Dongen, L.: Shaping the future maintenance operations: reflections on the adoptions of augmented reality through problems and opportunities. Procedia CIRP. 59, 14–17 (2017)
18.
Porcelli, I., Rapaccini, M., Espíndola, D.B., Pereira, C.E.: Technical and organizational issues about the introduction of augmented reality in maintenance and technical assistance services. IFAC Proc. Vols. 46(7), 257–262 (2013)
19.
Dini, G., Mura, M.D.: Application of augmented reality techniques in through-life engineering services. Procedia CIRP. 38, 14–23 (2015)
20.
Borsci, S., Lawson, G., Broome, S.: Empirical evidence, evaluation criteria and challenges for the effectiveness of virtual and mixed reality tools for training operators of car service maintenance. Comput. Ind. 67, 17–26 (2015)
21.
Palmarini, R., Erkoyuncu, J.A., Roy, R., Torabmostaedi, H.: A systematic review of augmented reality applications in maintenance. Robot. Comput. Integr. Manuf. 49, 215–228 (2018)
22.
Friedrich, W., Jahn, D., Schmidt, L.: ARVIKA: Augmented reality for development, production and service. In: Proceedings of the 1st International Symposium on Mixed and Augmented Reality, Darmstadt, Germany, pp. 3–4 (2002)
23.
Weidenhausen, J., Knoepfle, C., Stricker, D.: Lessons learned on the way to industrial augmented reality applications. A retrospective on ARVIKA. Comput. Graph. 27, 887–891 (2003)
24.
De Groote, P.: Maintenance performance analysis: a practical approach. J. Qual. Maint. Eng. 1, 4–24 (1995)
25.
Regenbrecht, H.T., Specht, R.: A mobile passive augmented reality device – mPARD. In: Proceedings of the IEEE and ACM International Symposium on Augmented Reality, Munich, 2000, pp. 81–84 (2000)
26.
García, A.A., Bobadilla, I.G., Figueroa, G.A., Ramírez, M.P., Román, J.M.: Virtual reality training system for maintenance and operation of high-voltage overhead power lines. Virtual Reality. 20, 27–40 (2016)
27.
Fiorentino, M., Uva, A.E., Gattullo, M., Debernardis, S., Monno, G.: Augmented reality on large screen for interactive maintenance instructions. Comput. Ind. 65, 270–278 (2014)
28.
Neges, M., Wolf, M., Abramovici, M.: Secure access augmented reality solution for Mobile maintenance support utilizing condition-oriented work instructions. Procedia CIRP. 38, 58–62 (2015)
29.
Syberfeldt, A., Danielsson, O., Holm, M., Wang, L.: Dynamic operator instructions based on augmented reality and expert systems. Procedia CIRP. 41, 346–351 (2016)
30.
Shim, J., Yang, Y., Kang, N., Seo, J., Han, T.D.: Gesture-based interactive augmented reality content authoring system using HMD. Virtual Reality. 20, 57–69 (2016)
31.
Kim, K., Billinghurst, M., Bruder, G., Duh, H.B.L., Welch, G.F.: Revisiting trends in augmented reality research: a review of the 2nd decade of ISMAR (2008–2017). IEEE Trans. Vis. Comput. Graph. 24, 2947–2962 (2018)
32.
Zhu, J., Ong, S.K., Nee, A.Y.C.: A context-aware augmented reality assisted maintenance system. Int. J. Comput. Integr. Manuf. 28(2), 213–225 (2015)
33.
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., MacIntyre, B.: Recent advances in augmented reality. IEEE Comput. Graph. Appl. 21(6), 34–47 (2001)
34.
Gattullo, M., Scurati, G.W., Fiorentino, M., Uva, A.E., Ferrise, F., Bordegoni, M.: Towards augmented reality manuals for industry 4.0: a methodology. Robot. Comput. Integr. Manuf. 56, 276–286 (2019)
35.
Reardon, C., Lee, K., Rogers, J.G., Fink, J.: Augmented reality for human-robot teaming in field environments. In: Proceedings of the International Conference on Human-Computer Interaction, Orlando, pp. 79–92 (2019)
36.
Castellanos, M.J., Navarro-Newball, A.A.: Prototyping an augmented reality maintenance and repairing system for a deep well vertical turbine pump. In: Proceedings of the International Conference on Electronics, Communications and Computers, Cholula, Mexico, pp. 36–40 (2019)
37.
Wang, X., Ong, S.K., Nee, A.Y.C.: A comprehensive survey of ubiquitous manufacturing research. Int. J. Prod. Res. 56, 604–628 (2019). (2018)
38.
Haritos, T., Macchiarella, N.D.: A mobile application of augmented reality for aerospace maintenance training. In: Proceedings of the AIAA/IEEE Digital Avionics Systems Conference, Washington, DC, pp. 5.B.3–5.1 (2005)
39.
Bacca, J., Baldiris, S., Fabregat, R., Kinshuk, Graf, S.: Mobile augmented reality in vocational education and training. Procedia Comput. Sci. 75, 49–58 (2015)
40.
Nakajima, C., Itho, N.: A support system for maintenance training by augmented reality. In: Proceedings of the 12th International Conference on Image Analysis and Processing, Mantova, Italy, pp. 158–163 (2003)
41.
Webel, S., Bockholt, U., Engelke, T., Gavish, N., Olbrich, M., Preusche, C.: An augmented reality training platform for assembly and maintenance skills. Robot. Auton. Syst. 61, 398–403 (2013)
42.
Macchiarella, N.D., Vincenzi, D.A.: Augmented reality in a learning paradigm for flight aerospace maintenance training. In: Proceedings of the 24th Digital Avionics Systems Conference, Avionics in Changing Market Place: Safe and Secure, Salt Lake City, Washington, DC, pp. 5.D.1–5.1-9 (2005)
43.
Schwald, B., DeLaval, B.: An augmented reality system for training and assistance to maintenance in the industrial context. In: Proceedings of the 11th International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, Czech Republic, pp. 425–432 (2003)
44.
Segovia, D., Ramírez, H., Mendoza, M., Mendoza, M., Mendoza, E., González, E.: Machining and dimensional validation training using augmented reality for a Lean process. Procedia Comput. Sci. 75, 195–204 (2015)
45.
Jo, G.S., Oh, K.J., Ha, I., Lee, K.S., Hong, M.D., Neumann, U., You, S.: A unified framework for augmented reality and knowledge-based systems in maintaining aircraft. In: Proceedings of the National Conference on Artificial Intelligence, Quebec City, pp. 2990–2997 (2014)
46.
Neges, M., Adwernat, S., Abramovici, M.: Augmented Virtuality for maintenance training simulation under various stress conditions. Procedia Manuf. 19, 171–178 (2018)
47.
Syberfeldt, A., Holm, M., Danielsson, O., Wang, L., Brewster, R.L.: Support systems on the industrial shop-floors of the future: Operators’ perspective on augmented reality. In: Proceedings of the 6th CIRP Conference on Assembly Technologies and Systems, Gothenburg, pp. 108–113 (2016)
48.
Abdelnaby, M., Abd Elazem, M., Aly, H.A., Kaboudan, A.: Augmented reality maintenance training with intel depth camera. In: Proceedings of the International Conference on Machine Vision and Information Technology, Los Alamitos, pp. 116–122 (2017)
49.
Wang, X., Ong, S.K., Nee, A.Y.C.: Real-virtual components interaction for assembly simulation and planning. Robot. Comput. Integr. Manuf. 41, 102–114 (2016)
50.
Toro, C., Sanin, C., Vaquero, J., Posada, J., Szczerbicki, E.: Knowledge based industrial maintenance using portable devices and augmented reality. In: Proceedings of the International Conference on Knowledge-Based and Intelligent Information and Engineering Systems, Vietri sul Mare, Italy, pp. 295–302 (2007)
51.
Nakagawa, T., Sano, T., Nakatani, Y.: Plant maintenance support system by augmented reality. In: Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Tokyo, Japan, pp. I-768–I-773 (1999)
52.
Lee, S., Akin, Ö.: Augmented reality-based computational fieldwork support for equipment operations and maintenance. Autom. Constr. 20, 338–352 (2011)
53.
Savioja, O., Järvinen, P., Karhela, T., Siltanen, P., Woodward, C.: Developing a mobile, service-based augmented reality tool for modern maintenance work. In: Proceedings of the International Conference on Virtual Reality, Beijing, China, pp. 554–563 (2007)
54.
Ke, C., Kang, B., Chen, D., Li, X.: An augmented reality-based application for equipment maintenance. In: Proceedings of the First International Conference on Affective Computing and Intelligent Interaction, Beijing, China, pp. 836–841 (2005)
55.
Schlagowski, R., Merkel, L., Meitinger, C.: Design of an assistant system for industrial maintenance tasks and implementation of a prototype using augmented reality. In: Proceedings of the IEEE International Conference on Industrial Engineering and Engineering Management, Singapore, pp. 294–298 (2017)
56.
Zenati, N., Zerhouni, N., Achour, K.: Assistance to maintenance in industrial process using an augmented reality system. In: Proceedings of the IEEE International Conference on Industrial Technology, Hammamet, Tunisia, pp. 848–852 (2004)
57.
Benbelkacem, S., Belhocine, M., Bellarbi, A., Zenati-Henda, N., Tadjine, M.: Augmented reality for photovoltaic pumping systems maintenance tasks. Renew. Energy. 55, 428–437 (2013)
58.
Tatić, D., Tešić, B.: The application of augmented reality technologies for the improvement of occupational safety in an industrial environment. Comput. Ind. 85, 1–10 (2017)
59.
Garza, L.E., Pantoja, G., Ramírez, P., Ramírez, H., Rodríguez, N., González, E., Quintal, R., Pérez, J.A.: Augmented reality application for the maintenance of a Flapper valve of a Fuller-Kynion type M pump. Procedia Comput. Sci. 25, 154–160 (2013)
60.
Mooser, J., Wang, L., You, S., Neumann, U.: An augmented reality interface for mobile information retrieval. In: Proceedings of the IEEE International Conference on Multimedia and Expo, Beijing, pp. 2226–2229 (2007)
61.
Behringer, R., Chen, S., Sundareswaran, V., Wang, K., Vassiliou, M.: Novel interface for device diagnostics using speech recognition, augmented reality visualization and 3D audio auralization. In: Proceedings of the International Conference on Multimedia Computing and Systems, Florence, Italy, pp. 427–432 (1999)
62.
Oliveira, A., Caetano, N., Botega, L.C., de Araújo, R.B.: A head-up display with augmented reality and gamification for an e-maintenance system: using interfaces and gamification to motivate workers in procedural tasks. In: Proceedings of the International Conference on Human Interface and the Management of Information, Los Angeles, 2015, pp. 499–510 (2015)
63.
Aschenbrenner, D., Maltry, N., Kimmel, J., Albert, M., Scharnagl, J., Schilling, K.: ARTab – Using virtual and augmented reality methods for an improved situation awareness for telemaintenance. IFAC-PapersOnLine. 49(30), 204–209 (2016)
64.
Aschenbrenner, D., Latoschik, M.E., Schilling, K.: Industrial maintenance with augmented reality: Two case studies. In: Proceedings of the ACM Symposium on Virtual Reality Software and Technology, Munich, pp. 341–342 (2016)
65.
Abramovici, M., Wolf, M., Adwernat, S., Neges, M.: Context-aware maintenance support for augmented reality assistance and synchronous multi-user collaboration. Procedia CIRP. 59, 18–22 (2016)
66.
Zenati-Henda, N., Bellarbi, A., Benbelkacem, S., Belhocine, M.: Augmented reality system based on hand gestures for remote maintenance. In: Proceedings of the International Conference on Multimedia Computing and Systems, Marrakech, Morocco, pp. 5–8 (2014)
67.
Regenbrecht, H., Baratoff, G., Wilke, W.: Augmented reality projects in the automotive and aerospace industries. IEEE Comput. Graph. Appl. 25(6), 48–56 (2005)
68.
Wang, W., Qi, Y., Wang, Q.: An augmented reality application framework for complex equipment collaborative maintenance. In: Proceedings of the 8th International Conference on Cooperative Design, Visualization, and Engineering, Berlin, 2011, pp. 154–161 (2011)
69.
Petersen, N., Stricker, D.: Cognitive augmented reality. Comput. Graph. 53, 82–91 (2015)
70.
Chimienti, V., Iliano, S., Dassisti, M., Dini, G., Failli, F.: Guidelines for implementing augmented reality procedures in assisting assembly operations. In: Proceedings of the International Precision Assembly Seminar, Chamonix, pp. 174–179 (2010)
71.
Macchiarella, N.D.: Augmented reality as a medium for job task training. J. Instr. Deliv. Syst. 19(1), 21–24 (2005)
72.
Greenhalgh, P., Mullins, B., Grunnet-Jepsen, A., Bhowmik, A.K.: Industrial deployment of a full-featured head-mounted augmented-reality system and the incorporation of a 3D-sensing platform. In: Proceedings of the Society for Information Display Symposium Digest of Technical Papers, San Francisco, pp. 448–451 (2016)
73.
Zhu, J., Nee, A.Y.C., Ong, S.K.: Online authoring for augmented reality remote maintenance. In: Proceedings of the 12th IASTED International Conference on Computer Graphics and Imaging, Innsbruck, Austria, pp. 87–94 (2011)
74.
Masoni, R., Ferrise, F., Bordegoni, M., Gattullo, M., Uva, A.E., Fiorentino, M., Carrabba, E., Di Donato, M.: Supporting remote maintenance in industry 4.0 through augmented reality. Procedia Manuf. 11, 1296–1302 (2017)
75.
Zhu, J., Ong, S.K., Nee, A.Y.C.: An Authorable context-aware augmented reality system to assist the maintenance technicians. Int. J. Adv. Manuf. Technol. 66, 1699–1714 (2013)
76.
del Amo, I.F., Erkoyuncu, J.A., Roy, R., Wilding, S.: Augmented reality in maintenance: an information-centred design framework. Procedia Manuf. 19, 148–155 (2018)
77.
Bauer, M., Bruegge, B., Klinker, G., MacWilliams, A., Reicher, T., Riß, S., Sandor, C., Wagner, M.: Design of a component-based augmented reality framework. In: Proceedings of the IEEE and ACM International Symposium on Augmented Reality, New York, pp. 45–54 (2001)
78.
Benbelkacem, S., Zenati-Henda, N., Belhocine, M., Malek, S.: Augmented reality system for e-maintenance application. In: Proceedings of the 2nd Mediterranean Conference on Intelligent Systems and Automation, Zarzis, Tunisia, pp. 185–189 (2009)
79.
Siew, C.Y., Ong, S.K., Nee, A.Y.C.: A practical augmented reality-assisted maintenance system framework for adaptive user support. Robot. Comput. Integr. Manuf. 59, 115–129 (2019)
80.
Siltanen, S.: Theory and Applications of Marker-Based Augmented Reality. VTT Technical Research Centre of Finland, Espoo (2012)
81.
Wang, X., Ong, S.K., Nee, A.Y.C.: A comprehensive survey of augmented reality assembly research. Adv. Manuf. 4, 1–22 (2016)
82.
Kato, H., Billinghurst, M.: Marker tracking and HMD calibration for a video-based augmented reality conferencing system. In: Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality, Francisco, pp. 85–94 (1999)
83.
Wang, R., Paris, S., Popović, J.: 6D hands: Markerless hand-tracking for computer aided design. In: Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, Santa Barbara, pp. 549–558 (2011)
84.
Lee, T., Höllerer, T.: Hybrid feature tracking and user interaction for markerless augmented reality. In: Proceedings of the IEEE International Symposium on Virtual Reality, Reno, pp. 145–152 (2008)
85.
Yu, L., Ong, S.K., Nee, A.Y.C.: A tracking solution for mobile augmented reality based on sensor-aided marker-less tracking and panoramic mapping. Multimed. Tools Appl. 75, 3199–3220 (2016)
86.
Manuri, F., Pizzigalli, A., Sanna, A.: A state validation system for augmented reality based maintenance procedures. Appl. Sci. 9(10), 2115 (2019)
87.
Lima, J.P., Roberto, R., Simões, F., Almeida, M., Figueiredo, L., Teixeira, J.M., Teichrieb, V.: Markerless tracking system for augmented reality in the automotive industry. Expert Syst. Appl. 82, 100–114 (2017)
88.
Li, J., Fan, X.: Outdoor augmented reality tracking using 3D city models and game engine. In: Proceedings of the 7th International Congress on Image and Signal Processing, Dalian, China, pp. 104–108 (2014)
89.
Zhou, F., Duh, H.B.L., Billinghurst, M.: Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. In: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, Cambridge, pp. 193–202 (2008)
90.
91.
92.
93.
Flatt, H., Koch, N., Röcker, C., Günter, A., Jasperneite, J.: A context-aware assistance system for maintenance applications in smart factories based on augmented reality and indoor localization. In: Proceedings of the IEEE International Conference on Emerging Technologies and Factory Automation, Luxembourg, pp. 1–4 (2015)
94.
Paz, A., Guenaga, M.L., Eguiluz, A.: Augmented reality for maintenance operator training using surf points and homography. In: Proceedings of the 9th International Conference on Remote Engineering and Virtual Instrumentation, Bilbao, Spain, pp. 1–4 (2012)
95.
Stiefmeier, T., Ogris, G., Junker, H., Lukowicz, P., Troster, G.: Combining motion sensors and ultrasonic hands tracking for continuous activity recognition in a maintenance scenario. In: Proceedings of the 10th IEEE International Symposium on Wearable Computers, Montreux, pp. 97–104 (2006)
96.
Welch, G., Foxlin, E.: Motion tracking: no silver bullet, but a respectable arsenal. IEEE Comput. Graph. Appl. 22, 24–38 (2002)
97.
98.
99.
100.
101.
Boessenkool, H., Thomas, J., Wildenbeest, J.G.W., Heemskerk, C.J.M., de Baar, M.R., Steinbuch, M., Abbink, D.A.: Where to improve in human-in-the-loop tele-operated maintenance? A phased task analysis based on video data of maintenance at JET. Fusion Eng. Des. 129, 309–319 (2018)
102.
Siew, C.Y., Nee, A.Y.C., Ong, S.K.: Improving maintenance efficiency with an adaptive AR-assisted maintenance system. In: Proceedings of the 4th International Conference on Robotics, Control and Automation, Guangzhou, China, pp. 74–78 (2019)
103.
Tsai, C.H., Huang, J.Y.: Augmented reality display based on user behaviour. Comput. Stand. Interf. 55, 171–181 (2018)
104.
Golparvar-Fard, M., Ham, Y.: Automated diagnostics and visualization of potential energy performance problems in existing buildings using energy performance augmented reality models. J. Comput. Civ. Eng. 28, 17–29 (2013)
105.
Scurati, G.W., Gattullo, M., Fiorentino, M., Ferrise, F., Bordegoni, M., Uva, A.E.: Converting maintenance actions into standard symbols for augmented reality applications in industry 4.0. Comput. Ind. 98, 68–79 (2018)
106.
Westerfield, G., Mitrovic, A., Billinghurst, M.: Intelligent augmented reality training for motherboard assembly. Int. J. Artif. Intell. Educ. 25, 157–172 (2015)
107.
Fiorentino, M., Uva, A.E., Monno, G., Radkowski, R.: Natural interaction for online documentation in industrial maintenance. Int. J. Comput. Aided Eng. Technol. 8(1/2), 56–79 (2016)
108.
Goose, S., Sudarsky, S., Zhang, X., Navab, N.: Speech-enabled augmented reality supporting mobile industrial maintenance. IEEE Pervasive Comput. 2(1), 65–70 (2003)
109.
Park, H.M., Lee, S.H., Choi, J.S.: Wearable augmented reality system using gaze interaction. In: Proceedings of the 7th IEEE International Symposium on Mixed and Augmented Reality, Cambridge, pp. 175–176 (2008)
110.
Wang, X., Ong, S.K., Nee, A.Y.C.: Real-virtual interaction in AR assembly simulation based on component contact handling strategy. Assem. Autom. 35(4), 376–394 (2015)
111.
Lee, A.S., Swift, M., Tang, J.C., Chen, H.: 3D collaboration method over HoloLens and Skype endpoints. In: Proceedings of the 3rd International Workshop on Immersive Media Experiences, Brisbane, pp. 27–30 (2015)
112.
Pringle, A., Hutka, S., Mom, J., van Esch, R., Heffernan, N., Chen, P.: Ethnographic study of a commercially available augmented reality HMD App for industry work instruction. In: Proceedings of the 12th ACM International Conference on Pervasive Technologies Related to Assistive Environments, Rhodes, pp. 389–397 (2019)
113.
van Krevelen, R., Poelman, R.: A survey of augmented reality technologies, applications and limitations. Int. J. Virtual Real. 9, 1–20 (2010)
114.
Johnston, R.S., Willey, S.R.: Development of a commercial retinal scanning display. In: Proceedings of the Symposium on OE/Aerospace Sensing and Dual Use Photonics, Orlando, pp. 2–14 (1995)
115.
Kiyokawa, K.: Trends and vision of head mounted display in augmented reality. In: International Symposium on Ubiquitous Virtual Reality, Daejeon, South Korea, pp. 14–17 (2012)
116.
Factura, B., LaPerche, L., Reyneri, P., Jones, B., Karsch, K.: Lightform: Procedural effects for projected AR. In: Proceedings of the SIGGRAPH Special Interest Group on Computer Graphics and Interactive Techniques Conference, Vancouver, BC, pp. 6-1–6-2 (2018)
117.
Lakshmprabha, N.S., Kasderidis, S., Mousouliotis, P., Petrou, L., Beltramello, O.: Augmented reality for maintenance application on a mobile platform. In: Proceedings of the IEEE Annual International Symposium on Virtual Reality, Arles, Camargue-Provence, pp. 355–356 (2015)
118.
Fang, W., Zheng, L., Wu, X.: Multi-sensor based real-time 6-Dof pose tracking for wearable augmented reality. Comput. Ind. 92–93, 91–103 (2017)
119.
Herold, R., Vogel, U., Richter, B., Kreye, D., Reckziegel, S., Scholles, M., Lakner, H.: OLED-on-CMOS integration for augmented-reality systems. In: Proceedings of the International Students and Young Scientists Workshop – Photonics and Microsystems, Wroclaw-Szklarska Poreba, Poland, pp. 19–22 (2008)
120.
Lv, Z., Halawani, A., Feng, S., Ur Réhman, S., Li, H.: Touch-less interactive augmented reality game on vision-based wearable device. Pers. Ubiquit. Comput. 19, 551–567 (2015)
121.
Haller, M., Thomas, B.H., Billinghurst, M.: Emerging Technologies of Augmented Reality. IGI Global, Hershey (2007)
122.
Ohshima, T., Satoh, K., Yamamoto, H., Tamura, H.: RV-border guards: a multi-player mixed reality entertainment. Trans. Virtual Real. Soc. Jpn. 4(4), 699–705 (1999)
123.
Sweller, J.: Cognitive load during problem solving: effects on learning. Cogn. Sci. 12(2), 257–285 (1988)
124.
Tao, F., Cheng, J., Qi, Q., Zhang, M., Zhang, H., Sui, F.: Digital twin-driven product design, manufacturing and service with big data. Int. J. Adv. Manuf. Technol. 94, 3563–3576 (2018)
125.
Faro, A., Giordano, D., Pino, C., Spampinato, C.: Visual attention for implicit relevance feedback in a content based image retrieval. In: Proceedings of the Symposium on Eye-Tracking Research & Applications, Austin, pp. 73–76 (2010)
126.
Thayer, J.F., Åhs, F., Fredrikson, M., Sollers, J.J., Wager, T.D.: A meta-analysis of heart rate variability and neuroimaging studies: implications for heart rate variability as a marker of stress and health. Neurosci. Biobehav. Rev. 36(2), 747–756 (2012)
127.
Tattersall, A.J., Hockey, G.R.: Level of operator control and changes in heart rate variability during simulated flight maintenance. Hum. Factors. 37(4), 682–698 (1995)
128.
Kroemer, K.H.E., Grandjean, E.: Fitting the Task to the Human: A Textbook of Occupational Ergonomics, 5th edn. CRC Press, London (1997)
129.
Colombini, D., Occhipinti, E.: Scientific basis of the OCRA method for risk assessment of biomechanical overload of upper limb, as preferred method in ISO standards on biomechanical risk factors. Scand. J. Work Environ. Health. 44(4), 436–438 (2018)
130.
Stanton, N.A., Hedge, A., Brookhuis, K., Salas, E., Hendrick, H.W.: Handbook of Human Factors and Ergonomics Methods, 1st edn. CRC Press, London (2004)
131.
Salvendy, N.G.: Handbook of Human Factors and Ergonomics, 4th edn. Wiley, Hoboken (2012)
132.
Hoy, D., Brooks, P., Blyth, F., Buchbinder, R.: The epidemiology of low Back pain. Best Pract. Res. Clin. Rheumatol. 24(6), 769–781 (2010)
133.
Siew, C.Y., Ong, S.K., Nee, A.Y.C.: Improving maintenance efficiency and safety through a human-centric approach. Adv. Manuf. 9(1), 104–114 (2021)
Metadata
Title
Augmented Reality in Maintenance: A Review of the State-of-the-Art and Future Challenges
Authors
Soh Khim Ong
C. Y. Siew
Andrew Yeh Ching Nee
Copyright Year
2023
Book
Springer Handbook of Augmented Reality

Print ISBN: 978-3-030-67821-0

Electronic ISBN: 978-3-030-67822-7

Copyright Year: 2023

DOI
https://doi.org/10.1007/978-3-030-67822-7_23

Premium Partner

    Image Credits