Top

The International Journal of Advanced Manufacturing Technology

Published in:

09-02-2024 | ORIGINAL ARTICLE

The effects of complex assembly task type and assembly experience on users’ demands for augmented reality instructions

Authors: Jianghong Li, Shuxia Wang, Guanfeng Wang, Jie Zhang, Shuo Feng, Yifan Xiao, Shixin Wu

Published in: The International Journal of Advanced Manufacturing Technology | Issue 3-4/2024

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Compared to traditional techniques, augmented reality (AR) confers notable benefits in facilitating complex product assembly processes. The efficacy of AR systems in assembly contexts is notably influenced by the pivotal role of AR instructions. As such, meeting users’ demands for AR instructions is crucial during AR-guided assembly processes. In the present study, an investigation was conducted into the influence of complex assembly task types and user assembly experience on their demands for AR instructions. Firstly, complex assembly tasks were categorized into repetitive complex assembly tasks (RAT) and non-repetitive complex assembly tasks (NRAT) based on their complex characteristics. A user study was conducted using HMD-HoloLens 2 as the experimental device. User performances were recorded during iterative execution of AR experimental tasks under the aforementioned task conditions. The specific measures included users’ attention process, interface interaction behaviors, assembly errors, and users’ subjective experience. The results indicate significant differences in users’ demands for AR instructions across different task types. Moreover, users’ demands for AR instructions also changed with increasing assembly experience. Through comprehensive analysis, the rules of users’ demands for AR instructions were summarized. The present findings enhance the current comprehension of users’ demands regarding AR instructions and offer valuable insights for designing and developing efficient AR-guided assembly systems.

previous article Computational modeling for structural element analysis using cement composites in 3D printing

next article Dynamics simulation and product quality consistency optimization of energetic material extrusion process

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Chu C-H, Ko C-H (2021) An experimental study on augmented reality assisted manual assembly with occluded components. J Manuf Syst 61:685–695CrossRef

Carmigniani J, Furht B (2011) Augmented reality: An overview. In: Furht B (ed) Handbook of augmented reality: Springer New York, pp 3–46

Nee AYC, Ong SK, Chryssolouris G, Mourtzis D (2012) Augmented reality applications in design and manufacturing. CIRP Ann 61(2):657–679CrossRef

Malik AA, Masood T, Bilberg A (2019) Virtual reality in manufacturing: immersive and collaborative artificial-reality in design of human-robot workspace. Int J Comput Integr Manuf 33(1):22–37CrossRef

Gupta S, Chaudhary R, Gupta S (2019) A survey on tracking techniques in augmented reality based application. International Conference on Image Information Processing (ICIIP), pp 215–220

Li W, Wang J, Lan S, Li S (2019) Augmented reality assembly process information content editing technology. Comput Integr Manuf Syst 25(7):1676–1684

Wu D, Zhou S, Xu H (2021) Assembly operation process assistance based on augmented reality and artificial intelligence. Aeronaut Manuf Technol 64(13):26–32

Schwerdtfeger Bo, Reif R, G¨unthner WA, Klinker G, Hamacher D, Schega L, Bockelmann I, Doil F, T¨umler J (2009) Pick-by-vision: a first stress test. In: IEEE International Symposium on Mixed and Augmented Reality, pp 115–124

Choong Y-Y, Goad K, Mangold KC (2022) Augmented reality (AR) usability evaluation framework: the case of public safety communications research. NIST Interagency/Internal Report (NISTIR), pp 1–21

10.

Bottani E, Vignali G (2019) Augmented reality technology in the manufacturing industry: a review of the last decade. IISE Transactions 51(3):284–310CrossRef

11.

Akçayır M, Akçayır G, Pektaş HM, Ocak MA (2016) Augmented reality in science laboratories: the effects of augmented reality on university students’ laboratory skills and attitudes toward science laboratories. Comput Hum Behav 57:334–342CrossRef

12.

Poushneh A (2018) Augmented reality in retail: a trade-off between user’s control of access to personal information and augmentation quality. J Retail Consum Serv 41:169–176CrossRef

13.

Yuan ML, Ong SK, Nee AYC (2008) Augmented reality for assembly guidance using a virtual interactive tool. Int J Prod Res 46(7):1745–1767CrossRef

14.

Hou L, Wang X, Bernold L, Love PED (2013) Using animated augmented reality to cognitively guide assembly. J Comput Civ Eng 27(5):439–451CrossRef

15.

Hou L, Wang X, Truijens M (2015) Using augmented reality to facilitate piping assembly: an experiment-based evaluation. J Comput Civil Eng 29:1CrossRef

16.

Brizzi F, Peppoloni L, Graziano A, Stefano ED, Avizzano CA, Ruffaldi E (2018) Effects of augmented reality on the performance of teleoperated industrial assembly tasks in a robotic embodiment. IEEE Trans Human-Mach Syst 48(2):197–206CrossRef

17.

Yang Z, Shi J, Jiang W, Sui Y, Wu Y, Ma S, Kang C, Li H (2019) Influences of augmented reality assistance on performance and cognitive loads in different stages of assembly task. Front Psychol 10:1703CrossRefPubMedPubMedCentral

18.

Vanneste P, Huang Y, Park JY, Cornillie F, Decloedt B, Van den Noortgate W (2020) Cognitive support for assembly operations by means of augmented reality: an exploratory study. Int J Human-Comput Stud 143:102480

19.

Werrlich S, Lorber C, Nguyen P-A, Yanez CEF, Notni G (2018) Assembly training: comparing the effects of head-mounted displays and face-to-face training. In: Chen J, Fragomeni G (eds) Virtual, augmented and mixed reality: interaction, navigation, visualization, embodiment, and simulation. Springer International Publishing, pp 462–476

20.

Barfield W, Caudell TP (2001) Boeing’s wire bundle assembly project

21.

Fiorentino M, Monno G, Uva AE (2009) Tangible digital master for product lifecycle management in augmented reality. Int J Interact Des Manuf (IJIDeM) 3(2):121–129CrossRef

22.

Wiedenmaier S, Oehme O, Schmidt L, Luczak H (2003) Augmented reality (AR) for assembly processes design and experimental evaluation. Int J Human-Comput Interact 16(3):497–514CrossRef

23.

Feiner SHS (2011) Exploring the benefits of augmented reality documentation for maintenance and repair. IEEE Trans Vis Comput Graph 17(10):1355–1368CrossRefPubMed

24.

Huang JM, Ong SK, Nee AYC (2017) Visualization and interaction of finite element analysis in augmented reality. Comput Aided Des 84:1–14CrossRef

25.

Billinghurst M, Hakkarainen M, Woodward C (2008) Augmented assembly using a mobile phone. In: 2008 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp 167–168

26.

Jeffri NFS, Rambli DRA (2020) Guidelines for the interface design of AR systems for manual assembly. In: Proceedings of the 2020 4th International Conference on Virtual and Augmented Reality Simulations, pp 70–77

27.

Funk M, Bächler A, Bächler L, Korn O, Krieger C, Heidenreich T, Schmidt A (2015) Comparing projected in-situ feedback at the manual assembly workplace with impaired workers. In: Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments, pp 1–8

28.

Funk M, Kosch T, Greenwald SW, Schmidt A (2015) A benchmark for interactive augmented reality instructions for assembly tasks. In: Proceedings of the 14th International Conference on Mobile and Ubiquitous Multimedia, pp 253–257

29.

Wang Z, Bai X, Zhang S, Billinghurst M, He W, Wang Y, Han D, Chen G, Li J (2021) The role of user-centered AR instruction in improving novice spatial cognition in a high-precision procedural task. Adv Eng Inform 47:101250

30.

Funk M, Bächler A, Bächler L, Kosch T, Heidenreich T, Schmidt A (2017) Working with augmented reality? In: Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments, pp 222–229

31.

Wang C-H, Tsai N-H, Lu J-M, Wang M-JJ (2019) Usability evaluation of an instructional application based on Google Glass for mobile phone disassembly tasks. Appl Ergon 77:58–69CrossRefPubMed

32.

Rodriguez FS, Saleem K, Spilski J, Lachmann T (2021) Performance differences between instructions on paper vs digital glasses for a simple assembly task. Appl Ergon 94:103423

33.

Drouot M, Le Bigot N, Bricard E, Bougrenet JL, Nourrit V (2022) Augmented reality on industrial assembly line: impact on effectiveness and mental workload. Appl Ergon 103:103793CrossRefPubMed

34.

Wang Z, Bai X, Zhang S, Billinghurst M, He W, Wang P, Lan W, Min H, Chen Y (2022) A comprehensive review of augmented reality-based instruction in manual assembly, training and repair. Robot Comput -Integr Manuf 78:102407

35.

Gattullo M, Dalena V, Evangelista A, Uva AE (2019) A context-aware technical information manager for presentation in augmented reality. Virtual Reality and 3D User Interfaces (VR) 939–940

36.

Wang Z, Bai X, Zhang S, He W, Zhang X, Zhang L, Wang P, Han D, Yan Y (2019) Information-level AR instruction: a novel assembly guidance information representation assisting user cognition. Int J Adv Manuf Technol 106(1–2):603–626

37.

Wang X, Ong SK, Nee AYC (2016) Multi-modal augmented-reality assembly guidance based on bare-hand interface. Adv Eng Inform 30(3):406–421CrossRef

38.

Endsley TC, Sprehn KA, Brill RM, Ryan KJ, Vincent EC, Martin JM (2017) Augmented reality design heuristics: designing for dynamic interactions. Proc Human Factors Ergon Soc Ann Meet 61(1):2100–2104CrossRef

39.

Ariansyah D, Erkoyuncu JA, Eimontaite I, Johnson T, Oostveen A-M, Fletcher S, Sharples S (2022) A head mounted augmented reality design practice for maintenance assembly: toward meeting perceptual and cognitive needs of AR users. Appl Ergon 98(2):103597CrossRefPubMed

40.

Jones AT, Romero D, Wuest T (2018) Modeling agents as joint cognitive systems in smart manufacturing systems. Manuf Lett 17:6–8CrossRef

41.

Hollnagel E (2005) Designing for joint cognitive systems. People and Systems - Who are we Designing for 47–51

42.

Rumelhart DE (1977) Cognitive psychology: cognition and reality. Science 198(4319):816–817

43.

Haritos T, Macchiarella ND (2005) A mobile application of augmented reality for aerospace maintenance training. In: 24th Digital Avionics Systems Conference 1:5.B.3–5.1

44.

Wang Z, Bai X, Zhang S, He W, Wang P, Zhang X, Yan Y (2020) SHARIdeas: a visual representation of intention sharing between designer and executor supporting AR assembly. In: Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference, pp 1–2

45.

Stork S, Schubö A (2010) Human cognition in manual assembly: theories and applications. Adv Eng Inform 24(3):320–328CrossRef

46.

Radkowski R, Herrema J, Oliver J (2015) Augmented reality-based manual assembly support with visual features for different degrees of difficulty. Int J Human-Comput Interact 31(5):337–349CrossRef

47.

Blattgerste J, Strenge B, Renner P, Pfeiffer T, Essig K (2017) Comparing conventional and augmented reality instructions for manual assembly tasks. In: Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments, pp 75–82

48.

Funk M, Kosch T, Schmidt A (2016) Interactive worker assistance: comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. In: Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, pp 934–939

49.

Smith E, Semple G, Evans D, McRae K, Blackwell P (2020) Augmented instructions: analysis of performance and efficiency of assembly tasks. In: Chen JYC, Fragomeni G (eds) Virtual, Augmented and Mixed Reality. Industrial and Everyday Life Applications, 12191:166–177

50.

Takemura BMKKKAMJJLVTMH (2014) The effectiveness of an AR-based context-aware assembly support system in object assembly. In: 2014 IEEE Virtual Reality (VR), pp 57–62

51.

Livingston MA (2005) Evaluating human factors in augmented reality systems. IEEE Comput Graphics Appl 25(6):6–9CrossRef

52.

Porter ME, Heppelmann JE (2017) Why every organization needs an augmented reality strategy. Harv Bus Rev 95(6):46–57

53.

Holm M, Danielsson O, Syberfeldt A, Moore P, Wang L (2017) Adaptive instructions to novice shop-floor operators using augmented reality. J Ind Prod Eng 34(5):362–374

54.

Li D, Babcock J, and Parkhurst DJ (2006) openEyes: a low-cost head-mounted eye-tracking solution. In: Proceedings of the 2006 symposium on Eye tracking research & applications, pp 95–100

55.

Chen F, Ruiz N, Choi E, Epps J, Khawaja MA, Taib R, Yin B, Wang Y (2012) Multimodal behavior and interaction as indicators of cognitive load. ACM Trans Interact Intell Syst 2(4):1–36CrossRef

56.

Liang C, Lin C-T, Yao S-N, Chang W-S, Liu Y-C, Chen S-A (2017) Visual attention and association: an electroencephalography study in expert designers. Des Stud 48:76–95CrossRef

57.

Thomas LE, Lleras A (2007) Moving eyes and moving thought: on the spatial compatibility between eye movements and cognition. Psychon Bull Rev 14(4):663–668CrossRefPubMed

58.

Nuthmann A, Smith TJ, Engbert R, Henderson JM (2010) CRISP: a computational model of fixation durations in scene viewing. Psychol Rev 117(2):382–405CrossRefPubMed

59.

Kalyani R and Gadiraju U (2019) Understanding user search behavior across varying cognitive levels. In: Proceedings of the 30th ACM Conference on Hypertext and Social Media, pp 123–132

60.

Duncan J, Humphreys GW (1989) Visual search and stimulus similarity. Psychol Rev 96(3):433–458CrossRefPubMed

61.

Desimone R, Duncan J (1995) Neural mechanisms of selective visual attention. Annu Rev Neurosci 18:193–222CrossRefPubMed

62.

Richardson M, Jones G, Torrance M (2004) Identifying the task variables that influence perceived object assembly complexity. Ergonomics 47(9):945–964CrossRefPubMed

63.

Wickens CD (1992) Engineering psychology and human performance (2nd ed.): HarperCollins Publishers

64.

Clark R, Harrelson GL (2002) Designing instruction that supports cognitive learning processes. J Athl Train 37(4):152–159

65.

Basil MD (2012) Multiple resource theory. In: Seel NM (eds) Encyclopedia of the Sciences of Learning, pp 2384–2385

66.

Lee BC, Duffy VG (2015) The effects of task interruption on human performance: a study of the systematic classification of human behavior and interruption frequency. Human Factors Ergon Manuf Serv Ind 25(2):137–152CrossRef

67.

Lai Z-H, Tao W, Leu MC, Yin Z (2020) Smart augmented reality instructional system for mechanical assembly towards worker-centered intelligent manufacturing. J Manuf Syst 55:69–81CrossRef

68.

Sable-Meyer M, Fagot J, Caparos S, van Kerkoerle T, Amalric M, Dehaene S (2021) Sensitivity to geometric shape regularity in humans and baboons: a putative signature of human singularity. Proc Natl Acad. Sci U.S.A 118:16CrossRef

Title: The effects of complex assembly task type and assembly experience on users’ demands for augmented reality instructions
Authors: Jianghong Li
Shuxia Wang
Guanfeng Wang
Jie Zhang
Shuo Feng
Yifan Xiao
Shixin Wu
Publication date: 09-02-2024
Publisher: Springer London
Published in: The International Journal of Advanced Manufacturing Technology / Issue 3-4/2024
Print ISSN: 0268-3768
Electronic ISSN: 1433-3015
DOI: https://doi.org/10.1007/s00170-024-13091-z

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 3-4/2024

Biodegradable cutting fluids for sustainable manufacturing: a review of machining mechanisms and performance

Data-driven thermal error modeling based on a novel method of temperature measuring point selection

An accelerated simulating method for flow forming process through locally and dynamically rigidifying the workpiece

Ultrasonic vibration–assisted chatter suppression for deep hole boring of stainless steel

Investigation of the nozzle arrangement effect on the performance of internal spray cooling turning tool

Temperature-driven controllable deformation in 4D printing through programmable heterogeneous laminated bilayer structure

Premium Partners