Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
The International Journal of Advanced Manufacturing Technology
Erschienen in: The International Journal of Advanced Manufacturing Technology 9-10/2021

19.07.2021 | ORIGINAL ARTICLE

A mixed reality platform for assembly assistance based on gaze interaction in industry

verfasst von: Zenglei Wang, Shusheng Zhang, Xiaoliang Bai

Erschienen in: The International Journal of Advanced Manufacturing Technology | Ausgabe 9-10/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A novel platform for remote collaboration is proposed in this paper. This platform makes it possible for an expert to assist a worker for industrial assembly task in different places. Our goal is to compare the effect of sharing head pointer in a SAR remote collaboration with AR annotations in manufacturing. First, we develop an AR remote collaborative platform. This platform implements sharing a remote expert’s head pointer instead of eye gaze. Then, we evaluate the prototype system comparing two conditions through a user study, AR annotations and gaze cues (GC), relating to their effectiveness in the assembly efficiency, numbers of incorrect operation, workload, and collaborative experience. The results show that sharing head pointer can improve performance, co-presence awareness, and user collaborative experiences and decreases the numbers of incorrect operations. More importantly, we implement GC visualization in low-cost head tracking and find that it acts as a good referential pointing. Therefore, head pointer could be a competent representation of GC in AR/MR remote collaboration for assembly assistance. Our research has a great practical significance for the industrial application of GC-based AR/MR remote collaboration.
Vorheriger Artikel Modeling and optimization of weld bead profile with varied welding stages for weathering steel A606
Nächster Artikel Fabrication and characterization of in situ structural health monitoring hybrid continuous carbon/glass fiber–reinforced thermoplastic composite

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren
Fußnoten
Literatur
1.
Wang X, Ong SK, Nee AYC (2016) A comprehensive survey of augmented reality assembly research. Adv Manuf 1:1–22CrossRef
2.
Wang S, Parsons M, Stone-McLean J, Rogers P, Boyd S, Hoover K, Meruvia-Pastor O, Gong M, Smith A (2017) Augmented reality as a telemedicine platform for remote procedural training. Sensors-Basel. 17:2294CrossRef
3.
Anton D, Kurillo G, Bajcsy R (2018) User experience and interaction performance in 2D/3D telecollaboration. Futur Gener Comput Syst 82:77–88CrossRef
4.
Gurevich P, Lanir J, Cohen B (2015) Design and implementation of TeleAdvisor: a projection-based augmented reality system for remote collaboration. Computer Supported Cooperative Work (CSCW) 24:527–562CrossRef
5.
Wang P, Zhang S, Bai X, Billinghurst M, He W, Wang S, Zhang X, Du J, Chen Y. (2019) Head pointer or eye gaze: which helps more in MR remote collaboration. 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR).
6.
Wang P, Zhang S, Bai X, Billinghurst M, He W, Sun M, Chen Y, Lv H, Ji H (2019) 2.5DHANDS: a gesture-based MR remote collaborative platform. Int J Adv Manuf Technol 102(5-8):1339–1353CrossRef
7.
Wang P , Zhang S , Bai X , Billinghurst M, He W, Zhang L, Du J, Wang S. (2018) Do you know what I mean? An MR-based collaborative platform[C]// 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct). IEEE, 2018.
8.
Zubizarreta J, Aguinaga I, Amundarain A (2019) A framework for augmented reality guidance in industry. Int J Adv Manuf Technol 102(3):4095–4108CrossRef
9.
Wang P, Bai X, Billinghurst M, Zhang S, Han D, Sun M, Wang Z, Lv H, Han S (2020) Haptic feedback helps me? A VR-SAR remote collaborative system with tangible interaction. Int J Human Comput Interaction 2020:1–16
10.
Mourtzis D, Zogopoulos V, Xanthi F (2019) Augmented reality application to support the assembly of highly customized products and to adapt to production re-scheduling. Int J Adv Manuf Technol 105(9):1–12CrossRef
11.
Werrlich S, Daniel A, Ginger A, Nguyen PA, Notni G (2018) Comparing HMD-based and paper-based training[C]// 2018 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE 2018:134–142
12.
Hietanen A, Pieters R, Lanz M, Latokartano J, Kämäräinen J (2020) AR-based interaction for human-robot collaborative manufacturing[J]. Robot Comput Integr Manuf 63:101891CrossRef
13.
Gergle D, Kraut RE, Fussell SR (2013) Using visual information for grounding and awareness in collaborative tasks. Hum Comput Interact 28(1):1–39
14.
Balakrishnan R. (2007) Dynamic shared visual spaces: experimenting with automatic camera control in a remote repair task. In Sigchi Conference on Human Factors in Computing Systems, 1177–1186.
15.
Piumsomboon T, Dey A, Ens B, Lee G, Billinghurst M (2019). The effects of sharing awareness cues in collaborative mixed reality. Frontiers in Robotics and AI, 2019, 6:5.
16.
Piumsomboon T, Lee G A, Hart J D, Ens B, Lindeman R W, Thomas B H, Billinghurst M (2018). Mini-me: an adaptive avatar for mixed reality remote collaboration. In Chi Conference on Human Factors in Computing Systems.46:1-13.
17.
Piumsomboon T, Lee GA, Ens B, Thomas BH, Billinghurst M (2018) Superman vs giant: a study on spatial perception for a multi-scale mixed reality flying telepresence interface. Ieee T Vis Comput Gr 24:2974–2982CrossRef
18.
19.
Funk M. (2016) Augmented reality at the workplace a context-aware assistive system using in-situ projection. PHD.
20.
Kraut RE, Fussell SR, Siegel J (2003) Visual information as a conversational resource in collaborative physical tasks. J Vocat Behav 18:13–49
21.
Huang W, Alem L, Tecchia F, Duh HBL (2018) Augmented 3D hands: a gesture-based mixed reality system for distributed collaboration. J Multimodal User Interfaces 12:77–89CrossRef
22.
Akkil D, Isokoski P (2019) Comparison of gaze and mouse pointers for video-based collaborative physical task. Interact Comput 6:6
23.
Brennan SE, Chen X, Dickinson CA, Neider MB, Zelinsky GJ (2008) Coordinating cognition: the costs and benefits of shared gaze during collaborative search. Cognition, 2008 106(3):1465–1477
24.
D’Angelo S, Begel A. Improving communication between pair programmers using shared gaze awareness[C] CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems May 2017 Pages 6245–6255.
25.
Gupta K, Lee G, Billinghurst M (2016) Do you see what I see? The effect of gaze tracking on task space remote collaboration. Ieee T Vis Comput Gr 22:2413–2422CrossRef
26.
Wang P, Bai X, Billinghurst M, Zhang S, He W, Han D, Wang Y, Min H, Lan W, Han S (2020) Using a head pointer or eye gaze: the effect of gaze on spatial AR remote collaboration for physical tasks. Interact Comput 32(2):153–169CrossRef
27.
Kritzler M, Murr M, Michahelles F. (2016) RemoteBob support of on-site workers via a telepresence remote expert system. 6th International Conference on the Internet of Things (IoT‘16), November 07-09, 2016, Stuttgart, Germany.
28.
Anton D, Kurillo G, Yang AY and Bajcsy R. (2017) Augmented telemedicine platform for real-time remote medical consultation. 2017: 77-89.
29.
Günther S, Kratz S , Avrahami D, Mühlhäuser M. (2018) Exploring audio, visual, and tactile cues for synchronous remote assistance[C]// Pervasive Technologies Related to Assistive Environments Conference. 2018:339-344.
30.
Huang W, Kim S, Billinghurst M, Alem L (2018) Sharing hand gesture and sketch cues in remote collaboration. J Vis Commun Image Represent 2018
31.
Wang P, Bai X, Billinghurst M, Zhang S, Wei S, Xu G, He W, Zhang X, Zhang J (2020) 3DGAM: using 3D gesture and CAD models for training on mixed reality remote collaboration. Multimed Tools Appl:1–28
32.
Zhu K, Chen T, Han F, Wu Y S (2019). HapTwist: Creating interactive haptic proxies in virtual reality using low-cost twistable artefacts. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (pp. 1–13). Glasgow, Scotland.
33.
Metadaten
Titel
A mixed reality platform for assembly assistance based on gaze interaction in industry
verfasst von
Zenglei Wang
Shusheng Zhang
Xiaoliang Bai
Publikationsdatum
19.07.2021
Verlag
Springer London
Erschienen in
The International Journal of Advanced Manufacturing Technology / Ausgabe 9-10/2021
Print ISSN: 0268-3768
Elektronische ISSN: 1433-3015
DOI
https://doi.org/10.1007/s00170-021-07624-z

Weitere Artikel der Ausgabe 9-10/2021

The International Journal of Advanced Manufacturing Technology 9-10/2021 Zur Ausgabe

Critical Review

Finite element methods used in clinching process

ORIGINAL ARTICLE

Development and research of the press operating mechanism, made in the form of the wedge-joint mechanism with a curving wedge for separation operations

ORIGINAL ARTICLE

Fabrication of S-shaped micron-sized constrictions on FeC (steel) surface using femtosecond laser ablation with beam shaping

Critical Review

A state-of-the-art review on sensors and signal processing systems in mechanical machining processes

ORIGINAL ARTICLE

A new single probe scanning method for on-machine measurement of roundness error

ORIGINAL ARTICLE

A general method for calibration of milling force coefficients and cutter runout parameters simultaneously for helical end milling

Premium Partner

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen. 

    Zur Marktübersicht
    Bildnachweise