skip to main content
10.1145/2910674.2910683acmotherconferencesArticle/Chapter ViewAbstractPublication PagespetraConference Proceedingsconference-collections
research-article

Haptic, Auditory, or Visual?: Towards Optimal Error Feedback at Manual Assembly Workplaces

Authors Info & Claims
Published:29 June 2016Publication History

ABSTRACT

We are observing a trend that more and more manual assembly workplaces are equipped with sensor technology to assist workers during complex work tasks. These assistive systems mostly use visual feedback for providing assembly instructions or hinting at errors. However, a red light indicating an error might not always be the best solution for communicating that an error was made, or might be overlooked in stressful situations. Therefore, we extended an assitsive system to compare haptic, auditory, and visual error feedback at the manual assembly workplace. Through two user studies, we first determine suitable variants for each error feedback modality and second compare the error feedback modalities against each other. The results show that haptic feedback is appropriate for retaining the worker's privacy, and auditory feedback is perceived as most distracting. The subjective feedback reveals interesting insights for future research in communicating errors as a combination of haptic and visual feedback might lead to noticing an error faster.

References

  1. Motoyuki Akamatsu, I Scott MacKenzie, and Thierry Hasbroucq. 1995. A comparison of tactile, auditory, and visual feedback in a pointing task using a mouse-type device. Ergonomics 38, 4 (1995), 816--827. DOI: http://dx.doi.org/10.1080/00140139508925152Google ScholarGoogle ScholarCross RefCross Ref
  2. A Bannat, F Wallhoff, G Rigoll, F Friesdorf, H Bubb, S Stork, HJ Müller, A Schubö, M Wiesbeck, and MF Zäh. 2008. Towards optimal worker assistance: a framework for adaptive selection and presentation of assembly instructions. In Proceedings of the 1st international workshop on cognition for technical systems, Cotesys.Google ScholarGoogle Scholar
  3. Dominik Bial, Dagmar Kern, Florian Alt, and Albrecht Schmidt. 2011. Enhancing outdoor navigation systems through vibrotactile feedback. In CHI'11 Extended Abstracts on Human Factors in Computing Systems. ACM, 1273--1278. DOI: http://dx.doi.org/10.1145/1979742.1979760 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Sebastian Büttner, Markus Funk, Oliver Sand, and Carsten Röcker. 2016. Using Head-Mounted Displays and In-Situ Projection for Assistive Systems A Comparison.. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 8. DOI: http://dx.doi.org/10.1145/2910674.2910679 Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Sebastian Büttner, Oliver Sand, and Carsten Röcker. 2015. Extending the Design Space in Industrial Manufacturing Through Mobile Projection. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct. ACM, 1130--1133. DOI: http://dx.doi.org/10.1145/2786567.2794342 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Markus Funk, Andreas Bächler, Liane Bächler, Oliver Korn, Christoph Krieger, Thomas Heidenreich, and Albrecht Schmidt. 2015a. Comparing projected in-situ feedback at the manual assembly workplace with impaired workers. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 1. DOI: http://dx.doi.org/10.1145/2769493.2769496 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Markus Funk, Sven Mayer, Michael Nistor, and Albrecht Schmidt. 2016. Mobile In-Situ Pick-by-Vision: Order Picking Support using a Projector Helmet. In Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 4. DOI: http://dx.doi.org/10.1145/2910674.2910730 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Markus Funk, Sven Mayer, and Albrecht Schmidt. 2015b. Using In-Situ Projection to Support Cognitively Impaired Workers at the Workplace. In Proceedings of the 17th international ACM SIGACCESS conference on Computers & accessibility. DOI: http://dx.doi.org/10.1145/2700648.2809853 Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Markus Funk and Albrecht Schmidt. 2015. Cognitive assistance in the workplace. Pervasive Computing, IEEE14, 3 (2015), 53--55. DOI: http://dx.doi.org/10.1109/MPRV.2015.53Google ScholarGoogle ScholarCross RefCross Ref
  10. Markus Funk, Alireza Sahami Shirazi, Sven Mayer, Lars Lischke, and Albrecht Schmidt. 2015. Pick from here!: an interactive mobile cart using in-situ projection for order picking. In Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing. ACM, 601--609. DOI: http://dx.doi.org/10.1145/2750858.2804268 Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Oliver Korn, Markus Funk, Stephan Abele, Thomas Hörz, and Albrecht Schmidt. 2014. Context-aware assistive systems at the workplace: analyzing the effects of projection and gamification. In Proceedings of the 7th International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 38. DOI: http://dx.doi.org/10.1145/2674396.2674406 Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Oliver Korn, Markus Funk, and Albrecht Schmidt. 2015a. Assistive Systems for the Workplace: Towards Context-Aware Assistance. Assistive Technologies for Physical and Cognitive Disabilities (2015), 121--133. DOI:http://dx.doi.org/10.4018/978-1-4666-8200-9.ch097Google ScholarGoogle Scholar
  13. Oliver Korn, Markus Funk, and Albrecht Schmidt. 2015b. Design approaches for the gamification of production environments: a study focusing on acceptance. In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 6. DOI: http://dx.doi.org/10.1145/2769493.2769549 Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Bernd Petzold, Michael F Zaeh, Berthold Faerber, Barbara Deml, Hans Egermeier, Johannes Schilp, and Stella Clarke. 2004. A study on visual, auditory, and haptic feedback for assembly tasks. Presence 13, 1 (2004), 16--21. DOI: http://dx.doi.org/10.1162/105474604774048207 Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Matthias Rauterberg and Erich Styger. 1994. Positive effects of sound feedback during the operation of a plant simulator. In Human-Computer Interaction. Springer, 35--44. DOI: http://dx.doi.org/10.1007/3-540-58648-2_24 Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Paul Richard, Grigore Burdea, Daniel Gomez, and Philippe Coiffet. 1994. A comparison of haptic, visual and auditive force feedback for deformable virtual objects. In Proceedings of the Internation Conference on Automation Technology (ICAT). 49--62.Google ScholarGoogle Scholar
  17. Stefan Rüther, Thomas Hermann, Maik Mracek, Stefan Kopp, and Jochen Steil. 2013. An assistance system for guiding workers in central sterilization supply departments. In Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments. ACM, 3. DOI: http://dx.doi.org/10.1145/2504335.2504338 Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Arthur Tang, Charles Owen, Frank Biocca, and Weimin Mou. 2003. Comparative effectiveness of augmented reality in object assembly. In Proceedings of the SIGCHI conference on Human factors in computing systems. ACM, 73--80. DOI: http://dx.doi.org/10.1145/642611.642626 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Haptic, Auditory, or Visual?: Towards Optimal Error Feedback at Manual Assembly Workplaces

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Other conferences
      PETRA '16: Proceedings of the 9th ACM International Conference on PErvasive Technologies Related to Assistive Environments
      June 2016
      455 pages
      ISBN:9781450343374
      DOI:10.1145/2910674

      Copyright © 2016 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 29 June 2016

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed limited

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader