Skip to main content
Top
Published in: Journal on Multimodal User Interfaces 4/2019

11-01-2019 | Original Paper

The contribution of force feedback to human performance in the teleoperation of multiple unmanned aerial vehicles

Author: Hyoung Il Son

Published in: Journal on Multimodal User Interfaces | Issue 4/2019

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The availability of additional force cues in haptic devices are often expected to improve control performance, over conditions that only provide visual feedback. However, there is little empirical evidence to show this to be true for the teleoperation control of remote vehicles [i.e., multiple unmanned aerial vehicles (UAVs)]. In this paper, the contribution of haptic force feedback cues to the teleoperation of multiple UAVs was evaluated. These cues were based on either the UAVs’ velocity or directed forces from sensed obstacles. Both induced improved teleoperator perception of the remote environment. However, velocity-based cues resulted in more effortful maneuvering.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Borenstein J, Koren Y (1990) Teleautonomous guidance for mobile robots. IEEE Trans Syst Man Cybern 20(6):1437–1443CrossRef Borenstein J, Koren Y (1990) Teleautonomous guidance for mobile robots. IEEE Trans Syst Man Cybern 20(6):1437–1443CrossRef
2.
go back to reference Diolaiti N, Melchiorri C (2002) Teleoperation of a mobile robot through haptic feedback. In: Proceedings of the international workshop on haptic virtual environments and their applications, pp 67–72 Diolaiti N, Melchiorri C (2002) Teleoperation of a mobile robot through haptic feedback. In: Proceedings of the international workshop on haptic virtual environments and their applications, pp 67–72
3.
go back to reference McCarley J, Wickens C (2005) Human factors implications of UAVs in the national airspace. Aviation Human Factors Division, Savoy, Illinois, Technical report AHFD-05-05/FAA-05-01 McCarley J, Wickens C (2005) Human factors implications of UAVs in the national airspace. Aviation Human Factors Division, Savoy, Illinois, Technical report AHFD-05-05/FAA-05-01
4.
go back to reference Franchi A, Masone C, Grabe V, Ryll M, Bülthoff HH, Giordano PR (2012) Modeling and control of UAV bearing formations with bilateral high-level steering. Int J Robot Res 31(12):1504–1525CrossRef Franchi A, Masone C, Grabe V, Ryll M, Bülthoff HH, Giordano PR (2012) Modeling and control of UAV bearing formations with bilateral high-level steering. Int J Robot Res 31(12):1504–1525CrossRef
5.
go back to reference Franchi A, Secchi C, Ryll M, Bülthoff HH, Giordano PR (2012) Shared control: balancing autonomy and human assistance with a group of quadrotor UAVs. IEEE Robot Autom Mag 19(3):57–68CrossRef Franchi A, Secchi C, Ryll M, Bülthoff HH, Giordano PR (2012) Shared control: balancing autonomy and human assistance with a group of quadrotor UAVs. IEEE Robot Autom Mag 19(3):57–68CrossRef
6.
go back to reference Hong A, Bülthoff HH, Son HI (2013) A visual and force feedback for multi-robot teleoperation in outdoor environments: a preliminary result. In: 2013 IEEE international conference on robotics and automation (ICRA). IEEE, pp 1471–1478 (2013) Hong A, Bülthoff HH, Son HI (2013) A visual and force feedback for multi-robot teleoperation in outdoor environments: a preliminary result. In: 2013 IEEE international conference on robotics and automation (ICRA). IEEE, pp 1471–1478 (2013)
7.
go back to reference Hong A, Lee DG, Bülthoff HH, Son HI (2017) Multimodal feedback for teleoperation of multiple mobile robots in an outdoor environment. J Multimodal User Interfaces 11(1):67–80CrossRef Hong A, Lee DG, Bülthoff HH, Son HI (2017) Multimodal feedback for teleoperation of multiple mobile robots in an outdoor environment. J Multimodal User Interfaces 11(1):67–80CrossRef
8.
go back to reference Bahrick H (1957) An analysis of stimulus variables influencing the proprioceptive control of movements. Psychol Rev 64(5):324–328CrossRef Bahrick H (1957) An analysis of stimulus variables influencing the proprioceptive control of movements. Psychol Rev 64(5):324–328CrossRef
9.
go back to reference Hill J (1979) Study of modeling and evaluation of remote manipulation tasks with force feedback. Final Report, SRI International Project, vol 7696 Hill J (1979) Study of modeling and evaluation of remote manipulation tasks with force feedback. Final Report, SRI International Project, vol 7696
11.
go back to reference van der Meijden O, Schijven M (2009) The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review. Surg Endosc 23(6):1180–1190CrossRef van der Meijden O, Schijven M (2009) The value of haptic feedback in conventional and robot-assisted minimal invasive surgery and virtual reality training: a current review. Surg Endosc 23(6):1180–1190CrossRef
12.
go back to reference Wagner C, Howe R, Stylopoulos N (2002) The role of force feedback in surgery: analysis of blunt dissection. In: Proceedings of the symposium on haptic interfaces for virtual environment and teleoperator systems, pp 73–79 (2002) Wagner C, Howe R, Stylopoulos N (2002) The role of force feedback in surgery: analysis of blunt dissection. In: Proceedings of the symposium on haptic interfaces for virtual environment and teleoperator systems, pp 73–79 (2002)
13.
go back to reference Reiley C, Akinbiyi T, Burschka D, Chang D, Okamura A, Yuh D (2008) Effects of visual force feedback on robot-assisted surgical task performance. J Thorac Cardiovasc Surg 135(1):196–202CrossRef Reiley C, Akinbiyi T, Burschka D, Chang D, Okamura A, Yuh D (2008) Effects of visual force feedback on robot-assisted surgical task performance. J Thorac Cardiovasc Surg 135(1):196–202CrossRef
14.
go back to reference Wagner C, Howe R (2007) Force feedback benefit depends on experience in multiple degree of freedom robotic surgery task. IEEE Trans Robot 23(6):1235–1240CrossRef Wagner C, Howe R (2007) Force feedback benefit depends on experience in multiple degree of freedom robotic surgery task. IEEE Trans Robot 23(6):1235–1240CrossRef
15.
go back to reference Anderson R, Spong M (1989) Bilateral control of teleoperators with time delay. IEEE Trans Autom Control 34(5):494–501MathSciNetCrossRef Anderson R, Spong M (1989) Bilateral control of teleoperators with time delay. IEEE Trans Autom Control 34(5):494–501MathSciNetCrossRef
16.
go back to reference Massimino M (1995) Improved force perception through sensory substitution. Control Eng Pract 3(2):215–222CrossRef Massimino M (1995) Improved force perception through sensory substitution. Control Eng Pract 3(2):215–222CrossRef
17.
go back to reference Yoon J, Ryu J (2001) Design, fabrication, and evaluation of a new haptic device using a parallel mechanism. IEEE/ASME Trans Mechatron 6(3):221–233CrossRef Yoon J, Ryu J (2001) Design, fabrication, and evaluation of a new haptic device using a parallel mechanism. IEEE/ASME Trans Mechatron 6(3):221–233CrossRef
18.
go back to reference Hayward V, MacLean K (2007) Do it yourself haptics: part I. IEEE Robot Autom Mag 14(4):88–104CrossRef Hayward V, MacLean K (2007) Do it yourself haptics: part I. IEEE Robot Autom Mag 14(4):88–104CrossRef
19.
go back to reference Murray R (2007) Recent research in cooperative control of multivehicle systems. J Dyn Syst Meas Control 129:571–583CrossRef Murray R (2007) Recent research in cooperative control of multivehicle systems. J Dyn Syst Meas Control 129:571–583CrossRef
20.
go back to reference Franchi A, Secchi C, Son HI, Bülthoff HH, Giordano PR (2012) Bilateral teleoperation of groups of mobile robots with time-varying topology. IEEE Trans Robot 28(5):1019–1033CrossRef Franchi A, Secchi C, Son HI, Bülthoff HH, Giordano PR (2012) Bilateral teleoperation of groups of mobile robots with time-varying topology. IEEE Trans Robot 28(5):1019–1033CrossRef
21.
go back to reference Lee D, Franchi A, Son HI, Ha C, Bülthoff HH, Giordano PR (2013) Semiautonomous haptic teleoperation control architecture of multiple unmanned aerial vehicles. IEEE/ASME Trans Mechatron 18(4):1334–1345CrossRef Lee D, Franchi A, Son HI, Ha C, Bülthoff HH, Giordano PR (2013) Semiautonomous haptic teleoperation control architecture of multiple unmanned aerial vehicles. IEEE/ASME Trans Mechatron 18(4):1334–1345CrossRef
22.
go back to reference Ju C, Son HI (2018) Multiple UAV systems for agricultural applications: control, implementation, and evaluation. Electronics 7(9):162CrossRef Ju C, Son HI (2018) Multiple UAV systems for agricultural applications: control, implementation, and evaluation. Electronics 7(9):162CrossRef
23.
go back to reference Lam T, Boschloo H, Mulder M, Van Paassen M (2009) Artificial force field for haptic feedback in UAV teleoperation. IEEE Trans Syst Man Cybern Syst Hum 39(6):1316–1330CrossRef Lam T, Boschloo H, Mulder M, Van Paassen M (2009) Artificial force field for haptic feedback in UAV teleoperation. IEEE Trans Syst Man Cybern Syst Hum 39(6):1316–1330CrossRef
24.
go back to reference Son HI, Franchi A, Chuang LL, Kim J, Bülthoff HH, Giordano PR (2013) Human-centered design and evaluation of haptic cueing for teleoperation of multiple mobile robots. IEEE Trans Cybern 43(2):597–609CrossRef Son HI, Franchi A, Chuang LL, Kim J, Bülthoff HH, Giordano PR (2013) Human-centered design and evaluation of haptic cueing for teleoperation of multiple mobile robots. IEEE Trans Cybern 43(2):597–609CrossRef
25.
go back to reference Son HI, Chuang L, Kim J, Bülthoff HH (2011) Haptic feedback cues can improve human perceptual awareness in multi-robots teleoperation. In: Proceedings of the international conference on control, automation and systems, pp 1323–1328 Son HI, Chuang L, Kim J, Bülthoff HH (2011) Haptic feedback cues can improve human perceptual awareness in multi-robots teleoperation. In: Proceedings of the international conference on control, automation and systems, pp 1323–1328
26.
go back to reference Lee D, Huang K (2010) Passive-set-position-modulation framework for interactive robotic systems. IEEE Trans Robot 26(2):354–369CrossRef Lee D, Huang K (2010) Passive-set-position-modulation framework for interactive robotic systems. IEEE Trans Robot 26(2):354–369CrossRef
27.
go back to reference Hashtrudi-Zaad K, Salcudean SE (2001) Analysis of control architectures for teleoperation systems with impedance/admittance master and slave manipulators. Int J Robot Res 20(6):419–445CrossRef Hashtrudi-Zaad K, Salcudean SE (2001) Analysis of control architectures for teleoperation systems with impedance/admittance master and slave manipulators. Int J Robot Res 20(6):419–445CrossRef
28.
go back to reference Wichmann FA, Hill NJ (2001) The psychometric function: I. Fitting, sampling and goodness-of-fit. Percept Psychophys 63(8):1293–1313CrossRef Wichmann FA, Hill NJ (2001) The psychometric function: I. Fitting, sampling and goodness-of-fit. Percept Psychophys 63(8):1293–1313CrossRef
Metadata
Title
The contribution of force feedback to human performance in the teleoperation of multiple unmanned aerial vehicles
Author
Hyoung Il Son
Publication date
11-01-2019
Publisher
Springer International Publishing
Published in
Journal on Multimodal User Interfaces / Issue 4/2019
Print ISSN: 1783-7677
Electronic ISSN: 1783-8738
DOI
https://doi.org/10.1007/s12193-019-00292-0

Other articles of this Issue 4/2019

Journal on Multimodal User Interfaces 4/2019 Go to the issue

Premium Partner