Skip to main content

2016 | OriginalPaper | Buchkapitel

A Visual-Haptic Display for Human and Autonomous Systems Integration

verfasst von : Matteo Razzanelli, Stefano Aringhieri, Giovanni Franzini, Giulio Avanzini, Fabrizio Giulietti, Mario Innocenti, Lorenzo Pollini

Erschienen in: Modelling and Simulation for Autonomous Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper introduces a novel concept of visual-haptic display for situational awareness improvement for crowded and low altitude airspace situations. The visual augmentation display that constitutes of Virtual Fences delimiting no-fly zones, and a specific tri-dimensional highlight graphics that enhances visibility of other remotely piloted or autonomous agents, as well as conventional manned aircraft operating in the area is presented first. Then the Shared Control paradigm and the Haptic Force generation mechanism, based on a Proportional-Derivative-like controller applied to repulsive forces generated by the Virtual Fences and other UAVs are introduced and discussed. Simulations with 26 pilots were performed in a photo-realistic synthetic environment showing that the combined use of Visual-haptic feedback outperforms the Visual Display only in helping the pilot keeping a safe distance from no-fly zones and other vehicles.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Sachs, G.: Perspective predictor/flight-path display with minimum pilot compensation. J. Guid. Control Dyn. 23(3), 420–429 (2000)CrossRef Sachs, G.: Perspective predictor/flight-path display with minimum pilot compensation. J. Guid. Control Dyn. 23(3), 420–429 (2000)CrossRef
2.
Zurück zum Zitat Mulder, M., Veldhuijzen, A.R., van Paassen, M.M., Mulder, J.A.: Integrating fly-by-wire controls with perspective flight-path displays. J. Guid. Control Dyn. 28(6), 1263–1274 (2005)CrossRef Mulder, M., Veldhuijzen, A.R., van Paassen, M.M., Mulder, J.A.: Integrating fly-by-wire controls with perspective flight-path displays. J. Guid. Control Dyn. 28(6), 1263–1274 (2005)CrossRef
3.
Zurück zum Zitat Giulietti, F., Pollini, L., Avanzini, A.: Visual aids for safe operation of remotely piloted vehicles in the controlled air space. In: Proceedings of Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, Published online before print 7 March 2016 (2016). doi:10.1177/0954410016632014 Giulietti, F., Pollini, L., Avanzini, A.: Visual aids for safe operation of remotely piloted vehicles in the controlled air space. In: Proceedings of Institution of Mechanical Engineers, Part G: Journal of Aerospace Engineering, Published online before print 7 March 2016 (2016). doi:10.​1177/​0954410016632014​
4.
Zurück zum Zitat Innocenti, M., Pollini, L., Giulietti, F.: Visual tools for man-machine interface real time simulation. In: Proceedings of IEEE Symposium on Information Technology in Mechatronics, ITM 2001, Istanbul, Turkey, October 2001 (2001) Innocenti, M., Pollini, L., Giulietti, F.: Visual tools for man-machine interface real time simulation. In: Proceedings of IEEE Symposium on Information Technology in Mechatronics, ITM 2001, Istanbul, Turkey, October 2001 (2001)
5.
Zurück zum Zitat Avanzini, G.: Frenet-based algorithm for trajectory prediction. J. Guid. Control Dyn. 27(1), 127–135 (2004)CrossRef Avanzini, G.: Frenet-based algorithm for trajectory prediction. J. Guid. Control Dyn. 27(1), 127–135 (2004)CrossRef
6.
Zurück zum Zitat Lam, T.M., Boschloo, H.W., Mulder, M., van Paassen, M.M.: Artificial force field for haptic feedback in UAV teleoperation. IEEE Trans. Syst. Man Cybern. Part A: Syst. Hum. 39(6), 1316–1330 (2009)CrossRef Lam, T.M., Boschloo, H.W., Mulder, M., van Paassen, M.M.: Artificial force field for haptic feedback in UAV teleoperation. IEEE Trans. Syst. Man Cybern. Part A: Syst. Hum. 39(6), 1316–1330 (2009)CrossRef
7.
Zurück zum Zitat Lam, T.M., Mulder, M., van Paassen, M.M., Mulder, J.A., van Der Helm, F.C.T., Force-stiffness feedback in UAV tele-operation with time delay. In: AIAA Guidance, Navigation, and Control Conference, Chicago, Illinois, August 2009 Lam, T.M., Mulder, M., van Paassen, M.M., Mulder, J.A., van Der Helm, F.C.T., Force-stiffness feedback in UAV tele-operation with time delay. In: AIAA Guidance, Navigation, and Control Conference, Chicago, Illinois, August 2009
8.
Zurück zum Zitat Diolaiti, N., Melchiorri, C.: Tele-operation of a mobile robot through haptic feedback. In: IEEE International Workshop on Haptic Virtual Environments and Their Applications (HAVE 2002), Ottawa, Ontario, Canada, November (2002) Diolaiti, N., Melchiorri, C.: Tele-operation of a mobile robot through haptic feedback. In: IEEE International Workshop on Haptic Virtual Environments and Their Applications (HAVE 2002), Ottawa, Ontario, Canada, November (2002)
9.
Zurück zum Zitat Barnes, D.P., Counsell, M.S.: Haptic communication for remote mobile manipulator robot operations. In: Proceedings of 8th Topical Meeting on Robotics and Remote Systems. American Nuclear Society, Pittsburgh (1999) Barnes, D.P., Counsell, M.S.: Haptic communication for remote mobile manipulator robot operations. In: Proceedings of 8th Topical Meeting on Robotics and Remote Systems. American Nuclear Society, Pittsburgh (1999)
10.
Zurück zum Zitat Farkhatdinov, I., Ryu, J,-H., An, J.: A preliminary experimental study on haptic teleoperation of mobile robot with variable force feedback gain. In: Haptics Symposium, 25–26 March 2010. IEEE (2010) Farkhatdinov, I., Ryu, J,-H., An, J.: A preliminary experimental study on haptic teleoperation of mobile robot with variable force feedback gain. In: Haptics Symposium, 25–26 March 2010. IEEE (2010)
11.
Zurück zum Zitat Horan, B., Crelghton, D., Nahavandi, S., Jamshidi, M., Bilateral haptic teleoperation of an articulated track mobile robot. In: IEEE International Conference on System of Systems Engineering, SoSE 2007, 16–18 April 2007 (2007) Horan, B., Crelghton, D., Nahavandi, S., Jamshidi, M., Bilateral haptic teleoperation of an articulated track mobile robot. In: IEEE International Conference on System of Systems Engineering, SoSE 2007, 16–18 April 2007 (2007)
12.
Zurück zum Zitat Mitsou, N.C., Velanas, S.V., Tzafestas, C.S.: Visuo-haptic interface for teleoperation of mobile robot exploration tasks. In: The 15th IEEE International Symposium on Robot and Human Interactive Communication, ROMAN 2006, 6–8 September 2006, pp. 157–163 (2006) Mitsou, N.C., Velanas, S.V., Tzafestas, C.S.: Visuo-haptic interface for teleoperation of mobile robot exploration tasks. In: The 15th IEEE International Symposium on Robot and Human Interactive Communication, ROMAN 2006, 6–8 September 2006, pp. 157–163 (2006)
13.
Zurück zum Zitat Rsch, O.J., Schilling, K., Roth, H.: Haptic interfaces for the remote control of mobile robots. Control Eng. Pract. 10(11), 1309–1313 (2002)CrossRef Rsch, O.J., Schilling, K., Roth, H.: Haptic interfaces for the remote control of mobile robots. Control Eng. Pract. 10(11), 1309–1313 (2002)CrossRef
14.
Zurück zum Zitat Lee, S., Sukhatme, G.S., Kim, G.J., Park, C.-M.: Haptic control of a mobile robot: a user study. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3, pp. 2867–2874 (2002) Lee, S., Sukhatme, G.S., Kim, G.J., Park, C.-M.: Haptic control of a mobile robot: a user study. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, vol. 3, pp. 2867–2874 (2002)
15.
Zurück zum Zitat De Stigter, S., Mulder, M., van Paassen, M.M.: Design and evaluation of a haptic flight director. J. Guid. Control Dyn. 30(1), 35–46 (2007)CrossRef De Stigter, S., Mulder, M., van Paassen, M.M.: Design and evaluation of a haptic flight director. J. Guid. Control Dyn. 30(1), 35–46 (2007)CrossRef
16.
Zurück zum Zitat Abbink, D.A., Boer, E.R., Mulder, M.: Motivation for continuous haptic gas pedal feedback to support car following. In: Proceedings of IEEE Intelligent Vehicles Symposium, pp. 283–290 (2008) Abbink, D.A., Boer, E.R., Mulder, M.: Motivation for continuous haptic gas pedal feedback to support car following. In: Proceedings of IEEE Intelligent Vehicles Symposium, pp. 283–290 (2008)
17.
Zurück zum Zitat Abbink, D., Mulder, M., Boer, E.R.: Haptic shared control: smoothly shifting control authority? Cogn. Technol. Work 14(1), 19–28 (2012)CrossRef Abbink, D., Mulder, M., Boer, E.R.: Haptic shared control: smoothly shifting control authority? Cogn. Technol. Work 14(1), 19–28 (2012)CrossRef
18.
Zurück zum Zitat Goodrich, K., Schutte, P., Williams, R.: Haptic-multimodal flight control system update. In: Proceedings of 11th AIAA Aviation Technology, Integration, and Operations (ATIO) Conference, pp. 1–17 (2011) Goodrich, K., Schutte, P., Williams, R.: Haptic-multimodal flight control system update. In: Proceedings of 11th AIAA Aviation Technology, Integration, and Operations (ATIO) Conference, pp. 1–17 (2011)
19.
Zurück zum Zitat Olivari, M., Nieuwenhuizen, F.M., Buelthoff, H.H., Pollini, L.: Pilot adaptation to different classes of haptic aids in tracking tasks. J. Guid. Control Dyn. 37(6), 1741–1753 (2014)CrossRef Olivari, M., Nieuwenhuizen, F.M., Buelthoff, H.H., Pollini, L.: Pilot adaptation to different classes of haptic aids in tracking tasks. J. Guid. Control Dyn. 37(6), 1741–1753 (2014)CrossRef
20.
Zurück zum Zitat Maimeri, M., Olivari, M., Buelthoff, H.H., Pollini, L.: On effects of failures in haptic and automated pilot support systems. In: Proceedings of AIAA Modeling and Simulation Technologies Conference, pp. 1–12 (2016) Maimeri, M., Olivari, M., Buelthoff, H.H., Pollini, L.: On effects of failures in haptic and automated pilot support systems. In: Proceedings of AIAA Modeling and Simulation Technologies Conference, pp. 1–12 (2016)
21.
Zurück zum Zitat D’Intino, G., Olivari, M., Geluardi, S., Venrooij, J., Innocenti, M., Buelthoff, H.H., Pollini, L.: Evaluation of haptic support system for training purposes in a tracking task. In: IEEE Systems, Men, and Cybernetics Society Conference (2016) D’Intino, G., Olivari, M., Geluardi, S., Venrooij, J., Innocenti, M., Buelthoff, H.H., Pollini, L.: Evaluation of haptic support system for training purposes in a tracking task. In: IEEE Systems, Men, and Cybernetics Society Conference (2016)
22.
Zurück zum Zitat Petermeijer, S., Abbink, D., Mulder, M., de Winter, J.: The effect of haptic support systems on driver performance: a literature survey. IEEE Trans. Haptics 8(4), 467–479 (2015)CrossRef Petermeijer, S., Abbink, D., Mulder, M., de Winter, J.: The effect of haptic support systems on driver performance: a literature survey. IEEE Trans. Haptics 8(4), 467–479 (2015)CrossRef
23.
Zurück zum Zitat Alaimo, S.M.C., Pollini, L., Bresciani, J.P., Blthoff, H.H.: A comparison of direct and indirect haptic aiding for remotely piloted vehicles. In: Proceedings of 19th IEEE International Symposium in Robot and Human Interactive Communication (IEEE Ro-Man 2010) Alaimo, S.M.C., Pollini, L., Bresciani, J.P., Blthoff, H.H.: A comparison of direct and indirect haptic aiding for remotely piloted vehicles. In: Proceedings of 19th IEEE International Symposium in Robot and Human Interactive Communication (IEEE Ro-Man 2010)
24.
Zurück zum Zitat Alaimo, S.M.C., Pollini, L., Bresciani, J.-P., Blthoff, H.H.: Experiments of direct and indirect haptic aiding for remotely piloted vehicles with a mixed wind gust rejection/obstacle avoidance task. In: AIAA Modeling and Simulation Technologies Conference 2011 (MST-2011), Portland, Oregon (2011) Alaimo, S.M.C., Pollini, L., Bresciani, J.-P., Blthoff, H.H.: Experiments of direct and indirect haptic aiding for remotely piloted vehicles with a mixed wind gust rejection/obstacle avoidance task. In: AIAA Modeling and Simulation Technologies Conference 2011 (MST-2011), Portland, Oregon (2011)
25.
Zurück zum Zitat Profumo, L., Pollini, L., Abbink, D.A.: Direct and indirect haptic aiding for curve negotiation. In: IEEE International Conference on Systems, Man, and Cybernetics (2013) Profumo, L., Pollini, L., Abbink, D.A.: Direct and indirect haptic aiding for curve negotiation. In: IEEE International Conference on Systems, Man, and Cybernetics (2013)
26.
Zurück zum Zitat Alaimo, S.M.C., Pollini, L., Innocenti, M., Bresciani, J.P., Buelthoff, H.H.: Experimental comparison of direct and indirect haptic aids in support of obstacle avoidance for remotely piloted vehicles. J. Mech. Eng. Autom. 2(10), 2159–5275 (2012) Alaimo, S.M.C., Pollini, L., Innocenti, M., Bresciani, J.P., Buelthoff, H.H.: Experimental comparison of direct and indirect haptic aids in support of obstacle avoidance for remotely piloted vehicles. J. Mech. Eng. Autom. 2(10), 2159–5275 (2012)
27.
Zurück zum Zitat Di Corato, F., Innocenti, M., Pollini, L.: Combined vision-inertial navigation for improved robustness. In: IEEE Israel Itzhack Y. Bar-Itzhack Memorial Symposium on Estimation, Navigation, and Spacecraft Control, Haifa, Israel, 14–17 October 2012 Di Corato, F., Innocenti, M., Pollini, L.: Combined vision-inertial navigation for improved robustness. In: IEEE Israel Itzhack Y. Bar-Itzhack Memorial Symposium on Estimation, Navigation, and Spacecraft Control, Haifa, Israel, 14–17 October 2012
28.
Zurück zum Zitat Di Corato, F., Innocenti, M., Pollini, L.: Robust vision-aided inertial navigation algorithm via entropy-like relative pose estimation. Gyroscopy Navig. 4(1), 1–13 (2013)CrossRef Di Corato, F., Innocenti, M., Pollini, L.: Robust vision-aided inertial navigation algorithm via entropy-like relative pose estimation. Gyroscopy Navig. 4(1), 1–13 (2013)CrossRef
29.
Zurück zum Zitat Pollini, L., Metrangolo, A.: Simulation and robust backstepping control of a quadrotor aircraft. In: AIAA Modeling and Simulation Technologies Conference, Honolulu, Hawaii (2008) Pollini, L., Metrangolo, A.: Simulation and robust backstepping control of a quadrotor aircraft. In: AIAA Modeling and Simulation Technologies Conference, Honolulu, Hawaii (2008)
30.
Zurück zum Zitat Pollini, L., Innocenti, M.: A synthetic environment for dynamic systems control and distributed simulation. IEEE Control Syst. Mag. 20(2), 49–61 (2000)CrossRef Pollini, L., Innocenti, M.: A synthetic environment for dynamic systems control and distributed simulation. IEEE Control Syst. Mag. 20(2), 49–61 (2000)CrossRef
31.
Zurück zum Zitat Hutton, J., Mostafa, M.M.R.: 10 years of direct georeferencing for airborne photogrammetry. GIS Bus. (GeoBit) 11(1), 33–41 (2005) Hutton, J., Mostafa, M.M.R.: 10 years of direct georeferencing for airborne photogrammetry. GIS Bus. (GeoBit) 11(1), 33–41 (2005)
32.
Zurück zum Zitat Nebiker, S., Eugster, H., Flckiger, K., Christen, M.: Planning and management of real-time geospatial UAS missions within a virtual globe environment. In: UAV-g 2011, Conference on Unmanned Aerial Vehicle in Geomatics (2011) Nebiker, S., Eugster, H., Flckiger, K., Christen, M.: Planning and management of real-time geospatial UAS missions within a virtual globe environment. In: UAV-g 2011, Conference on Unmanned Aerial Vehicle in Geomatics (2011)
33.
Zurück zum Zitat Pollini, L., Razzanelli, M., Olivari, M., Brandimarti, A., Maimeri, M., Pazzaglia, P., Pittiglio, G., Nuti, R., Innocenti, M., Buelthoff, H.H.: Design, realization and experimental evaluation of a haptic stick for shared control studies. In: The 13th IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design, and Evaluation of Human-Machine Systems, Kyoto, Japan (2016) Pollini, L., Razzanelli, M., Olivari, M., Brandimarti, A., Maimeri, M., Pazzaglia, P., Pittiglio, G., Nuti, R., Innocenti, M., Buelthoff, H.H.: Design, realization and experimental evaluation of a haptic stick for shared control studies. In: The 13th IFAC/IFIP/IFORS/IEA Symposium on Analysis, Design, and Evaluation of Human-Machine Systems, Kyoto, Japan (2016)
Metadaten
Titel
A Visual-Haptic Display for Human and Autonomous Systems Integration
verfasst von
Matteo Razzanelli
Stefano Aringhieri
Giovanni Franzini
Giulio Avanzini
Fabrizio Giulietti
Mario Innocenti
Lorenzo Pollini
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-47605-6_6