Skip to main content
Top

2022 | OriginalPaper | Chapter

Remote Tower Experimental System with Augmented Vision Videopanorama

Authors : Norbert Fürstenau, Markus Schmidt

Published in: Virtual and Remote Control Tower

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The goal of the research described in this chapter was the development and setup of an initial experimental version of the “Virtual Tower” with focus on replacement of the direct view out-of-windows. Specifically, the intermediate step of a Remote Tower Operation (RTO) work environment for remote surveillance and control of small airports is described which served for verifying the main functionalities. A structured work and task analysis detailed the requirements on the new human–machine interface (HMI) and emphasized the “far view” out of the tower windows as important information source. Consequently a digital high-resolution videopanorama system was implemented as central HMI-component to replace the airport tower out-the-window view. Field tests using this reconstructed panorama indicated the effective visual resolution for object detection to show reasonable agreement with theoretical predictions under ideal conditions. As addition to the panorama an integrated zoom function provided an enlarged narrow-angle “foveal” component by means of a remotely controlled pan-tilt-zoom camera with tracking functionality. The digital reconstruction of the far view allowed for integration of “video-see-through” augmented vision features by integration and superposition of e.g. weather and electronic surveillance data, and it allowed for video replay of stored surveillance information.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Barfield, W., & Caudell, T. (Eds.) (2001). Fundamentals of Wearable Computers and Augmented Reality. Mahwah/NJ, London: Lawrence Erlbaum. Barfield, W., & Caudell, T. (Eds.) (2001). Fundamentals of Wearable Computers and Augmented Reality. Mahwah/NJ, London: Lawrence Erlbaum.
go back to reference Bass, M. (1995). Handbook of Optics (Vol. 1, pp. 24.13 ff). New York: McGraw-Hill. Bass, M. (1995). Handbook of Optics (Vol. 1, pp. 24.13 ff). New York: McGraw-Hill.
go back to reference Brinton, & Atkins. (2006). Brinton & Atkins Remote Airport Traffic Services Concept, Proceedings, I-CNS Conference, Baltimore 5/2006. Baltimore Brinton, & Atkins. (2006). Brinton & Atkins Remote Airport Traffic Services Concept, Proceedings, I-CNS Conference, Baltimore 5/2006. Baltimore
go back to reference Ellis, S. R. (1991). Pictorial Communication in Virtual and Real Environments. Taylor & Francis.CrossRef Ellis, S. R. (1991). Pictorial Communication in Virtual and Real Environments. Taylor & Francis.CrossRef
go back to reference Ellis, S. R., Fürstenau, N., & Mittendorf, M. (2011). Determination of frame rate requirements of video-panorama-based virtual towers using visual discrimination of landing aircraft deceleration during simulated aircraft landing. Fortschritt-Berichte VDI, 22(33), 519–524. Ellis, S. R., Fürstenau, N., & Mittendorf, M. (2011). Determination of frame rate requirements of video-panorama-based virtual towers using visual discrimination of landing aircraft deceleration during simulated aircraft landing. Fortschritt-Berichte VDI, 22(33), 519–524.
go back to reference Fürstenau, N. (2013). Remote Airport Traffic Control Center (RAiCe). Braunschweig: DLR IB-112-2013/20. Fürstenau, N. (2013). Remote Airport Traffic Control Center (RAiCe). Braunschweig: DLR IB-112-2013/20.
go back to reference Fürstenau, N. (1996). From Sensors to Situation Awareness. DLR Mitteilung 96–02. Köln: DLR. Fürstenau, N. (1996). From Sensors to Situation Awareness. DLR Mitteilung 96–02. Köln: DLR.
go back to reference Fürstenau, N. (2004). Virtual Tower. Visionary Projects Competition 2001–2004 (pp. 16–19). Köln: DLR. Fürstenau, N. (2004). Virtual Tower. Visionary Projects Competition 2001–2004 (pp. 16–19). Köln: DLR.
go back to reference Fürstenau, N., Rudolph, M., Schmidt, M., & Lorenz, B. (2004). On the use of transparent rear projection screens to reduce head-down time in the air-traffic control tower. In Proceedings of the Human Performance, Situation Awareness and Automation Technology (HAPSA II) (pp. 195–200). Lawrence Erlbaum, Mahwah/NJ. Fürstenau, N., Rudolph, M., Schmidt, M., & Lorenz, B. (2004). On the use of transparent rear projection screens to reduce head-down time in the air-traffic control tower. In Proceedings of the Human Performance, Situation Awareness and Automation Technology (HAPSA II) (pp. 195–200). Lawrence Erlbaum, Mahwah/NJ.
go back to reference Fürstenau, N., Rudolph, M., Schmidt, M., Werther, B., Hetzheim, H., Halle, W., & Tuchscheerer, W. (2008). Flugverkehr-Leiteinrichtung (Virtueller Tower). Europäisches Patent EP1791364. Fürstenau, N., Rudolph, M., Schmidt, M., Werther, B., Hetzheim, H., Halle, W., & Tuchscheerer, W. (2008). Flugverkehr-Leiteinrichtung (Virtueller Tower). Europäisches Patent EP1791364.
go back to reference Fürstenau, N., Schmidt, M., Rudolph, M., Möhlenbrink, C., & Halle, W. (2008). Augmented vision videopano-rama system for remote airport tower operation. In Proceedings of the ICAS 2008, 26th International Congress of the Aeronautical Sciences. Anchorage: I. Grant. Fürstenau, N., Schmidt, M., Rudolph, M., Möhlenbrink, C., & Halle, W. (2008). Augmented vision videopano-rama system for remote airport tower operation. In Proceedings of the ICAS 2008, 26th International Congress of the Aeronautical Sciences. Anchorage: I. Grant.
go back to reference Fürstenau, N., Schmidt, M., Rudolph, M., Möhlenbrink, C., Kaltenhäuser, S., & Schlüßler, E. (2011). Experimental system for remote airport traffic control center research. In F. Vanderhaegen (Ed.), IFAC Proceeding of the Analysis, Design, and Evaluation of Human-Machine Systems. 11/1, pp. 111–116. Valenciennes / France: Elsevier. Fürstenau, N., Schmidt, M., Rudolph, M., Möhlenbrink, C., Kaltenhäuser, S., & Schlüßler, E. (2011). Experimental system for remote airport traffic control center research. In F. Vanderhaegen (Ed.), IFAC Proceeding of the Analysis, Design, and Evaluation of Human-Machine Systems. 11/1, pp. 111–116. Valenciennes / France: Elsevier.
go back to reference Fürstenau, N., Schmidt, M., Rudolph, M., Möhlenbrink, M., & Werther, B. (2007). Development of an augmented vision videopanorama human-machine interface for remote airport tower operation. In Proceedings of the 6th Eurocontrol Innovative Research Workshop (pp. 125–132). Bretigny, France: Eurocontrol. Fürstenau, N., Schmidt, M., Rudolph, M., Möhlenbrink, M., & Werther, B. (2007). Development of an augmented vision videopanorama human-machine interface for remote airport tower operation. In Proceedings of the 6th Eurocontrol Innovative Research Workshop (pp. 125–132). Bretigny, France: Eurocontrol.
go back to reference Hannon, D., Lee, J., Geyer, M., Mackey, S., Sheridan, T., Francis, M., … Malonson, M. (2008). Feasibility Evaluation of a Staffed Virtual Tower. The Journal of Air Traffic Control, 27–39. Hannon, D., Lee, J., Geyer, M., Mackey, S., Sheridan, T., Francis, M., … Malonson, M. (2008). Feasibility Evaluation of a Staffed Virtual Tower. The Journal of Air Traffic Control, 27–39.
go back to reference Kraiss, K., & Kuhlen, T. (1996). Virtual reality—principles and applications. In N. Fürstenau (Ed.), From Sensors to Situation Awareness. DLR-Mitteilung 112-96-02 (pp. 187–208). Kraiss, K., & Kuhlen, T. (1996). Virtual reality—principles and applications. In N. Fürstenau (Ed.), From Sensors to Situation Awareness. DLR-Mitteilung 112-96-02 (pp. 187–208).
go back to reference Möhlenbrink, C., Friedrich, M., Papenfuss, A., Rudolph, M., Schmidt, M., Morlang, F., & Fürstenau, N. (2010). High-fidelity human-in-the-loop simulations as one step towards remote control of regional airports: a preliminary study. In Proceedings of the Internatioanl Conference Research Air Transportation. Budapest: Eurocontrol. Möhlenbrink, C., Friedrich, M., Papenfuss, A., Rudolph, M., Schmidt, M., Morlang, F., & Fürstenau, N. (2010). High-fidelity human-in-the-loop simulations as one step towards remote control of regional airports: a preliminary study. In Proceedings of the Internatioanl Conference Research Air Transportation. Budapest: Eurocontrol.
go back to reference Papenfuss, A., & Möhlenbrink, C. (2009). RaiCe—Cognitive Work Analysis. Braunschweig: DLR IB-112–2009/22. Papenfuss, A., & Möhlenbrink, C. (2009). RaiCe—Cognitive Work Analysis. Braunschweig: DLR IB-112–2009/22.
go back to reference Papenfuss, A., Möhlenbrink, C., Friedrich, M., Schmidt, M., Morlang, F., & Fürstenau, N. (2010). High-fidelity human-in-the-loop simulations as one step towards remote control of regional airports: a preliminary study. In Proceedings of the of 11th IFAC Symp. Analysis, Design, and Evaluation of Human-Machine Systems. Valenciennes. Papenfuss, A., Möhlenbrink, C., Friedrich, M., Schmidt, M., Morlang, F., & Fürstenau, N. (2010). High-fidelity human-in-the-loop simulations as one step towards remote control of regional airports: a preliminary study. In Proceedings of the of 11th IFAC Symp. Analysis, Design, and Evaluation of Human-Machine Systems. Valenciennes.
go back to reference Peterson, S., & Pinska, E. (2006). Human performance with simulated collimation in transparent projection screens. In Proceedings of the 2nd International Conference Research in Air Transportation (pp. 231–237). Belgrade: Eurocontrol. Peterson, S., & Pinska, E. (2006). Human performance with simulated collimation in transparent projection screens. In Proceedings of the 2nd International Conference Research in Air Transportation (pp. 231–237). Belgrade: Eurocontrol.
go back to reference Pinska, E. (2006). An investigation of the head-up time at tower and ground control positions. In Proceedings of the 5th Eurocontrol Innovative Research Workshop (pp. 81–86). Bretigny: Eurocontrol. Pinska, E. (2006). An investigation of the head-up time at tower and ground control positions. In Proceedings of the 5th Eurocontrol Innovative Research Workshop (pp. 81–86). Bretigny: Eurocontrol.
go back to reference Schmidt, M., Rudolph, M., Papenfuss, A., Friedrich, M., Möhlenbrink, C., Kaltenhäuser, S., & Fürstenau, N. (2009). Remote airport traffic control center with augmented vision videopanorama. In Proceedings of the 28th IEEE-DASC (pp. 4.E.2–1–4.E.2–15). Orlando: IEEE. Schmidt, M., Rudolph, M., Papenfuss, A., Friedrich, M., Möhlenbrink, C., Kaltenhäuser, S., & Fürstenau, N. (2009). Remote airport traffic control center with augmented vision videopanorama. In Proceedings of the 28th IEEE-DASC (pp. 4.E.2–1–4.E.2–15). Orlando: IEEE.
go back to reference Schmidt, M., Rudolph, M., Werther, B., & Fürstenau, N. (2006). Remote airport tower operation with augmented vision videopanorama HMI. In Proceedings of the 2nd International Conference on Research in Air Transportation (ICRAT II) (pp. 221–230). Belgrade: Eurocontrol. Schmidt, M., Rudolph, M., Werther, B., & Fürstenau, N. (2006). Remote airport tower operation with augmented vision videopanorama HMI. In Proceedings of the 2nd International Conference on Research in Air Transportation (ICRAT II) (pp. 221–230). Belgrade: Eurocontrol.
go back to reference Schmidt, M., Rudolph, M., Werther, B., Möhlenbrink, C., & Fürstenau, N. (2007). Development of an augmented vision video panorama human-machine interface for remote airport tower operation. In M. J. Smith, & G. Salvendy (Eds.). Lecture Notes Computer Science: Human Interface II (Vol. 4558, pp. 1119–1128). Berlin, Heidelberg: Springer Verlag. Schmidt, M., Rudolph, M., Werther, B., Möhlenbrink, C., & Fürstenau, N. (2007). Development of an augmented vision video panorama human-machine interface for remote airport tower operation. In M. J. Smith, & G. Salvendy (Eds.). Lecture Notes Computer Science: Human Interface II (Vol. 4558, pp. 1119–1128). Berlin, Heidelberg: Springer Verlag.
go back to reference Tavanti, M. (2006). Control Tower Operations: A Literature Review of Task Analysis Studies. Eurocontrol Experimental Center EEC Note 05. Tavanti, M. (2006). Control Tower Operations: A Literature Review of Task Analysis Studies. Eurocontrol Experimental Center EEC Note 05.
go back to reference Tavanti, M. (2007). Augmented reality for tower: using scenarios for describing tower activities. In Proceedings of the 28th Digital Avionics Systems Conference (DASC'07) (pp. 5.A.4–1–5.A.4–12). Dallas/Texas: IEEE. Tavanti, M. (2007). Augmented reality for tower: using scenarios for describing tower activities. In Proceedings of the 28th Digital Avionics Systems Conference (DASC'07) (pp. 5.A.4–1–5.A.4–12). Dallas/Texas: IEEE.
go back to reference Vogel, B. (2009). ANSP's explore control from afar. Janes Airport Review, pp. 16–17. Vogel, B. (2009). ANSP's explore control from afar. Janes Airport Review, pp. 16–17.
go back to reference Werther, B. (2006). Colored Petri net based modeling of airport control processes. In Proceedings of the Internatioanl Conference on Computer Intelligence for Modeling, Control & Automation (CIMCA). Sydney: IEEE. ISBN 0-7695-2731-0. Werther, B. (2006). Colored Petri net based modeling of airport control processes. In Proceedings of the Internatioanl Conference on Computer Intelligence for Modeling, Control & Automation (CIMCA). Sydney: IEEE. ISBN 0-7695-2731-0.
go back to reference Werther, B. (2006). Kognitive Modellierung mit farbigen Petrinetzen zur Analyse menschlichen Verhaltens. Ph.D. Dissertation, German Aerospace Center (DLR). Werther, B. (2006). Kognitive Modellierung mit farbigen Petrinetzen zur Analyse menschlichen Verhaltens. Ph.D. Dissertation, German Aerospace Center (DLR).
go back to reference Werther, B., & Schnieder, E. (2005). Formal Cognitive Ressource Model: Modeling of Human Behavior in Complex Work Environments. In Proceedings of the International Conference Computational Intelligence for Modelling, Control & Automation (CIMCA), (pp. 606–611). Wien. Werther, B., & Schnieder, E. (2005). Formal Cognitive Ressource Model: Modeling of Human Behavior in Complex Work Environments. In Proceedings of the International Conference Computational Intelligence for Modelling, Control & Automation (CIMCA), (pp. 606–611). Wien.
go back to reference Werther, B., & Uhlmann, H. (2005). Ansatz zur modellbasierten Entwicklung eines Lotsenarbeitsplatzes. Fortschrittberichte VDI, Zustandserkennung und Systemgestaltung (Vol. 22, pp. 291–294). Werther, B., & Uhlmann, H. (2005). Ansatz zur modellbasierten Entwicklung eines Lotsenarbeitsplatzes. Fortschrittberichte VDI, Zustandserkennung und Systemgestaltung (Vol. 22, pp. 291–294).
go back to reference Werther, B., Möhlenbrink, C., & Rudolph, M. (2007). Formal Petri-Net based Airport Control Model for simulation and analysis of airport control processes. In Proceedings of the Conference Human Computer Interact. (HCII 2007). Publ. in: Lecture Notes in Computer Science (vol. 4558). Beijing: Springer. Werther, B., Möhlenbrink, C., & Rudolph, M. (2007). Formal Petri-Net based Airport Control Model for simulation and analysis of airport control processes. In Proceedings of the Conference Human Computer Interact. (HCII 2007). Publ. in: Lecture Notes in Computer Science (vol. 4558). Beijing: Springer.
Metadata
Title
Remote Tower Experimental System with Augmented Vision Videopanorama
Authors
Norbert Fürstenau
Markus Schmidt
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-030-93650-1_6

Premium Partner