Skip to main content
Top

2022 | OriginalPaper | Chapter

Integration of (Surveillance) Multilateration Sensor Data into a Remote Tower System

Authors : Satoru Inoue, Mark Brown, Yasuyuki Kakubari

Published in: Virtual and Remote Control Tower

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Information from a surveillance sensor can be integrated into a Remote Tower System. Surveillance sensors provide position and altitude information that can be used to supplement optical sensor tracking, and a cooperative surveillance sensor further provides aircraft identification that can be correlated with flight information. In the Remote Tower research system developed by the Electronic Navigation Research Institute (ENRI), integration with a multilateral sensor allows integrated flight information to be displayed in a label (tag) associated with each aircraft, and surveillance position is combined with optical sensor information to assist automatic object-following by a PTZ camera function, which improves its performance particularly in low visibility conditions. To integrate surveillance information with optical target tracking accurately, calibration or correction techniques such as georeferencing (3D-2D mapping) are required. This chapter gives details on the following specific topics: (1) correlation of optically detected and tracked objects with surveillance sensor targets and labelling, (2) PTZ object following, and (3) mapping between two-dimensional screen coordinates and real-world three-dimensional PTZ coordinates.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Fürstenau, N., & Schmidt, M. (2016). Remote tower experimental system with augmented vision videopanorama. In N. Fürstenau (Ed.), Virtual and remote control tower, research topics in aerospace (pp. 163–192). Springer International Publishing. Fürstenau, N., & Schmidt, M. (2016). Remote tower experimental system with augmented vision videopanorama. In N. Fürstenau (Ed.), Virtual and remote control tower, research topics in aerospace (pp. 163–192). Springer International Publishing.
go back to reference Girshick, R. (2015). Fast R-CNN. In IEEE International Conference on Computer Vision (ICCV) (pp. 1440–1448). Girshick, R. (2015). Fast R-CNN. In IEEE International Conference on Computer Vision (ICCV) (pp. 1440–1448).
go back to reference Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014). Rich feature hierarchies for accurate object detection and semantic segmentation. IEEE Conference on Computer Vision and Pattern Recognition. Girshick, R., Donahue, J., Darrell, T., & Malik, J. (2014). Rich feature hierarchies for accurate object detection and semantic segmentation. IEEE Conference on Computer Vision and Pattern Recognition.
go back to reference Kakubari, Y., Koga, T., & Miyazaki, H., et al. (2014). Enhancement of passive surveillance system for airport surface movement. Electronics and Communications in Japan, 97(3), 24–30. Kakubari, Y., Koga, T., & Miyazaki, H., et al. (2014). Enhancement of passive surveillance system for airport surface movement. Electronics and Communications in Japan, 97(3), 24–30.
go back to reference Kang, Z., Bass, E. J., & Lee, D. W. (2014). Air traffic controllers’ visual scanning, aircraft selection, and comparison strategies in support of conflict detection. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58(1), 77–81.CrossRef Kang, Z., Bass, E. J., & Lee, D. W. (2014). Air traffic controllers’ visual scanning, aircraft selection, and comparison strategies in support of conflict detection. In Proceedings of the Human Factors and Ergonomics Society Annual Meeting, 58(1), 77–81.CrossRef
go back to reference Kirkpatrick, S., Gelatt. C. D. Jr., & Vecchi, M. P. (1983). Optimization by simulated annealing. Science, 220(4598), 671–680. Kirkpatrick, S., Gelatt. C. D. Jr., & Vecchi, M. P. (1983). Optimization by simulated annealing. Science, 220(4598), 671–680.
go back to reference Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems (Vol. 1, pp. 1097–1105). Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. In Proceedings of the 25th International Conference on Neural Information Processing Systems (Vol. 1, pp. 1097–1105).
go back to reference Lu, X., Izumi, T., Teng, L., & Horie, T. (2012). A novel background subtraction method for moving vehicle detection. IEEJ Transactions on Fundamentals and Materials, 132(10), 857–863.CrossRef Lu, X., Izumi, T., Teng, L., & Horie, T. (2012). A novel background subtraction method for moving vehicle detection. IEEJ Transactions on Fundamentals and Materials, 132(10), 857–863.CrossRef
go back to reference Mandellos, N. A., Keramitsoglou, I., & Kiranoudis, C. T. (2011). A background subtraction XE “background subtraction” algorithm for detecting and tracking vehicles. Expert Systems with Applications, 38, 1619–1631.CrossRef Mandellos, N. A., Keramitsoglou, I., & Kiranoudis, C. T. (2011). A background subtraction XE “background subtraction” algorithm for detecting and tracking vehicles. Expert Systems with Applications, 38, 1619–1631.CrossRef
go back to reference Matsuyama, T., Wada, T., Habe, H., & Tanahashi, K. (2006). Background subtraction XE “Background subtraction” under varying illumination. Systems and Computers in Japan, 37(4), 77–88.CrossRef Matsuyama, T., Wada, T., Habe, H., & Tanahashi, K. (2006). Background subtraction XE “Background subtraction” under varying illumination. Systems and Computers in Japan, 37(4), 77–88.CrossRef
go back to reference Okada, R., Shirai, Y., & Miura, J. (1996). Object tracking based on optical flow and depth. In IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems. Okada, R., Shirai, Y., & Miura, J. (1996). Object tracking based on optical flow and depth. In IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems.
go back to reference Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp.779–788). Redmon, J., Divvala, S., Girshick, R., & Farhadi, A. (2016). You only look once: Unified, real-time object detection. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (pp.779–788).
go back to reference Remotely Operated Aerodrome Flight Information Service. (2012). AN-Conf/12-WP/130 23/10/12. In ICAO Working Paper, TWELFTH AIR NAVIGATION CONFERENCE Montréal. Remotely Operated Aerodrome Flight Information Service. (2012). AN-Conf/12-WP/130 23/10/12. In ICAO Working Paper, TWELFTH AIR NAVIGATION CONFERENCE Montréal.
go back to reference Ren, S., He, K., Girshick, R., & Sun, J. (2017). Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1137–1149. Ren, S., He, K., Girshick, R., & Sun, J. (2017). Faster R-CNN: Towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1137–1149.
go back to reference Schmidt, M., Rudolph, M., & Fürstenau, N. (2016). Remote tower prototype system and automation perspectives. In N. Fürstenau (Ed.), Virtual and remote control tower, research topics in aerospace (pp. 193–220). Springer International Publishing. Schmidt, M., Rudolph, M., & Fürstenau, N. (2016). Remote tower prototype system and automation perspectives. In N. Fürstenau (Ed.), Virtual and remote control tower, research topics in aerospace (pp. 193–220). Springer International Publishing.
go back to reference Scott, J., Pusateri, M. A., & Cornish, D. (2009). Kalman filter based video background estimation. In Applied Imagery Pattern Recognition Workshop (AIPRW). IEEE. Scott, J., Pusateri, M. A., & Cornish, D. (2009). Kalman filter based video background estimation. In Applied Imagery Pattern Recognition Workshop (AIPRW). IEEE.
go back to reference Shrivakshan, G. T., & Chandrasekar, C. (2012). A Comparison of various edge detection techniques used in image processing. International Journal of Computer Science Issues, 9(5), 269–276. Shrivakshan, G. T., & Chandrasekar, C. (2012). A Comparison of various edge detection techniques used in image processing. International Journal of Computer Science Issues, 9(5), 269–276.
go back to reference Smith, W. E., Vakil, N., & Maislin, S. A. (1992). Correction of distortion in endoscope images. IEEE Transactions on Medical Imaging, 11, 117–122.CrossRef Smith, W. E., Vakil, N., & Maislin, S. A. (1992). Correction of distortion in endoscope images. IEEE Transactions on Medical Imaging, 11, 117–122.CrossRef
go back to reference Szeliski, R. (1996). Video mosaics for virtual environments. IEEE Computer Graphics and Application, 16(2), 22–30.CrossRef Szeliski, R. (1996). Video mosaics for virtual environments. IEEE Computer Graphics and Application, 16(2), 22–30.CrossRef
go back to reference Van der Jeught, S., Buytaert, J., & Dirckx, J. J. J. (2012). Real-time geometric lens distortion correction using a graphics processing unit. Optical Engineering, 51(2), 027002. Van der Jeught, S., Buytaert, J., & Dirckx, J. J. J. (2012). Real-time geometric lens distortion correction using a graphics processing unit. Optical Engineering, 51(2), 027002.
go back to reference van Schaik, F. J., Roessingh, J. J. M., Bengtsson, J., Lindqvist, G., & Fält, K. (2016). The advanced remote tower system and its validation. In N. Fürstenau (Ed.), Virtual and remote control tower, research topics in aerospace (pp. 263–278). Springer International Publishing. van Schaik, F. J., Roessingh, J. J. M., Bengtsson, J., Lindqvist, G., & Fält, K. (2016). The advanced remote tower system and its validation. In N. Fürstenau (Ed.), Virtual and remote control tower, research topics in aerospace (pp. 263–278). Springer International Publishing.
Metadata
Title
Integration of (Surveillance) Multilateration Sensor Data into a Remote Tower System
Authors
Satoru Inoue
Mark Brown
Yasuyuki Kakubari
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-030-93650-1_8

Premium Partner