Skip to main content
Top

2016 | OriginalPaper | Chapter

Real-Time Automated Aerial Refueling Using Stereo Vision

Authors : Christopher Parsons, Scott Nykl

Published in: Advances in Visual Computing

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Aerial Refueling (AAR) of Unammed Aerial Vehicles (UAVs) is vital to the United States Air Force’s (USAF) continued air superiority. Inspired by the stereo vision system organic to the new KC-46A Pegasus tanker, we present a novel solution for computing a real time relative navigation (rel-nav) vector between a refueling UAV and a KC-46. Our approach relies on a real time 3D virtual simulation environment that models a realistic refueling scenario. Within this virtual scenario, a stereo camera system mounted beneath the KC-46 consumes synthetic imagery of a receiver conducting an aerial refueling approach. This synthetic imagery is processed by computer vision algorithms that calculate the sensed rel-nav position and orientation. The sensed solution is compared against the virtual environment’s truth data to quantify error and evaluate the stereo vision performance in a deterministic, real time manner. Our approach yields sub-meter precision at approximately 30 Hz.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Kelsey, J., Byrne, J., Cosgrove, M., Seereeram, S., Mehra, R.: Vision-based relative pose estimation for autonomous rendezvous and docking. In: 2006 IEEE Aerospace Conference (2006) Kelsey, J., Byrne, J., Cosgrove, M., Seereeram, S., Mehra, R.: Vision-based relative pose estimation for autonomous rendezvous and docking. In: 2006 IEEE Aerospace Conference (2006)
2.
go back to reference Campa, G., Fravolini, M.L., Ficola, A.: Autonomous aerial refueling for UAVs using a combined GPS-machine vision guidance. In: Aerospace, 5350 (2004) Campa, G., Fravolini, M.L., Ficola, A.: Autonomous aerial refueling for UAVs using a combined GPS-machine vision guidance. In: Aerospace, 5350 (2004)
3.
go back to reference Valasek, J., Gunnam, K., Kimmett, J., Tandale, M.D., Junkins, J.L., Hughes, D.: Vision-based sensor and navigation system for autonomous air refueling. J. Guidance Control Dyn. 28, 979–989 (2005)CrossRef Valasek, J., Gunnam, K., Kimmett, J., Tandale, M.D., Junkins, J.L., Hughes, D.: Vision-based sensor and navigation system for autonomous air refueling. J. Guidance Control Dyn. 28, 979–989 (2005)CrossRef
4.
go back to reference Mammarella, M., Campa, G., Napolitano, M.R., Fravolini, M.L., Gu, Y., Perhinschi, M.G.: Machine vision/GPS integration using EKF for the UAV aerial refueling problem. IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 38, 791–801 (2008)CrossRef Mammarella, M., Campa, G., Napolitano, M.R., Fravolini, M.L., Gu, Y., Perhinschi, M.G.: Machine vision/GPS integration using EKF for the UAV aerial refueling problem. IEEE Trans. Syst. Man Cybern. Part C: Appl. Rev. 38, 791–801 (2008)CrossRef
5.
go back to reference Mammarella, M., Campa, G., Napolitano, M.R., Fravolini, M.L.: Comparison of point matching algorithms for the UAV aerial refueling problem. Mach. Vis. Appl. 21, 241–251 (2010)CrossRef Mammarella, M., Campa, G., Napolitano, M.R., Fravolini, M.L.: Comparison of point matching algorithms for the UAV aerial refueling problem. Mach. Vis. Appl. 21, 241–251 (2010)CrossRef
6.
go back to reference Ross, S.M., Menza, M.D., Waddell Jr, E.T., Mainstone, A.P., Velez, J.: Demonstration of a control algorithm for autonomous aerial refueling (Project “No Gyro”). Technical report, Air Force Flight Test Center (2005) Ross, S.M., Menza, M.D., Waddell Jr, E.T., Mainstone, A.P., Velez, J.: Demonstration of a control algorithm for autonomous aerial refueling (Project “No Gyro”). Technical report, Air Force Flight Test Center (2005)
7.
go back to reference Curro, J.: Automated aerial refueling position estimation using a scanning LiDAR. Master’s thesis, Air Force Institute of Technology, Wright-Patterson Air Force Base, OH, USA (2012) Curro, J.: Automated aerial refueling position estimation using a scanning LiDAR. Master’s thesis, Air Force Institute of Technology, Wright-Patterson Air Force Base, OH, USA (2012)
8.
go back to reference Werner, K.P.: Precision relative positioning for automated aerial refueling from a stereo imaging system. Master’s thesis, Air Force Institute of Technology, Wright-Patterson Air Force Base, OH, USA (2015) Werner, K.P.: Precision relative positioning for automated aerial refueling from a stereo imaging system. Master’s thesis, Air Force Institute of Technology, Wright-Patterson Air Force Base, OH, USA (2015)
9.
go back to reference Curro, K.W.: Toward automated aerial refueling: relative navigation with structure from motion. Master’s thesis, Air Force Institute of Technology, Wright-Patterson Air Force Base, OH, USA (2016) Curro, K.W.: Toward automated aerial refueling: relative navigation with structure from motion. Master’s thesis, Air Force Institute of Technology, Wright-Patterson Air Force Base, OH, USA (2016)
10.
go back to reference Denby, B.D.: Toward automated aerial refueling: real time position estimation with stereo vision. Master’s thesis, Air Force Institute of Technology, Wright-Patterson Air Force Base, OH, USA (2016) Denby, B.D.: Toward automated aerial refueling: real time position estimation with stereo vision. Master’s thesis, Air Force Institute of Technology, Wright-Patterson Air Force Base, OH, USA (2016)
11.
go back to reference Nguyen, B.T., Lin, L.T.: The use of flight simulation and flight testing in the automated aerial refueling program. In: Aerospace, pp. 1–6 (2005) Nguyen, B.T., Lin, L.T.: The use of flight simulation and flight testing in the automated aerial refueling program. In: Aerospace, pp. 1–6 (2005)
12.
go back to reference Pollini, L., Campa, G., Giulietti, F., Innocenti, M.: Virtual simulation set-up for UAVs aerial refuelling. In: AIAA Guidance, Navigation and Control Conference and Exhibit, pp. 1–8 (2003) Pollini, L., Campa, G., Giulietti, F., Innocenti, M.: Virtual simulation set-up for UAVs aerial refuelling. In: AIAA Guidance, Navigation and Control Conference and Exhibit, pp. 1–8 (2003)
13.
go back to reference Burns, R.S., Clark, C.S., Ewart, R.: The automated aerial refueling simulation at the AVTAS laboratory. In: AIAA Modeling and Simulation Technologies Conference and Exhibit, pp. 1–12 (2005) Burns, R.S., Clark, C.S., Ewart, R.: The automated aerial refueling simulation at the AVTAS laboratory. In: AIAA Modeling and Simulation Technologies Conference and Exhibit, pp. 1–12 (2005)
14.
go back to reference Fravolini, M., Mammarella, M.: Machine vision algorithms for autonomous aerial refueling for UAVs using the USAF refueling boom method. In: Finn, A., Jain, L.C. (eds.) Innovations in Defence. SCI, vol. 304, pp. 95–138. Springer, Heidelberg (2010). doi:10.1007/978-3-642-14084-6_5 Fravolini, M., Mammarella, M.: Machine vision algorithms for autonomous aerial refueling for UAVs using the USAF refueling boom method. In: Finn, A., Jain, L.C. (eds.) Innovations in Defence. SCI, vol. 304, pp. 95–138. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-14084-6_​5
15.
go back to reference Mammarella, M., Campa, G., Napolitano, M.R., Seanor, B.: GPS/MV based aerial refueling for UAVs. In: AIAA Guidance, Navigation and Control Conference and Exhibit, pp. 1–16 (2008) Mammarella, M., Campa, G., Napolitano, M.R., Seanor, B.: GPS/MV based aerial refueling for UAVs. In: AIAA Guidance, Navigation and Control Conference and Exhibit, pp. 1–16 (2008)
16.
go back to reference Riley, D.: Automated aerial refueling (AAR) phase II integrator. Air Force Research Laboratory (2013) Riley, D.: Automated aerial refueling (AAR) phase II integrator. Air Force Research Laboratory (2013)
17.
go back to reference Nykl, S., Mourning, C., Leitch, M., Chelberg, D., Franklin, T., Liu, C.: An overview of the STEAMiE educational game engine. In: 38th Annual Frontiers in Education Conference, FIE 2008, pp. F3B:21–F3B:25 (2008) Nykl, S., Mourning, C., Leitch, M., Chelberg, D., Franklin, T., Liu, C.: An overview of the STEAMiE educational game engine. In: 38th Annual Frontiers in Education Conference, FIE 2008, pp. F3B:21–F3B:25 (2008)
18.
go back to reference Nykl, S., Mourning, C., Ghandi, N., Chelberg, D.: A flight tested wake turbulence aware altimeter. In: Bebis, G., et al. (eds.) ISVC 2011. LNCS, vol. 6939, pp. 219–228. Springer, Heidelberg (2011). doi:10.1007/978-3-642-24031-7_22 CrossRef Nykl, S., Mourning, C., Ghandi, N., Chelberg, D.: A flight tested wake turbulence aware altimeter. In: Bebis, G., et al. (eds.) ISVC 2011. LNCS, vol. 6939, pp. 219–228. Springer, Heidelberg (2011). doi:10.​1007/​978-3-642-24031-7_​22 CrossRef
Metadata
Title
Real-Time Automated Aerial Refueling Using Stereo Vision
Authors
Christopher Parsons
Scott Nykl
Copyright Year
2016
DOI
https://doi.org/10.1007/978-3-319-50832-0_59

Premium Partner