Skip to main content
Top

2014 | OriginalPaper | Chapter

Large Scale Monocular Vision-Only Mapping from a Fixed-Wing sUAS

Authors : Michael Warren, David McKinnon, Hu He, Arren Glover, Michael Shiel, Ben Upcroft

Published in: Field and Service Robotics

Publisher: Springer Berlin Heidelberg

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This paper presents the application of a monocular visual SLAM on a fixed-wing small Unmanned Aerial System (sUAS) capable of simultaneous estimation of aircraft pose and scene structure. We demonstrate the robustness of unconstrained vision alone in producing reliable pose estimates of a sUAS, at altitude. It is ultimately capable of online state estimation feedback for aircraft control and next-best-view estimation for complete map coverage without the use of additional sensors. We explore some of the challenges of visual SLAM from a sUAS including dealing with planar structure, distant scenes and noisy observations. The developed techniques are applied on vision data gathered from a fast-moving fixed-wing radio control aircraft flown over a \(1\times 1\) km rural area at an altitude of 20–100 m. We present both raw Structure from Motion results and a SLAM solution that includes FAB-MAP based loop-closures and graph-optimised pose. Timing information is also presented to demonstrate near online capabilities. We compare the accuracy of the 6-DOF pose estimates to an off-the-shelf GPS aided INS over a 1.7 km trajectory. We also present output 3D reconstructions of the observed scene structure and texture that demonstrates future applications in autonomous monitoring and surveying.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference M. Agrawal, K. Konolige, M. Blas, Censure: center surround extremas for realtime feature detection and matching, in International Conference on Computer Vision, The Proceedings of the, pp. 102–115 (2008) M. Agrawal, K. Konolige, M. Blas, Censure: center surround extremas for realtime feature detection and matching, in International Conference on Computer Vision, The Proceedings of the, pp. 102–115 (2008)
2.
go back to reference M. Blosch, S. Weiss, D. Scaramuzza, R. Siegwart, Vision based MAV navigation in unknown and unstructured environments, in Robotics and Automation (ICRA), 2010 IEEE International Conference on, pp. 21–28. IEEE (2010) M. Blosch, S. Weiss, D. Scaramuzza, R. Siegwart, Vision based MAV navigation in unknown and unstructured environments, in Robotics and Automation (ICRA), 2010 IEEE International Conference on, pp. 21–28. IEEE (2010)
3.
go back to reference M. Bryson, M. Johnson-Roberson, S. Sukkarieh, Airborne smoothing and mapping using vision and inertial sensors, in 2009 IEEE International Conference on Robotics and Automation, pp. 3143–3148. IEEE (2009) M. Bryson, M. Johnson-Roberson, S. Sukkarieh, Airborne smoothing and mapping using vision and inertial sensors, in 2009 IEEE International Conference on Robotics and Automation, pp. 3143–3148. IEEE (2009)
4.
go back to reference A. Cherian, J. Andersh, V. Morellas, N. Papanikolopoulos, B. Mettler, Autonomous altitude estimation of a UAV using a single onboard camera, in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3900–3905 (2009) A. Cherian, J. Andersh, V. Morellas, N. Papanikolopoulos, B. Mettler, Autonomous altitude estimation of a UAV using a single onboard camera, in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3900–3905 (2009)
5.
go back to reference R. Clark, M. Lin, C. Taylor, 3D environment capture from monocular video and inertial data, in SPIE on Three-Dimensional Image Capture and Applications (2006) R. Clark, M. Lin, C. Taylor, 3D environment capture from monocular video and inertial data, in SPIE on Three-Dimensional Image Capture and Applications (2006)
6.
go back to reference M. Cummins, P. Newman, FAB-MAP: probabilistic localization and mapping in the space of appearance. Int. J. Rob. Res. 27(6), 647–665 (2008)CrossRef M. Cummins, P. Newman, FAB-MAP: probabilistic localization and mapping in the space of appearance. Int. J. Rob. Res. 27(6), 647–665 (2008)CrossRef
7.
go back to reference D. Eynard, P. Vasseur, C. Demonceaux, V. Frémont, UAV altitude estimation by mixed stereoscopic vision, in Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ International Conference on, Iros, pp. 646–651. IEEE (2010) D. Eynard, P. Vasseur, C. Demonceaux, V. Frémont, UAV altitude estimation by mixed stereoscopic vision, in Intelligent Robots and Systems (IROS), 2010 IEEE/RSJ International Conference on, Iros, pp. 646–651. IEEE (2010)
8.
go back to reference A.J. Glover, W.P. Maddern, M.J. Milford, G.F. Wyeth, FAB-MAP + RatSLAM: appearance-based SLAM for multiple times of day, in The IEEE International Conference on Robotics and Automation, May 2010, pp. 3507–3512. IEEE, Alaska, USA (2010) A.J. Glover, W.P. Maddern, M.J. Milford, G.F. Wyeth, FAB-MAP + RatSLAM: appearance-based SLAM for multiple times of day, in The IEEE International Conference on Robotics and Automation, May 2010, pp. 3507–3512. IEEE, Alaska, USA (2010)
9.
go back to reference G. Grisetti, R. Kuemmerle, C. Stachniss, U. Frese, C. Hertzberg, Hierarchical optimization on manifolds for online 2d and 3d mapping, in Robotics and Automation (ICRA), 2010 IEEE International Conference on. IEEE, Anchorage, USA (2010) G. Grisetti, R. Kuemmerle, C. Stachniss, U. Frese, C. Hertzberg, Hierarchical optimization on manifolds for online 2d and 3d mapping, in Robotics and Automation (ICRA), 2010 IEEE International Conference on. IEEE, Anchorage, USA (2010)
10.
go back to reference B. Haralick, C. Lee, K. Ottenberg, M. Nölle, Review and analysis of solutions of the three point perspective pose estimation problem. Int. J. Comput. Vis. 13(3), 331–356 (1994)CrossRef B. Haralick, C. Lee, K. Ottenberg, M. Nölle, Review and analysis of solutions of the three point perspective pose estimation problem. Int. J. Comput. Vis. 13(3), 331–356 (1994)CrossRef
11.
go back to reference V. Hiep, R. Keriven, P. Labatut, J.P. Pons, Towards high-resolution large-scale multi-view stereo, in Conference on Computer Vision and Pattern Recognition (CVPR), Miami, USA (2009) V. Hiep, R. Keriven, P. Labatut, J.P. Pons, Towards high-resolution large-scale multi-view stereo, in Conference on Computer Vision and Pattern Recognition (CVPR), Miami, USA (2009)
12.
go back to reference H. Hoppe, Poisson surface reconstruction and its applications, in Proceedings of the 2008 ACM Symposium on Solid and Physical Modeling—SPM ’08, p. 10 (2008) H. Hoppe, Poisson surface reconstruction and its applications, in Proceedings of the 2008 ACM Symposium on Solid and Physical Modeling—SPM ’08, p. 10 (2008)
13.
go back to reference B.K.P. Horn, Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. A 4(4), 629 (1987)CrossRefMathSciNet B.K.P. Horn, Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. A 4(4), 629 (1987)CrossRefMathSciNet
14.
go back to reference T. Kanade, O. Amidi, Q. Ke, Real-time and 3D vision for autonomous small and micro air vehicles, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601), vol. 2, pp. 1655–1662 (2004) T. Kanade, O. Amidi, Q. Ke, Real-time and 3D vision for autonomous small and micro air vehicles, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601), vol. 2, pp. 1655–1662 (2004)
15.
go back to reference A. Kassir, T. Peynot, Reliable automatic camera-laser calibration, in Australasian Conference on Robotics and Automation, Brisbane, Australia (2010) A. Kassir, T. Peynot, Reliable automatic camera-laser calibration, in Australasian Conference on Robotics and Automation, Brisbane, Australia (2010)
16.
go back to reference J. Kim, S. Sukkarieh, Autonomous airborne navigation in unknown terrain environments. IEEE Trans. Aerosp. Electron. Syst. 40(3), 1031–1045 (2004)CrossRef J. Kim, S. Sukkarieh, Autonomous airborne navigation in unknown terrain environments. IEEE Trans. Aerosp. Electron. Syst. 40(3), 1031–1045 (2004)CrossRef
17.
go back to reference K. Konolige, M. Agrawal, Frameslam: from bundle adjustment to real-time visual mapping. IEEE Trans. Rob. 24(5), 1066–1077 (2008)CrossRef K. Konolige, M. Agrawal, Frameslam: from bundle adjustment to real-time visual mapping. IEEE Trans. Rob. 24(5), 1066–1077 (2008)CrossRef
18.
go back to reference D. Lowe, Object recognition from local scale-invariant features, in International Conference on Computer Vision, The Proceedings of the, vol. 2, pp. 1150–1157 (1999) D. Lowe, Object recognition from local scale-invariant features, in International Conference on Computer Vision, The Proceedings of the, vol. 2, pp. 1150–1157 (1999)
19.
go back to reference D. McKinnon, H. He, B. Upcroft, R.N. Smith, Towards automated and in-situ, near-real time 3-D reconstruction of coral reef environments, in Oceans, September 2011 D. McKinnon, H. He, B. Upcroft, R.N. Smith, Towards automated and in-situ, near-real time 3-D reconstruction of coral reef environments, in Oceans, September 2011
20.
go back to reference C. Mei, G. Sibley, P. Newman, A constant-time efficient stereo SLAM system, in Systems Engineering, pp. 1–11 (2009) C. Mei, G. Sibley, P. Newman, A constant-time efficient stereo SLAM system, in Systems Engineering, pp. 1–11 (2009)
21.
go back to reference D. Nistér, An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intell. 26, 756–777 (2004) D. Nistér, An efficient solution to the five-point relative pose problem. IEEE Trans. Pattern Anal. Mach. Intell. 26, 756–777 (2004)
22.
go back to reference D. Nistér, O. Naroditsky, J. Bergen, Visual odometry for ground vehicle applications. J. Field Rob. 23(1), 3–20 (2006)CrossRefMATH D. Nistér, O. Naroditsky, J. Bergen, Visual odometry for ground vehicle applications. J. Field Rob. 23(1), 3–20 (2006)CrossRefMATH
23.
go back to reference M. Pollefeys, D. Nistér, J.M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S.J. Kim, P. Merrell, C. Salmi, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewénius, R. Yang, G. Welch, H. Towles, Detailed real-time urban 3D reconstruction from video. Int. J. Comput. Vis. 78(2–3), 143–167 (2007) M. Pollefeys, D. Nistér, J.M. Frahm, A. Akbarzadeh, P. Mordohai, B. Clipp, C. Engels, D. Gallup, S.J. Kim, P. Merrell, C. Salmi, S. Sinha, B. Talton, L. Wang, Q. Yang, H. Stewénius, R. Yang, G. Welch, H. Towles, Detailed real-time urban 3D reconstruction from video. Int. J. Comput. Vis. 78(2–3), 143–167 (2007)
24.
go back to reference H. Strasdat, J. Montiel, A. Davison, Scale drift-aware large scale monocular SLAM, in Proceedings of Robotics: Science and Systems (RSS). Citeseer, Zaragoza, Spain (2010) H. Strasdat, J. Montiel, A. Davison, Scale drift-aware large scale monocular SLAM, in Proceedings of Robotics: Science and Systems (RSS). Citeseer, Zaragoza, Spain (2010)
25.
go back to reference E. Tola, C. Strecha, P. Fua, Efficient large-scale multi-view stereo for ultra high-resolution image sets. Mach. Vis. Appl. 23(5), 903–920 (2011) E. Tola, C. Strecha, P. Fua, Efficient large-scale multi-view stereo for ultra high-resolution image sets. Mach. Vis. Appl. 23(5), 903–920 (2011)
26.
go back to reference P. Torr, A. Fitzgibbon, A. Zisserman, The problem of degeneracy in structure and motion recovery from uncalibrated image sequences. Int. J. Comput. Vis. 32(1), 27–44 (1999)CrossRef P. Torr, A. Fitzgibbon, A. Zisserman, The problem of degeneracy in structure and motion recovery from uncalibrated image sequences. Int. J. Comput. Vis. 32(1), 27–44 (1999)CrossRef
27.
go back to reference J. Volpe, Vulnerability assessment of the transportation infrastructure relying on the global positioning system, Transportation (2001) J. Volpe, Vulnerability assessment of the transportation infrastructure relying on the global positioning system, Transportation (2001)
28.
go back to reference M. Warren, D. McKinnon, H. He, B. Upcroft, Unaided stereo vision based pose estimation, in Australasian Conference on Robotics and Automation, December 2010, Brisbane, Australia (2010) M. Warren, D. McKinnon, H. He, B. Upcroft, Unaided stereo vision based pose estimation, in Australasian Conference on Robotics and Automation, December 2010, Brisbane, Australia (2010)
Metadata
Title
Large Scale Monocular Vision-Only Mapping from a Fixed-Wing sUAS
Authors
Michael Warren
David McKinnon
Hu He
Arren Glover
Michael Shiel
Ben Upcroft
Copyright Year
2014
Publisher
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-40686-7_33