Skip to main content

2016 | OriginalPaper | Buchkapitel

10. Autonomous Flight with Onboard Stereo Vision

verfasst von : G. C. H. E. de Croon, M. Perçin, B. D. W. Remes , R. Ruijsink, C. De Wagter

Erschienen in: The DelFly

Verlag: Springer Netherlands

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We shift our focus to the use of stereo vision for autonomous flight. Stereo vision implies carrying two cameras on board, which adds weight and increases the power consumption. Still, it also allows for instantaneous distance estimates, which is a considerable advantage on a moving (and oscillating) flapping wing MAV. In particular, we explain the onboard stereo vision and control algorithms that allow the 20-g DelFly Explorer to autonomously fly around in unknown environments for as long as its battery lasts.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat M.F. Land, D.-E. Nilsson, Animal Eyes (Oxford University Press, New York, 2002) M.F. Land, D.-E. Nilsson, Animal Eyes (Oxford University Press, New York, 2002)
2.
Zurück zum Zitat D. Floreano, R. Pericet-Camara, S. Viollet, F. Ruffier, A. Brückner, R. Leitel, W. Buss, M. Menouni, F. Expert, R. Juston, M.K. Dobrzynski, G. LEplattenier, F. Recktenwald, H.A. Mallot, N. Franceschini, Miniature curved artificial compound eyes. Proc. Natl. Acad. Sci. U.S.A, PNAS 110(23), 9267–9272 (2013) D. Floreano, R. Pericet-Camara, S. Viollet, F. Ruffier, A. Brückner, R. Leitel, W. Buss, M. Menouni, F. Expert, R. Juston, M.K. Dobrzynski, G. LEplattenier, F. Recktenwald, H.A. Mallot, N. Franceschini, Miniature curved artificial compound eyes. Proc. Natl. Acad. Sci. U.S.A, PNAS 110(23), 9267–9272 (2013)
3.
Zurück zum Zitat N. Franceschini, J.M. Pichon, C. Blanes, J.M. Brady, From insect vision to robot vision. Philos. Trans. Biol. Sci. 337(1281), 283–294 (1992)CrossRef N. Franceschini, J.M. Pichon, C. Blanes, J.M. Brady, From insect vision to robot vision. Philos. Trans. Biol. Sci. 337(1281), 283–294 (1992)CrossRef
4.
Zurück zum Zitat F. Ruffier, N.H. Franceschini, Aerial robot piloted in steep relief by optic flow sensors, in (IROS 2008) (2008), pp. 1266–1273 F. Ruffier, N.H. Franceschini, Aerial robot piloted in steep relief by optic flow sensors, in (IROS 2008) (2008), pp. 1266–1273
5.
Zurück zum Zitat G. Sabiron, P. Chavent, T. Raharijaona, P. Fabiani, F. Ruffier, Low-speed optic-flow sensor onboard an unmanned helicopter flying outside over fields, in IEEE International Conference on Robotics and Automation (2013) G. Sabiron, P. Chavent, T. Raharijaona, P. Fabiani, F. Ruffier, Low-speed optic-flow sensor onboard an unmanned helicopter flying outside over fields, in IEEE International Conference on Robotics and Automation (2013)
6.
Zurück zum Zitat F. Garcia Bermudez, R. Fearing, Optical flow on a flapping wing robot, in IROS 2009 (2009), pp. 5027–5032 F. Garcia Bermudez, R. Fearing, Optical flow on a flapping wing robot, in IROS 2009 (2009), pp. 5027–5032
7.
Zurück zum Zitat G.C.H.E. de Croon, E. de Weerdt, C. de Wagter, B.D.W. Remes, R. Ruijsink, The appearance variation cue for obstacle avoidance. IEEE Trans. Robot. 28(2), 529–534 (2012)CrossRef G.C.H.E. de Croon, E. de Weerdt, C. de Wagter, B.D.W. Remes, R. Ruijsink, The appearance variation cue for obstacle avoidance. IEEE Trans. Robot. 28(2), 529–534 (2012)CrossRef
8.
Zurück zum Zitat S. Tijmons, G.C.H.E. de Croon, B.D.W. Remes, C. De Wagter, R. Ruijsink, E-J. Van Kampen, Q. Chu, Stereo vision based obstacle avoidance on flapping wing mavs, in EuroGNC (2013) S. Tijmons, G.C.H.E. de Croon, B.D.W. Remes, C. De Wagter, R. Ruijsink, E-J. Van Kampen, Q. Chu, Stereo vision based obstacle avoidance on flapping wing mavs, in EuroGNC (2013)
9.
Zurück zum Zitat F. Bonin-Font, A. Ortiz, G. Oliver, Visual navigation for mobile robots: a survey. J. Intell. Robot. Syst. 53(3), 263–296 (2008) F. Bonin-Font, A. Ortiz, G. Oliver, Visual navigation for mobile robots: a survey. J. Intell. Robot. Syst. 53(3), 263–296 (2008)
10.
Zurück zum Zitat A. Kelly, B. Nagy, Reactive nonholonomic trajectory generation via parametric optimal control. Int. J. Robot. Res. 22(7–8), 583–601 (2003)CrossRef A. Kelly, B. Nagy, Reactive nonholonomic trajectory generation via parametric optimal control. Int. J. Robot. Res. 22(7–8), 583–601 (2003)CrossRef
11.
Zurück zum Zitat E. Papadopoulos, I. Poulakakis, I. Papadimitriou, On path planning and obstacle avoidance for nonholonomic platforms with manipulators: a polynomial approach. Int. J. Robot. Res. 21(4), 367–383 (2002)CrossRef E. Papadopoulos, I. Poulakakis, I. Papadimitriou, On path planning and obstacle avoidance for nonholonomic platforms with manipulators: a polynomial approach. Int. J. Robot. Res. 21(4), 367–383 (2002)CrossRef
12.
Zurück zum Zitat M. Hwangbo, J. Kuffner, T. Kanade, Efficient two-phase 3d motion planning for small fixed-wing UAVs, in IEEE International Conference on Robotics and Automation (ICRA) (2007), pp. 1035–1041 M. Hwangbo, J. Kuffner, T. Kanade, Efficient two-phase 3d motion planning for small fixed-wing UAVs, in IEEE International Conference on Robotics and Automation (ICRA) (2007), pp. 1035–1041
13.
Zurück zum Zitat G. Roussos, D.V. Dimarogonas, K.J. Kyriakopoulos, 3d navigation and collision avoidance for nonholonomic aircraftlike vehicles. Int. J. Adapt. Control Signal Process. 24(10), 900–920 (2010)CrossRefMATH G. Roussos, D.V. Dimarogonas, K.J. Kyriakopoulos, 3d navigation and collision avoidance for nonholonomic aircraftlike vehicles. Int. J. Adapt. Control Signal Process. 24(10), 900–920 (2010)CrossRefMATH
14.
Zurück zum Zitat S. Griffiths, J. Saunders, A. Curtis, B. Barber, T. McLain, R. Beard, Maximizing miniature aerial vehicles. IEEE Robot. Autom. Mag. 3, 34–43 (2006)CrossRef S. Griffiths, J. Saunders, A. Curtis, B. Barber, T. McLain, R. Beard, Maximizing miniature aerial vehicles. IEEE Robot. Autom. Mag. 3, 34–43 (2006)CrossRef
15.
Zurück zum Zitat S. Griffiths, J. Saunders, A. Curtis, B. Barber, T. McLain, R. Beard, Obstacle and terrain avoidance for miniature aerial vehicles, in In Advances in Unmanned Aerial Vehicles (Springer, Netherlands, 2007), pp. 213–244 S. Griffiths, J. Saunders, A. Curtis, B. Barber, T. McLain, R. Beard, Obstacle and terrain avoidance for miniature aerial vehicles, in In Advances in Unmanned Aerial Vehicles (Springer, Netherlands, 2007), pp. 213–244
16.
Zurück zum Zitat D. Jia, J. Vagners, Parallel evolutionary algorithms for uav path planning, in Proceedings of the AIAA 1st Intelligent Systems Conference (2004) D. Jia, J. Vagners, Parallel evolutionary algorithms for uav path planning, in Proceedings of the AIAA 1st Intelligent Systems Conference (2004)
17.
Zurück zum Zitat J.-C. Zufferey, A. Klaptocz, A. Beyeler, J.-D. Nicoud, D. Floreano, A 10-gram microflyer for vision-based indoor navigation, in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2006) J.-C. Zufferey, A. Klaptocz, A. Beyeler, J.-D. Nicoud, D. Floreano, A 10-gram microflyer for vision-based indoor navigation, in Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (2006)
18.
Zurück zum Zitat S. Nolfi, Power and the limits of reactive agents. Neurocomputing 42(1–4), 119–145 (2002)CrossRefMATH S. Nolfi, Power and the limits of reactive agents. Neurocomputing 42(1–4), 119–145 (2002)CrossRefMATH
19.
Zurück zum Zitat G.C.H.E. de Croon, M.A. Groen, C. De Wagter, B.D.W. Remes, R. Ruijsink, B.W. van Oudheusden, Design, aerodynamics, and autonomy of the delfly. Bioinspiration Biomimetics 7(2), 025003 (2012) G.C.H.E. de Croon, M.A. Groen, C. De Wagter, B.D.W. Remes, R. Ruijsink, B.W. van Oudheusden, Design, aerodynamics, and autonomy of the delfly. Bioinspiration Biomimetics 7(2), 025003 (2012)
20.
Zurück zum Zitat S. Tijmons, G.C.H.E. de Croon, B.D.W. Remes, C. De Wagter, R. Ruijsink, E. van Kampen, Q.P. Chu, Off-board processing of stereo vision images for obstacle avoidance on a flapping wing mav, in Pegasus AIAA conference, Prague (2013) S. Tijmons, G.C.H.E. de Croon, B.D.W. Remes, C. De Wagter, R. Ruijsink, E. van Kampen, Q.P. Chu, Off-board processing of stereo vision images for obstacle avoidance on a flapping wing mav, in Pegasus AIAA conference, Prague (2013)
21.
Zurück zum Zitat S. Forstmann, Y. Kanou, J. Ohya, S. Thuering, A.Schmitt, Real-time stereo by using dynamic programming, in Computer Vision and Pattern Recognition Workshop (CVPRW) (2004), pp. 29–29 S. Forstmann, Y. Kanou, J. Ohya, S. Thuering, A.Schmitt, Real-time stereo by using dynamic programming, in Computer Vision and Pattern Recognition Workshop (CVPRW) (2004), pp. 29–29
22.
Zurück zum Zitat H. Hirschmuller, Accurate and efficient stereo processing by semi-global matching and mutual information. Comput. Vision Pattern Recogn. 2, 807–814 (2005) H. Hirschmuller, Accurate and efficient stereo processing by semi-global matching and mutual information. Comput. Vision Pattern Recogn. 2, 807–814 (2005)
23.
Zurück zum Zitat D. Gallup, J.M. Frahm, P. Mordohai, Q. Yang, M. Pollefeys, Real-time plane-sweeping stereo with multiple sweeping directions, in Computer Vision and Pattern Recognition (CVPR) (2007), pp. 1–8 D. Gallup, J.M. Frahm, P. Mordohai, Q. Yang, M. Pollefeys, Real-time plane-sweeping stereo with multiple sweeping directions, in Computer Vision and Pattern Recognition (CVPR) (2007), pp. 1–8
24.
Zurück zum Zitat S. Tijmons, G.C.H.E. de Croon, B.D.W. Remes, C. De Wagter, R. Ruijsink, Obstacle avoidance by stereo vision on flapping wing mavs (Submitted) S. Tijmons, G.C.H.E. de Croon, B.D.W. Remes, C. De Wagter, R. Ruijsink, Obstacle avoidance by stereo vision on flapping wing mavs (Submitted)
25.
Zurück zum Zitat G.C.H.E. de Croon, C. De Wagter, B.D.W. Remes, R. Ruijsink, Sub-sampling: real-time vision for micro air vehicles. Robot. Auton. Syst. 60(2), 167–181 (2012) G.C.H.E. de Croon, C. De Wagter, B.D.W. Remes, R. Ruijsink, Sub-sampling: real-time vision for micro air vehicles. Robot. Auton. Syst. 60(2), 167–181 (2012)
26.
Zurück zum Zitat C. De Wagter, S. Tijmons, B.D.W. Remes, G.C.H.E. de Croon, Autonomous flight of a 20-gram flapping wing mav with a 4-gram onboard stereo vision system, in 2014 IEEE International Conference on Robotics and Automation (ICRA 2014) 2014 C. De Wagter, S. Tijmons, B.D.W. Remes, G.C.H.E. de Croon, Autonomous flight of a 20-gram flapping wing mav with a 4-gram onboard stereo vision system, in 2014 IEEE International Conference on Robotics and Automation (ICRA 2014) 2014
Metadaten
Titel
Autonomous Flight with Onboard Stereo Vision
verfasst von
G. C. H. E. de Croon
M. Perçin
B. D. W. Remes
R. Ruijsink
C. De Wagter
Copyright-Jahr
2016
Verlag
Springer Netherlands
DOI
https://doi.org/10.1007/978-94-017-9208-0_10

    Premium Partner