Skip to main content

2016 | OriginalPaper | Buchkapitel

Vision and Learning for Deliberative Monocular Cluttered Flight

verfasst von : Debadeepta Dey, Kumar Shaurya Shankar, Sam Zeng, Rupesh Mehta, M. Talha Agcayazi, Christopher Eriksen, Shreyansh Daftry, Martial Hebert, J. Andrew Bagnell

Erschienen in: Field and Service Robotics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Cameras provide a rich source of information while being passive, cheap and lightweight for small Unmanned Aerial Vehicles (UAVs). In this work we present the first implementation of receding horizon control, which is widely used in ground vehicles, with monocular vision as the only sensing mode for autonomous UAV flight in dense clutter. Two key contributions make this possible: novel coupling of perception and control via relevant and diverse, multiple interpretations of the scene around the robot, leveraging recent advances in machine learning to showcase anytime budgeted cost-sensitive feature selection, and fast non-linear regression for monocular depth prediction. We empirically demonstrate the efficacy of our novel pipeline via real world experiments of more than 2 kms through dense trees with an off-the-shelf quadrotor. Moreover our pipeline is designed to combine information from other modalities like stereo and lidar.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Agarwal, A., Kakade, S.M., Karampatziakis, N., Song, L., Valiant, G.: Least squares revisited: scalable approaches for multi-class prediction. arXiv preprint arXiv:1310.1949 (2013) Agarwal, A., Kakade, S.M., Karampatziakis, N., Song, L., Valiant, G.: Least squares revisited: scalable approaches for multi-class prediction. arXiv preprint arXiv:​1310.​1949 (2013)
2.
Zurück zum Zitat Bachrach, A., He, R., Roy, N.: Autonomous flight in unknown indoor environments. Int. J. Micro Air Veh. (2009) Bachrach, A., He, R., Roy, N.: Autonomous flight in unknown indoor environments. Int. J. Micro Air Veh. (2009)
3.
Zurück zum Zitat Batra, D., Yadollahpour, P., Guzman-Rivera, A., Shakhnarovich, G.: Diverse m-best solutions in markov random fields. In: Computer Vision-ECCV 2012, pp. 1–16. Springer (2012) Batra, D., Yadollahpour, P., Guzman-Rivera, A., Shakhnarovich, G.: Diverse m-best solutions in markov random fields. In: Computer Vision-ECCV 2012, pp. 1–16. Springer (2012)
4.
Zurück zum Zitat Beyeler, A., Zufferey, J.C., Floreano, D.: Vision-based control of near-obstacle flight. Auton. Robots (2009) Beyeler, A., Zufferey, J.C., Floreano, D.: Vision-based control of near-obstacle flight. Auton. Robots (2009)
5.
Zurück zum Zitat Buehler, M., Iagnemma, K., Singh, S.: Special issue on the 2007 darpa urban challenge, part i, ii, iii. JFR (2008) Buehler, M., Iagnemma, K., Singh, S.: Special issue on the 2007 darpa urban challenge, part i, ii, iii. JFR (2008)
6.
Zurück zum Zitat Coulter, R.C.: Implementation of the pure pursuit path tracking algorithm. Tech. rep, DTIC Document (1992) Coulter, R.C.: Implementation of the pure pursuit path tracking algorithm. Tech. rep, DTIC Document (1992)
7.
Zurück zum Zitat Dalal, N., Triggs, B., Schmid, C.: Human detection using oriented histograms of flow and appearance. In: ECCV (2006) Dalal, N., Triggs, B., Schmid, C.: Human detection using oriented histograms of flow and appearance. In: ECCV (2006)
8.
Zurück zum Zitat Davies, E.R.: Machine vision: theory, algorithms, practicalities (2004) Davies, E.R.: Machine vision: theory, algorithms, practicalities (2004)
9.
Zurück zum Zitat Dey, D., Geyer, C., Singh, S., Digioia, M.: A cascaded method to detect aircraft in video imagery. IJRR (2011) Dey, D., Geyer, C., Singh, S., Digioia, M.: A cascaded method to detect aircraft in video imagery. IJRR (2011)
10.
Zurück zum Zitat Dey, D., Liu, T.Y., Hebert, M., Bagnell, J.A.D.: Contextual sequence optimization with application to control library optimization. In: RSS (2012) Dey, D., Liu, T.Y., Hebert, M., Bagnell, J.A.D.: Contextual sequence optimization with application to control library optimization. In: RSS (2012)
11.
Zurück zum Zitat Farnebäck, G.: Two-frame motion estimation based on polynomial expansion. In: Image Analysis (2003) Farnebäck, G.: Two-frame motion estimation based on polynomial expansion. In: Image Analysis (2003)
12.
Zurück zum Zitat Green, C., Kelly, A.: Optimal sampling in the space of paths: preliminary results. Tech. Rep. CMU-RI-TR-06-51, Robotics Institute, Pittsburgh, PA (2006) Green, C., Kelly, A.: Optimal sampling in the space of paths: preliminary results. Tech. Rep. CMU-RI-TR-06-51, Robotics Institute, Pittsburgh, PA (2006)
13.
Zurück zum Zitat Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference (1988) Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference (1988)
14.
Zurück zum Zitat Helgason, S.: Support of radon transforms. Adv. Math. (1980) Helgason, S.: Support of radon transforms. Adv. Math. (1980)
15.
Zurück zum Zitat Hoiem, D., Efros, A.A., Hebert, M.: Geometric context from a single image. In: ICCV (2005) Hoiem, D., Efros, A.A., Hebert, M.: Geometric context from a single image. In: ICCV (2005)
16.
Zurück zum Zitat Honegger, D., Meier, L., Tanskanen, P., Pollefeys, M.: An open source and open hardware embedded metric optical flow cmos camera for indoor and outdoor applications. In: ICRA (2013) Honegger, D., Meier, L., Tanskanen, P., Pollefeys, M.: An open source and open hardware embedded metric optical flow cmos camera for indoor and outdoor applications. In: ICRA (2013)
17.
Zurück zum Zitat Hu, H., Grubb, A., Bagnell, J.A., Hebert, M.: Efficient feature group sequencing for anytime linear prediction. arXiv:1409.5495 (2014) Hu, H., Grubb, A., Bagnell, J.A., Hebert, M.: Efficient feature group sequencing for anytime linear prediction. arXiv:​1409.​5495 (2014)
18.
Zurück zum Zitat Kelly, A., et al.: Toward reliable off road autonomous vehicles operating in challenging environments. IJRR (2006) Kelly, A., et al.: Toward reliable off road autonomous vehicles operating in challenging environments. IJRR (2006)
19.
Zurück zum Zitat Klein, G., Murray, D.: Parallel tracking and mapping for small ar workspaces. In: ISMAR (2007) Klein, G., Murray, D.: Parallel tracking and mapping for small ar workspaces. In: ISMAR (2007)
20.
Zurück zum Zitat Knepper, R., Mason, M.: Path diversity is only part of the problem. In: ICRA (2009) Knepper, R., Mason, M.: Path diversity is only part of the problem. In: ICRA (2009)
21.
Zurück zum Zitat Langford, J., Li, L., Strehl, A.: Vowpal Wabbit (2007) Langford, J., Li, L., Strehl, A.: Vowpal Wabbit (2007)
22.
Zurück zum Zitat Li, C., Kitani, K.M.: Pixel-level hand detection in ego-centric videos. In: CVPR (2013) Li, C., Kitani, K.M.: Pixel-level hand detection in ego-centric videos. In: CVPR (2013)
23.
Zurück zum Zitat Matthies, L., Brockers, R., Kuwata, Y., Weiss, S.: Stereo vision-based obstacle avoidance for micro air vehicles using disparity space. In: ICRA (2014) Matthies, L., Brockers, R., Kuwata, Y., Weiss, S.: Stereo vision-based obstacle avoidance for micro air vehicles using disparity space. In: ICRA (2014)
24.
Zurück zum Zitat Newcombe, R.A., Lovegrove, S.J., Davison, A.J.: Dtam: dense tracking and mapping in real-time. In: ICCV (2011) Newcombe, R.A., Lovegrove, S.J., Davison, A.J.: Dtam: dense tracking and mapping in real-time. In: ICCV (2011)
25.
Zurück zum Zitat Quigley, M., Conley, K., Gerkey, B.P., Faust, J., Foote, T., Leibs, J., Wheeler, R., Ng, A.Y.: Ros: an open-source robot operating system. In: ICRA Workshop on Open Source Software (2009) Quigley, M., Conley, K., Gerkey, B.P., Faust, J., Foote, T., Leibs, J., Wheeler, R., Ng, A.Y.: Ros: an open-source robot operating system. In: ICRA Workshop on Open Source Software (2009)
26.
Zurück zum Zitat Ross, S., Melik-Barkhudarov, N., Shankar, K.S., Wendel, A., Dey, D., Bagnell, J.A., Hebert, M.: Learning monocular reactive uav control in cluttered natural environments. In: ICRA (2013) Ross, S., Melik-Barkhudarov, N., Shankar, K.S., Wendel, A., Dey, D., Bagnell, J.A., Hebert, M.: Learning monocular reactive uav control in cluttered natural environments. In: ICRA (2013)
27.
Zurück zum Zitat Saxena, A., Chung, S.H., Ng, A.Y.: Learning depth from single monocular images. In: NIPS (2005) Saxena, A., Chung, S.H., Ng, A.Y.: Learning depth from single monocular images. In: NIPS (2005)
28.
Zurück zum Zitat Scherer, S., Singh, S., Chamberlain, L.J., Elgersma, M.: Flying fast and low among obstacles: methodology and experiments. IJRR (2008) Scherer, S., Singh, S., Chamberlain, L.J., Elgersma, M.: Flying fast and low among obstacles: methodology and experiments. IJRR (2008)
29.
Zurück zum Zitat Schmid, K., Lutz, P., Tomić, T., Mair, E., Hirschmüller, H.: Autonomous vision-based micro air vehicle for indoor and outdoor navigation. JFR (2014) Schmid, K., Lutz, P., Tomić, T., Mair, E., Hirschmüller, H.: Autonomous vision-based micro air vehicle for indoor and outdoor navigation. JFR (2014)
30.
Zurück zum Zitat Srinivasan, M.V.: Visual control of navigation in insects and its relevance for robotics. Curr. Opin. Neurobiol. (2011) Srinivasan, M.V.: Visual control of navigation in insects and its relevance for robotics. Curr. Opin. Neurobiol. (2011)
31.
Zurück zum Zitat Tomasi, C., Kanade, T.: Detection and tracking of point features. School of Computer Science, Carnegie Mellon University (1991) Tomasi, C., Kanade, T.: Detection and tracking of point features. School of Computer Science, Carnegie Mellon University (1991)
32.
Zurück zum Zitat Wendel, A., Maurer, M., Graber, G., Pock, T., Bischof, H.: Dense reconstruction on-the-fly. In: CVPR (2012) Wendel, A., Maurer, M., Graber, G., Pock, T., Bischof, H.: Dense reconstruction on-the-fly. In: CVPR (2012)
Metadaten
Titel
Vision and Learning for Deliberative Monocular Cluttered Flight
verfasst von
Debadeepta Dey
Kumar Shaurya Shankar
Sam Zeng
Rupesh Mehta
M. Talha Agcayazi
Christopher Eriksen
Shreyansh Daftry
Martial Hebert
J. Andrew Bagnell
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-27702-8_26

Neuer Inhalt