Skip to main content
Erschienen in: Autonomous Robots 6/2019

31.10.2018

Autonomous flight with robust visual odometry under dynamic lighting conditions

verfasst von: Pyojin Kim, Hyeonbeom Lee, H. Jin Kim

Erschienen in: Autonomous Robots | Ausgabe 6/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Sensitivity to light conditions poses a challenge when utilizing visual odometry (VO) for autonomous navigation of small aerial vehicles in various applications. We present an illumination-robust direct visual odometry for a stable autonomous flight of an aerial robot under unpredictable light condition. The proposed stereo VO achieves robustness with respect to the light-changing environment by employing the patch-based affine illumination model to compensate abrupt, irregular illumination changes during direct motion estimation. We furthermore incorporate a motion prior from feature-based stereo visual odometry in the optimization, resulting in higher accuracy and more stable motion estimate. Thorough analyses of convergence rate and linearity index for the feature-based and direct VO methods support the effectiveness of the usage of the motion prior knowledge. We extensively evaluate the proposed algorithm on synthetic and real micro aerial vehicle datasets with ground-truth. Autonomous flight experiments with an aerial robot show that the proposed method successfully estimates 6-DoF pose under significant illumination changes.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
Literatur
Zurück zum Zitat Achtelik, M., Achtelik, M., et al. (2012). Sfly: Swarm of micro flying robots. In: 2012 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 2649–2650). IEEE. Achtelik, M., Achtelik, M., et al. (2012). Sfly: Swarm of micro flying robots. In: 2012 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 2649–2650). IEEE.
Zurück zum Zitat Alismail, H., Kaess, M., Browning, B., & Lucey, S. (2017). Direct visual odometry in low light using binary descriptors. IEEE Robotics and Automation Letters, 2(2), 444–451.CrossRef Alismail, H., Kaess, M., Browning, B., & Lucey, S. (2017). Direct visual odometry in low light using binary descriptors. IEEE Robotics and Automation Letters, 2(2), 444–451.CrossRef
Zurück zum Zitat Benhimane, S., & Malis, E. (2004). Real-time image-based tracking of planes using efficient second-order minimization. In: 2004 IEEE/RSJ international conference on intelligent robots and systems, 2004. IROS 2004. Proceedings (Vol. 1, pp 943–948). IEEE. Benhimane, S., & Malis, E. (2004). Real-time image-based tracking of planes using efficient second-order minimization. In: 2004 IEEE/RSJ international conference on intelligent robots and systems, 2004. IROS 2004. Proceedings (Vol. 1, pp 943–948). IEEE.
Zurück zum Zitat Bergmann, P., Wang, R., & Cremers, D. (2018). Online photometric calibration of auto exposure video for realtime visual odometry and slam. IEEE Robotics and Automation Letters, 3(2), 627–634.CrossRef Bergmann, P., Wang, R., & Cremers, D. (2018). Online photometric calibration of auto exposure video for realtime visual odometry and slam. IEEE Robotics and Automation Letters, 3(2), 627–634.CrossRef
Zurück zum Zitat Blanco, J. L. (2010). A tutorial on se (3) transformation parameterizations and on-manifold optimization (p. 3). University of Malaga, Tech Rep. Blanco, J. L. (2010). A tutorial on se (3) transformation parameterizations and on-manifold optimization (p. 3). University of Malaga, Tech Rep.
Zurück zum Zitat Burri, M., & Nikolic, J. (2016). The EuRoc micro aerial vehicle datasets. The International Journal of Robotics Research, 35, 1157–1163.CrossRef Burri, M., & Nikolic, J. (2016). The EuRoc micro aerial vehicle datasets. The International Journal of Robotics Research, 35, 1157–1163.CrossRef
Zurück zum Zitat Civera, J., Davison, A. J., & Montiel, J. M. (2008). Inverse depth parametrization for monocular slam. IEEE Transactions on Robotics, 24(5), 932–945.CrossRef Civera, J., Davison, A. J., & Montiel, J. M. (2008). Inverse depth parametrization for monocular slam. IEEE Transactions on Robotics, 24(5), 932–945.CrossRef
Zurück zum Zitat Engel, J., Schöps, T., & Cremers, D. (2014). LSD-SLAM: Large-scale direct monocular slam. In: European Conference on Computer Vision (pp. 834–849). Springer. Engel, J., Schöps, T., & Cremers, D. (2014). LSD-SLAM: Large-scale direct monocular slam. In: European Conference on Computer Vision (pp. 834–849). Springer.
Zurück zum Zitat Engel, J., Stückler, J., & Cremers, D. (2015). Large-scale direct slam with stereo cameras. In: 2015 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 1935–1942). IEEE. Engel, J., Stückler, J., & Cremers, D. (2015). Large-scale direct slam with stereo cameras. In: 2015 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 1935–1942). IEEE.
Zurück zum Zitat Engel, J., Koltun, V., & Cremers, D. (2018). Direct sparse odometry. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(3), 611–625.CrossRef Engel, J., Koltun, V., & Cremers, D. (2018). Direct sparse odometry. IEEE Transactions on Pattern Analysis and Machine Intelligence, 40(3), 611–625.CrossRef
Zurück zum Zitat Fang, Z., & Scherer, S. (2014). Experimental study of odometry estimation methods using RGB-D cameras. In: IROS (pp. 680–687). IEEE. Fang, Z., & Scherer, S. (2014). Experimental study of odometry estimation methods using RGB-D cameras. In: IROS (pp. 680–687). IEEE.
Zurück zum Zitat Forster, C., Pizzoli, M., & Scaramuzza, D. (2014). SVO: Fast semi-direct monocular visual odometry. In: 2014 IEEE international conference on robotics and automation (ICRA) (pp. 15–22). IEEE. Forster, C., Pizzoli, M., & Scaramuzza, D. (2014). SVO: Fast semi-direct monocular visual odometry. In: 2014 IEEE international conference on robotics and automation (ICRA) (pp. 15–22). IEEE.
Zurück zum Zitat Forster, C., Zhang, Z., Gassner, M., Werlberger, M., & Scaramuzza, D. (2017). SVO: Semidirect visual odometry for monocular and multicamera systems. IEEE Transactions on Robotics, 33(2), 249–265.CrossRef Forster, C., Zhang, Z., Gassner, M., Werlberger, M., & Scaramuzza, D. (2017). SVO: Semidirect visual odometry for monocular and multicamera systems. IEEE Transactions on Robotics, 33(2), 249–265.CrossRef
Zurück zum Zitat Geiger, A., Roser, M., & Urtasun, R. (2010). Efficient large-scale stereo matching. In: Asian conference on computer vision (pp. 25–38). Springer. Geiger, A., Roser, M., & Urtasun, R. (2010). Efficient large-scale stereo matching. In: Asian conference on computer vision (pp. 25–38). Springer.
Zurück zum Zitat Geiger, A., Ziegler, J., & Stiller, C. (2011). Stereoscan: Dense 3d reconstruction in real-time. In: 2011 IEEE Intelligent Vehicles Symposium (IV) (pp. 963–968). IEEE. Geiger, A., Ziegler, J., & Stiller, C. (2011). Stereoscan: Dense 3d reconstruction in real-time. In: 2011 IEEE Intelligent Vehicles Symposium (IV) (pp. 963–968). IEEE.
Zurück zum Zitat Huang, A. S., Bachrach, A., Henry, P., Krainin, M., Maturana, D., Fox, D., et al. (2011). Visual odometry and mapping for autonomous flight using an RGB-D camera. In: ISRR, pp. 1–16. Huang, A. S., Bachrach, A., Henry, P., Krainin, M., Maturana, D., Fox, D., et al. (2011). Visual odometry and mapping for autonomous flight using an RGB-D camera. In: ISRR, pp. 1–16.
Zurück zum Zitat Jin, H., Favaro, P., & Soatto, S. (2001). Real-time feature tracking and outlier rejection with changes in illumination. In ICCV, pp. 684–689. Jin, H., Favaro, P., & Soatto, S. (2001). Real-time feature tracking and outlier rejection with changes in illumination. In ICCV, pp. 684–689.
Zurück zum Zitat Kerl, C. (2012). Odometry from RGB-D cameras for autonomous quadrocopters. Master’s thesis, Technical University Munich, Germany. Kerl, C. (2012). Odometry from RGB-D cameras for autonomous quadrocopters. Master’s thesis, Technical University Munich, Germany.
Zurück zum Zitat Kerl, C., Sturm, J., & Cremers, D. (2013). Robust odometry estimation for RGB-D cameras. In: 2013 IEEE international conference on robotics and automation (ICRA) (pp. 3748–3754). IEEE. Kerl, C., Sturm, J., & Cremers, D. (2013). Robust odometry estimation for RGB-D cameras. In: 2013 IEEE international conference on robotics and automation (ICRA) (pp. 3748–3754). IEEE.
Zurück zum Zitat Kerl, C., Souiai, M., Sturm, J., & Cremers, D. (2014). Towards illumination-invariant 3D reconstruction using ToF RGB-D cameras. In: 3DV. Kerl, C., Souiai, M., Sturm, J., & Cremers, D. (2014). Towards illumination-invariant 3D reconstruction using ToF RGB-D cameras. In: 3DV.
Zurück zum Zitat Kim, P., Lim, H., & Kim, H. J. (2015). Robust visual odometry to irregular illumination changes with RGB-D camera. In: 2015 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 3688–3694). IEEE. Kim, P., Lim, H., & Kim, H. J. (2015). Robust visual odometry to irregular illumination changes with RGB-D camera. In: 2015 IEEE/RSJ international conference on intelligent robots and systems (IROS) (pp. 3688–3694). IEEE.
Zurück zum Zitat Kitt, B., Geiger, A., & Lategahn, H. (2010). Visual odometry based on stereo image sequences with ransac-based outlier rejection scheme. In: 2010 IEEE Intelligent Vehicles Symposium (IV) (pp. 486–492). IEEE. Kitt, B., Geiger, A., & Lategahn, H. (2010). Visual odometry based on stereo image sequences with ransac-based outlier rejection scheme. In: 2010 IEEE Intelligent Vehicles Symposium (IV) (pp. 486–492). IEEE.
Zurück zum Zitat Klose, S., Heise, P., & Knoll, A. (2013). Efficient compositional approaches for real-time robust direct visual odometry from RGB-D data. In: 2013 IEEE/RSJ international conference on intelligent robots and systems (pp. 1100–1106). IEEE. Klose, S., Heise, P., & Knoll, A. (2013). Efficient compositional approaches for real-time robust direct visual odometry from RGB-D data. In: 2013 IEEE/RSJ international conference on intelligent robots and systems (pp. 1100–1106). IEEE.
Zurück zum Zitat Krombach, N., Droeschel, D., & Behnke, S. (2016). Combining feature-based and direct methods for semi-dense real-time stereo visual odometry. In: International conference on intelligent autonomous systems (pp. 855–868). Springer. Krombach, N., Droeschel, D., & Behnke, S. (2016). Combining feature-based and direct methods for semi-dense real-time stereo visual odometry. In: International conference on intelligent autonomous systems (pp. 855–868). Springer.
Zurück zum Zitat Lee, H., Kim, H., & Kim, H. J. (2018). Planning and control for collision-free cooperative aerial transportation. IEEE Transactions on Automation Science and Engineering, 15(1), 189–201.CrossRef Lee, H., Kim, H., & Kim, H. J. (2018). Planning and control for collision-free cooperative aerial transportation. IEEE Transactions on Automation Science and Engineering, 15(1), 189–201.CrossRef
Zurück zum Zitat Ma, Y., Soatto, S., Kosecka, J., & Sastry, S. S. (2012). An invitation to 3-d vision: From images to geometric models (Vol. 26). Berlin: Springer.MATH Ma, Y., Soatto, S., Kosecka, J., & Sastry, S. S. (2012). An invitation to 3-d vision: From images to geometric models (Vol. 26). Berlin: Springer.MATH
Zurück zum Zitat Maimone, M., Cheng, Y., & Matthies, L. (2007). Two years of visual odometry on the mars exploration rovers. Journal of Field Robotics, 24(3), 169–186.CrossRef Maimone, M., Cheng, Y., & Matthies, L. (2007). Two years of visual odometry on the mars exploration rovers. Journal of Field Robotics, 24(3), 169–186.CrossRef
Zurück zum Zitat Mur-Artal, R., Montiel, J., & Tardós, J. D. (2015). ORB-SLAM: A versatile and accurate monocular slam system. IEEE Transactions on Robotics, 31(5), 1147–1163.CrossRef Mur-Artal, R., Montiel, J., & Tardós, J. D. (2015). ORB-SLAM: A versatile and accurate monocular slam system. IEEE Transactions on Robotics, 31(5), 1147–1163.CrossRef
Zurück zum Zitat Nikolic, J., Rehder, J., et al. (2014). A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time slam. In: 2014 IEEE international conference on robotics and automation (ICRA) (pp. 431–437). IEEE. Nikolic, J., Rehder, J., et al. (2014). A synchronized visual-inertial sensor system with FPGA pre-processing for accurate real-time slam. In: 2014 IEEE international conference on robotics and automation (ICRA) (pp. 431–437). IEEE.
Zurück zum Zitat Nistér, D., Naroditsky, O., & Bergen, J. (2004). Visual odometry. In: Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition, 2004. CVPR 2004 (Vol. 1, pp. I–I). IEEE. Nistér, D., Naroditsky, O., & Bergen, J. (2004). Visual odometry. In: Proceedings of the 2004 IEEE computer society conference on computer vision and pattern recognition, 2004. CVPR 2004 (Vol. 1, pp. I–I). IEEE.
Zurück zum Zitat Park, S., Schöps, T., & Pollefeys, M. (2017). Illumination change robustness in direct visual slam. In: 2017 IEEE international conference on robotics and automation (ICRA) (pp. 4523–4530). IEEE. Park, S., Schöps, T., & Pollefeys, M. (2017). Illumination change robustness in direct visual slam. In: 2017 IEEE international conference on robotics and automation (ICRA) (pp. 4523–4530). IEEE.
Zurück zum Zitat Scaramuzza, D., Achtelik, M., et al. (2014). Vision-controlled micro flying robots: From system design to autonomous navigation and mapping in GPS-denied environments. IEEE Robotics & Automation Magazine, 21(3), 26–40.CrossRef Scaramuzza, D., Achtelik, M., et al. (2014). Vision-controlled micro flying robots: From system design to autonomous navigation and mapping in GPS-denied environments. IEEE Robotics & Automation Magazine, 21(3), 26–40.CrossRef
Zurück zum Zitat Scaramuzza, D., & Fraundorfer, F. (2011). Visual odometry [tutorial]. IEEE Robotics & Automation Magazine, 18(4), 80–92.CrossRef Scaramuzza, D., & Fraundorfer, F. (2011). Visual odometry [tutorial]. IEEE Robotics & Automation Magazine, 18(4), 80–92.CrossRef
Zurück zum Zitat Sturm, J., et al. (2012). A benchmark for the evaluation of RGB-D slam systems. In: 2012 IEEE/RSJ international conference on intelligent robots and systems (pp. 573–580). IEEE. Sturm, J., et al. (2012). A benchmark for the evaluation of RGB-D slam systems. In: 2012 IEEE/RSJ international conference on intelligent robots and systems (pp. 573–580). IEEE.
Zurück zum Zitat Valenti, R. G., et al. (2014). Autonomous quadrotor flight using onboard RGB-D visual odometry. In: 2014 IEEE International Conference on Robotics and Automation (ICRA) (pp. 5233–5238). IEEE. Valenti, R. G., et al. (2014). Autonomous quadrotor flight using onboard RGB-D visual odometry. In: 2014 IEEE International Conference on Robotics and Automation (ICRA) (pp. 5233–5238). IEEE.
Zurück zum Zitat von Stumberg, L., Usenko, V., Engel, J., Stückler, J., & Cremers, D. (2016). Autonomous exploration with a low-cost quadrocopter using semi-dense monocular slam. ArXiv preprint arXiv:1609.07835. von Stumberg, L., Usenko, V., Engel, J., Stückler, J., & Cremers, D. (2016). Autonomous exploration with a low-cost quadrocopter using semi-dense monocular slam. ArXiv preprint arXiv:​1609.​07835.
Zurück zum Zitat Wang, R., Schwörer, M., & Cremers, D. (2017). Stereo DSO: Large-scale direct sparse visual odometry with stereo cameras. In: International conference on computer vision (ICCV), Venice, Italy. Wang, R., Schwörer, M., & Cremers, D. (2017). Stereo DSO: Large-scale direct sparse visual odometry with stereo cameras. In: International conference on computer vision (ICCV), Venice, Italy.
Zurück zum Zitat Zhang, J., Kaess, M., & Singh, S. (2017). A real-time method for depth enhanced visual odometry. Autonomous Robots, 41(1), 31–43.CrossRef Zhang, J., Kaess, M., & Singh, S. (2017). A real-time method for depth enhanced visual odometry. Autonomous Robots, 41(1), 31–43.CrossRef
Metadaten
Titel
Autonomous flight with robust visual odometry under dynamic lighting conditions
verfasst von
Pyojin Kim
Hyeonbeom Lee
H. Jin Kim
Publikationsdatum
31.10.2018
Verlag
Springer US
Erschienen in
Autonomous Robots / Ausgabe 6/2019
Print ISSN: 0929-5593
Elektronische ISSN: 1573-7527
DOI
https://doi.org/10.1007/s10514-018-9816-4

Weitere Artikel der Ausgabe 6/2019

Autonomous Robots 6/2019 Zur Ausgabe

Neuer Inhalt