Skip to main content
Erschienen in: Intelligent Service Robotics 2/2014

01.04.2014 | Special Issue

3D reconstruction and classification of natural environments by an autonomous vehicle using multi-baseline stereo

verfasst von: Annalisa Milella, Giulio Reina

Erschienen in: Intelligent Service Robotics | Ausgabe 2/2014

Einloggen

Aktivieren Sie unsere intelligente Suche um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In natural outdoor settings, advanced perception systems and learning strategies are major requirement for an autonomous vehicle to sense and understand the surrounding environment, recognizing artificial and natural structures, topology, vegetation and drivable paths. Stereo vision has been used extensively for this purpose. However, conventional single-baseline stereo does not scale well to different depths of perception. In this paper, a multi-baseline stereo frame is introduced to perform accurate 3D scene reconstruction from near range up to several meters away from the vehicle. A classifier that segments the scene into navigable and non-navigable areas based on 3D data is also described. It incorporates geometric features within an online self-learning framework to model and identify traversable ground, without any a priori assumption on the terrain characteristics. The ground model is automatically retrained during the robot motion, thus ensuring adaptation to environmental changes. The proposed strategy is of general applicability for robot’s perception and it can be implemented using any range sensor. Here, it is demonstrated for stereo-based data acquired by the multi-baseline device. Experimental tests, carried out in a rural environment with an off-road vehicle, are presented. It is shown that the use of a multi-baseline stereo frame allows for accurate reconstruction and scene segmentation at a wide range of visible distances, thus increasing the overall flexibility and reliability of the perception system.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Hague T, Marchant JA, Tillett ND (2000) Ground-based sensing systems for autonomous agricultural vehicles. Comput Electron Agric 25(1–2):11–28CrossRef Hague T, Marchant JA, Tillett ND (2000) Ground-based sensing systems for autonomous agricultural vehicles. Comput Electron Agric 25(1–2):11–28CrossRef
2.
Zurück zum Zitat Rankin A, Huertas A, Matthies L (2005) Evaluation of stereo vision obstacle detecion algorithms for off-road autonomous navigation. In: Proceedings of the 32nd AUVSI symposium on unmanned systems, June 2005 Rankin A, Huertas A, Matthies L (2005) Evaluation of stereo vision obstacle detecion algorithms for off-road autonomous navigation. In: Proceedings of the 32nd AUVSI symposium on unmanned systems, June 2005
3.
Zurück zum Zitat Rovira-Más F, Zhang Q, Reid JF (2008) Stereo vision three-dimensional terrain maps for precision agriculture. Comput Electron Agric 60(2):133–143CrossRef Rovira-Más F, Zhang Q, Reid JF (2008) Stereo vision three-dimensional terrain maps for precision agriculture. Comput Electron Agric 60(2):133–143CrossRef
4.
Zurück zum Zitat Konolige K, Agrawal M, Bolles RC, Cowan C, Fischler M, Gerkey B (2008) Outdoor mapping and navigation using stereo vision. Exp Robot Springer Tracts Adv Robot 39:179–190CrossRef Konolige K, Agrawal M, Bolles RC, Cowan C, Fischler M, Gerkey B (2008) Outdoor mapping and navigation using stereo vision. Exp Robot Springer Tracts Adv Robot 39:179–190CrossRef
5.
Zurück zum Zitat Milella A, Reina G, Siegwart R (2006) Computer vision methods for improved mobile robot state estimation in challenging terrains. J Multimed 1(7):49–61CrossRef Milella A, Reina G, Siegwart R (2006) Computer vision methods for improved mobile robot state estimation in challenging terrains. J Multimed 1(7):49–61CrossRef
6.
Zurück zum Zitat Reina G, Milella A (2012) Towards autonomous agriculture: automatic ground detection using trinocular stereovision. Sensors 12(9):12405–12423CrossRef Reina G, Milella A (2012) Towards autonomous agriculture: automatic ground detection using trinocular stereovision. Sensors 12(9):12405–12423CrossRef
7.
Zurück zum Zitat Okutomi M, Kanade T (1993) A multiple-baseline stereo. IEEE Trans Pattern Anal Mach Intell 15(4):353–363 Okutomi M, Kanade T (1993) A multiple-baseline stereo. IEEE Trans Pattern Anal Mach Intell 15(4):353–363
8.
Zurück zum Zitat Gallup D, Frahm JM, Mordohai P, Pollefeys M (2008) Variable baseline/resolution stereo. In: IEEE conference on computer vision and pattern recognition, Anchorage, AK, 23–28 June 2008, pp 1–8. doi:10.1109/CVPR.2008.4587671 Gallup D, Frahm JM, Mordohai P, Pollefeys M (2008) Variable baseline/resolution stereo. In: IEEE conference on computer vision and pattern recognition, Anchorage, AK, 23–28 June 2008, pp 1–8. doi:10.​1109/​CVPR.​2008.​4587671
9.
Zurück zum Zitat Milella A, Reina G, Foglia M (2013) A multi-baseline stereo system for scene segmentation in natural environments. In: IEEE international conference on technologies for practical robot applications (TePRA), Woburn, MA, 22–23 Apr 2013, pp 1–6. doi:10.1109/TePRA.2013.6556370 Milella A, Reina G, Foglia M (2013) A multi-baseline stereo system for scene segmentation in natural environments. In: IEEE international conference on technologies for practical robot applications (TePRA), Woburn, MA, 22–23 Apr 2013, pp 1–6. doi:10.​1109/​TePRA.​2013.​6556370
10.
Zurück zum Zitat Broggi A, Cappalunga A, Caraffi C, Cattani S, Ghidoni S, GrisleriP P, Porta P, Posterli M, Zani P (2010) TerraMax vision at the urban challenge 2007. IEEE Trans Intell Transp Syst 11(1):194–205CrossRef Broggi A, Cappalunga A, Caraffi C, Cattani S, Ghidoni S, GrisleriP P, Porta P, Posterli M, Zani P (2010) TerraMax vision at the urban challenge 2007. IEEE Trans Intell Transp Syst 11(1):194–205CrossRef
11.
Zurück zum Zitat Olson CF, Abi-Rached H (2010) Wide-baseline stereo vision for terrain mapping. Mach Vis Appl 21:713–725CrossRef Olson CF, Abi-Rached H (2010) Wide-baseline stereo vision for terrain mapping. Mach Vis Appl 21:713–725CrossRef
13.
Zurück zum Zitat Broggi A, Caraffi C, Fedriga RI, Grisleri P (2005) Obstacle detection with stereo vision for off-road vehicle navigation. In: IEEE computer society conference on computer vision and pattern recognition, workshop, San Diego, CA, USA, 25 June 2005, p 65. doi:10.1109/CVPR.2005.503 Broggi A, Caraffi C, Fedriga RI, Grisleri P (2005) Obstacle detection with stereo vision for off-road vehicle navigation. In: IEEE computer society conference on computer vision and pattern recognition, workshop, San Diego, CA, USA, 25 June 2005, p 65. doi:10.​1109/​CVPR.​2005.​503
14.
Zurück zum Zitat Kelly A, Stentz A (1998) Stereo vision enhancements for low-cost outdoor autonomous vehicles. In: International conference on robotics and automation, workshop WS-7, navigation of outdoor autonomous vehicles (ICRA’98), May 1998 Kelly A, Stentz A (1998) Stereo vision enhancements for low-cost outdoor autonomous vehicles. In: International conference on robotics and automation, workshop WS-7, navigation of outdoor autonomous vehicles (ICRA’98), May 1998
15.
Zurück zum Zitat Manduchi R, Castano A, Talukder A, Matthies L (2003) Obstacle detection and terrain classification for autonomous off-road navigation. Auton Robots 18:81–102CrossRef Manduchi R, Castano A, Talukder A, Matthies L (2003) Obstacle detection and terrain classification for autonomous off-road navigation. Auton Robots 18:81–102CrossRef
16.
Zurück zum Zitat Moravec A (1981) Rover visual obstacle avoidance. In: Proceedings of the 7th international joint conference on artificial intelligence, Vancouver, British Columbia, pp 785–790 Moravec A (1981) Rover visual obstacle avoidance. In: Proceedings of the 7th international joint conference on artificial intelligence, Vancouver, British Columbia, pp 785–790
17.
Zurück zum Zitat Klarquist W, Bovik A (1997) Adaptive variable baseline stereo for vergence control. In: Proceedings of the 1997 IEEE international conference on robotics and automation, vol. 3, pp 1952–1959 Klarquist W, Bovik A (1997) Adaptive variable baseline stereo for vergence control. In: Proceedings of the 1997 IEEE international conference on robotics and automation, vol. 3, pp 1952–1959
18.
Zurück zum Zitat Nakabo Y, Mukai T, Hattori Y, Takeuchi Y, Ohnishi N (2005) Variable baseline stereo tracking vision system using high-speed linear slider. In: Proceedings of the 2005 IEEE international conference on robotics and automation, pp 1567–1572 Nakabo Y, Mukai T, Hattori Y, Takeuchi Y, Ohnishi N (2005) Variable baseline stereo tracking vision system using high-speed linear slider. In: Proceedings of the 2005 IEEE international conference on robotics and automation, pp 1567–1572
19.
Zurück zum Zitat Milella A, Reina G, Underwood J, Douillard B (2011) Combining radar and vision for self-supervised ground segmentation in outdoor environments. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 255–260 Milella A, Reina G, Underwood J, Douillard B (2011) Combining radar and vision for self-supervised ground segmentation in outdoor environments. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), pp 255–260
21.
Zurück zum Zitat Milella A, Reina G, Underwood J (2014) A self-learning framework for statistical ground classification using radar and monocular vision. J Field Robot (in press) Milella A, Reina G, Underwood J (2014) A self-learning framework for statistical ground classification using radar and monocular vision. J Field Robot (in press)
22.
Zurück zum Zitat Stavens D, Thrun S (2006) A self-supervised terrain roughness estimator for offroad autonomous driving. In: Proceedings of the conference on uncertainty in AI (UAI), pp 13–16 Stavens D, Thrun S (2006) A self-supervised terrain roughness estimator for offroad autonomous driving. In: Proceedings of the conference on uncertainty in AI (UAI), pp 13–16
23.
Zurück zum Zitat Zhou S, Xi J, McDaniel MW, Nishihata T, Salesses P, Iagnemma K (2012) Self-supervised learning to visually detect terrain surfaces for autonomous robots operating in forested terrain. J Field Robot 29(2):277–297 Zhou S, Xi J, McDaniel MW, Nishihata T, Salesses P, Iagnemma K (2012) Self-supervised learning to visually detect terrain surfaces for autonomous robots operating in forested terrain. J Field Robot 29(2):277–297
24.
Zurück zum Zitat Reina G, Milella A, Underwood J (2012) Self-learning classification of radar feautures for scene understanding. Robot Auton Syst 60(11):1377–1388CrossRef Reina G, Milella A, Underwood J (2012) Self-learning classification of radar feautures for scene understanding. Robot Auton Syst 60(11):1377–1388CrossRef
25.
Zurück zum Zitat Vernaza P, Taskar B, Lee DD (2008) Online, self-supervised terrain classification via discriminatively trained submodular Markov random fields. In: Proceedings of IEEE international conference on robotics and automation, pp 2750–2757 Vernaza P, Taskar B, Lee DD (2008) Online, self-supervised terrain classification via discriminatively trained submodular Markov random fields. In: Proceedings of IEEE international conference on robotics and automation, pp 2750–2757
26.
Zurück zum Zitat Hadsell R, Sermanet P, Ben J, Erkan A, Scoffier M, Kavukcuoglu K, Muller U, LeCun Y (2009) Learning long-range vision for autonomous off-road driving. J Field Robot 26(2):120–144CrossRef Hadsell R, Sermanet P, Ben J, Erkan A, Scoffier M, Kavukcuoglu K, Muller U, LeCun Y (2009) Learning long-range vision for autonomous off-road driving. J Field Robot 26(2):120–144CrossRef
27.
Zurück zum Zitat Konolige K, Agrawal M, Blas MR, Bolles RC, Gerkey BP, Solá J, Sundaresan A (2009) Mapping, navigation, and learning for off-road traversal. J Field Robot 26(1):88–113CrossRefMATH Konolige K, Agrawal M, Blas MR, Bolles RC, Gerkey BP, Solá J, Sundaresan A (2009) Mapping, navigation, and learning for off-road traversal. J Field Robot 26(1):88–113CrossRefMATH
28.
Zurück zum Zitat Bradski G, Kaehler A (2008) Learning OpenCV: computer vision with the OpenCV library. O’Reilly Media, USA Bradski G, Kaehler A (2008) Learning OpenCV: computer vision with the OpenCV library. O’Reilly Media, USA
29.
Zurück zum Zitat Kuthirummal S, Das A, Samarasekera S (2011) A graph traversal based algorithm for obstacle detection using lidar or stereo. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), San Francisco, CA, 25–30 Sept 2011, pp 3874–3880. doi:10.1109/IROS.2011.6094685 Kuthirummal S, Das A, Samarasekera S (2011) A graph traversal based algorithm for obstacle detection using lidar or stereo. In: IEEE/RSJ international conference on intelligent robots and systems (IROS), San Francisco, CA, 25–30 Sept 2011, pp 3874–3880. doi:10.​1109/​IROS.​2011.​6094685
30.
Zurück zum Zitat Duda EO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New YorkMATH Duda EO, Hart PE, Stork DG (2001) Pattern classification, 2nd edn. Wiley, New YorkMATH
31.
Zurück zum Zitat Mardia K, Kent J, Bibby J (1979) Multivariate analysis. Academic Press, LondonMATH Mardia K, Kent J, Bibby J (1979) Multivariate analysis. Academic Press, LondonMATH
Metadaten
Titel
3D reconstruction and classification of natural environments by an autonomous vehicle using multi-baseline stereo
verfasst von
Annalisa Milella
Giulio Reina
Publikationsdatum
01.04.2014
Verlag
Springer Berlin Heidelberg
Erschienen in
Intelligent Service Robotics / Ausgabe 2/2014
Print ISSN: 1861-2776
Elektronische ISSN: 1861-2784
DOI
https://doi.org/10.1007/s11370-014-0146-x

Weitere Artikel der Ausgabe 2/2014

Intelligent Service Robotics 2/2014 Zur Ausgabe

Neuer Inhalt