Skip to main content
Top

2016 | OriginalPaper | Chapter

21. Stereovision for ADAS

Authors : Stefan Gehrig, Uwe Franke

Published in: Handbook of Driver Assistance Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Camera-based driver assistance went from pure research level activities in the early 1990s to standard equipment products in vehicles nowadays. This change is due to both technological advances and algorithmic developments. Especially, stereo vision plays a vital role in advanced driver assistance systems. In this chapter, we lay the foundations of stereo vision, show the specific needs for driver assistance, and build up a processing chain combining motion estimation and stereo information. The combination is called 6D-Vision and allows velocity estimation on a pixel level. For efficiency reasons, an intermediate stereo representation called Stixels is introduced from which an object representation is derived. The final section describes future trends in stereo vision such as a combination with machine learning approaches.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Badino H, Franke U, Rabe C, Gehrig S (2006) Stereo vision-based detection of moving objects under strong camera motion. VisApp, Portugal Badino H, Franke U, Rabe C, Gehrig S (2006) Stereo vision-based detection of moving objects under strong camera motion. VisApp, Portugal
go back to reference Badino H, Franke U, Pfeiffer D (2009) The stixel world – a compact medium level representation of the 3D-world. In: DAGM symposium, Jena, GerCrossRef Badino H, Franke U, Pfeiffer D (2009) The stixel world – a compact medium level representation of the 3D-world. In: DAGM symposium, Jena, GerCrossRef
go back to reference Banz C, Blume H, Pirsch P (2011) Real-time semi-global matching disparity estimation on the GPU. In: ICCV workshop on mobile computer vision, BarcelonaCrossRef Banz C, Blume H, Pirsch P (2011) Real-time semi-global matching disparity estimation on the GPU. In: ICCV workshop on mobile computer vision, BarcelonaCrossRef
go back to reference Barth A, Franke U (2009) Estimating the driving state of oncoming vehicles from a moving platform using stereo vision. IEEE Trans ITS 10:560–571 Barth A, Franke U (2009) Estimating the driving state of oncoming vehicles from a moving platform using stereo vision. IEEE Trans ITS 10:560–571
go back to reference Belhumeur N (1996) A Bayesian approach to binocular stereopsis. Int J Comput Vis 19(3):237–260CrossRef Belhumeur N (1996) A Bayesian approach to binocular stereopsis. Int J Comput Vis 19(3):237–260CrossRef
go back to reference Bleyer M, Chambon S (2010) Does color really help in dense stereo matching? In: International symposium 3D data processing, visualization and transmission (3DPVT), pp 1–8, Paris Bleyer M, Chambon S (2010) Does color really help in dense stereo matching? In: International symposium 3D data processing, visualization and transmission (3DPVT), pp 1–8, Paris
go back to reference Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23(11):1222–1239CrossRef Boykov Y, Veksler O, Zabih R (2001) Fast approximate energy minimization via graph cuts. IEEE Trans Pattern Anal Mach Intell 23(11):1222–1239CrossRef
go back to reference Dickmanns ED, Zapp A (1986) A curvature-based scheme for improving road vehicle guidance by computer vision. SPIE 727:161–168 Dickmanns ED, Zapp A (1986) A curvature-based scheme for improving road vehicle guidance by computer vision. SPIE 727:161–168
go back to reference Enzweiler M, Gavrila DM (2011) A multi-level mixture-of-experts framework for pedestrian classification. IEEE Trans Image Process 20:2967–2979CrossRefMathSciNet Enzweiler M, Gavrila DM (2011) A multi-level mixture-of-experts framework for pedestrian classification. IEEE Trans Image Process 20:2967–2979CrossRefMathSciNet
go back to reference Enzweiler M, Hummel M, Pfeiffer D, Franke U (2012) Efficient stixel-based object recognition. In: IEEE intelligent vehicles symposium, Alcala de HenaresCrossRef Enzweiler M, Hummel M, Pfeiffer D, Franke U (2012) Efficient stixel-based object recognition. In: IEEE intelligent vehicles symposium, Alcala de HenaresCrossRef
go back to reference Erbs F, Schwarz B, Franke U (2013) From stixels to objects. In: IEEE intelligent vehicles symposium, Brisbane Erbs F, Schwarz B, Franke U (2013) From stixels to objects. In: IEEE intelligent vehicles symposium, Brisbane
go back to reference Franke U, Rabe C, Badino H, Gehrig S (2005) 6D-vision: fusion of stereo and motion for robust environment perception. In: DAGM symposium, Wien Franke U, Rabe C, Badino H, Gehrig S (2005) 6D-vision: fusion of stereo and motion for robust environment perception. In: DAGM symposium, Wien
go back to reference Franke U, Pfeiffer D, Rabe C, Knöppel C, Enzweiler M, Stein F, Herrtwich RG (2013) Making Bertha See. In: ICCV workshop computer vision for autonomous driving, SydneyCrossRef Franke U, Pfeiffer D, Rabe C, Knöppel C, Enzweiler M, Stein F, Herrtwich RG (2013) Making Bertha See. In: ICCV workshop computer vision for autonomous driving, SydneyCrossRef
go back to reference Gehrig S, Rabe C (2010) Real-time semi-global matching on the CPU. In: CVPR embedded computer vision workshop, San FranciscoCrossRef Gehrig S, Rabe C (2010) Real-time semi-global matching on the CPU. In: CVPR embedded computer vision workshop, San FranciscoCrossRef
go back to reference Gehrig S, Eberli F, Meyer T (2009) A real-time low-power stereo engine using semi-global matching. In: International conference on computer vision systems, LiegeCrossRef Gehrig S, Eberli F, Meyer T (2009) A real-time low-power stereo engine using semi-global matching. In: International conference on computer vision systems, LiegeCrossRef
go back to reference Gehrig S, Badino H, Franke U (2012) Improving sub-pixel accuracy for long range stereo. J Comput Vis Image Underst 116(1):16–24CrossRef Gehrig S, Badino H, Franke U (2012) Improving sub-pixel accuracy for long range stereo. J Comput Vis Image Underst 116(1):16–24CrossRef
go back to reference Gehrig S, Reznistkii M, Schneider N, Franke U, Weickert J (2013) Priors for stereo vision under adverse weather conditions. In: ICCV workshop computer vision for autonomous driving, SydneyCrossRef Gehrig S, Reznistkii M, Schneider N, Franke U, Weickert J (2013) Priors for stereo vision under adverse weather conditions. In: ICCV workshop computer vision for autonomous driving, SydneyCrossRef
go back to reference Geiger A, Lenz P, Urtasun R (2012) Are we ready for autonomous driving? The KITTI vision benchmark suite, computer vision and pattern recognition (CVPR), Providence, RI, USA Geiger A, Lenz P, Urtasun R (2012) Are we ready for autonomous driving? The KITTI vision benchmark suite, computer vision and pattern recognition (CVPR), Providence, RI, USA
go back to reference Hirschmüller H (2008) Stereo processing by semi-global matching and mutual information. IEEE Trans Pattern Anal Mach Intell 30(2):328–341CrossRef Hirschmüller H (2008) Stereo processing by semi-global matching and mutual information. IEEE Trans Pattern Anal Mach Intell 30(2):328–341CrossRef
go back to reference Hirschmüller H, Gehrig S (2009) Stereo matching in the presence of sub-pixel calibration errors. Computer vision and pattern recognition (CVPR), Miami, FL, USA Hirschmüller H, Gehrig S (2009) Stereo matching in the presence of sub-pixel calibration errors. Computer vision and pattern recognition (CVPR), Miami, FL, USA
go back to reference Hirschmüller H, Scharstein D (2009) Evaluation of stereo matching costs on images with radiometric differences. IEEE Trans Pattern Anal Mach Intell 31(9):1582–1599CrossRef Hirschmüller H, Scharstein D (2009) Evaluation of stereo matching costs on images with radiometric differences. IEEE Trans Pattern Anal Mach Intell 31(9):1582–1599CrossRef
go back to reference Meister S, Jähne B, Kondermann D (2012) Outdoor stereo camera system for the generation of real-world benchmark data sets. J Opt Eng 51(02):021207–1CrossRef Meister S, Jähne B, Kondermann D (2012) Outdoor stereo camera system for the generation of real-world benchmark data sets. J Opt Eng 51(02):021207–1CrossRef
go back to reference Moosmann F, Triggs B, Jurie F (2007) Fast discriminative visual codebooks using randomized clustering forests. In: Bernhard Schölkopf, John C. Platt, Thomas Hoffman (eds) Advances in Neural Information Processing Systems 19, Proceedings of the Twentieth Annual Conference on Neural Information Processing Systems, Vancouver, British Columbia, Canada, December 4-7, 2006. MIT Press 2007, ISBN 0-262-19568-2 Moosmann F, Triggs B, Jurie F (2007) Fast discriminative visual codebooks using randomized clustering forests. In: Bernhard Schölkopf, John C. Platt, Thomas Hoffman (eds) Advances in Neural Information Processing Systems 19, Proceedings of the Twentieth Annual Conference on Neural Information Processing Systems, Vancouver, British Columbia, Canada, December 4-7, 2006. MIT Press 2007, ISBN 0-262-19568-2
go back to reference Mühlmann K, Maier D, Hesser J, Männer R (2001) Calculating dense disparity maps from color stereo images, an efficient implementation. In: Stereo and multi-baseline vision, 2001 (SMBV 2001). Proceedings. IEEE workshop on, Kauai, 9–10 Dec 2001, pp 30–36. IEEE. doi:10.1109/SMBV.2001.988760 Mühlmann K, Maier D, Hesser J, Männer R (2001) Calculating dense disparity maps from color stereo images, an efficient implementation. In: Stereo and multi-baseline vision, 2001 (SMBV 2001). Proceedings. IEEE workshop on, Kauai, 9–10 Dec 2001, pp 30–36. IEEE. doi:10.1109/SMBV.2001.988760
go back to reference Müller T, Rannacher J, Rabe C, Franke U (2011a) Feature- and depth-supported modified total variation optical flow for 3D motion field estimation in real scenes. Computer vision and pattern recognition (CVPR), Colorado Springs, CO, USA Müller T, Rannacher J, Rabe C, Franke U (2011a) Feature- and depth-supported modified total variation optical flow for 3D motion field estimation in real scenes. Computer vision and pattern recognition (CVPR), Colorado Springs, CO, USA
go back to reference Müller T, Rabe C, Rannacher J, Franke U, Mester R (2011b) Illumination-robust dense optical flow using census signatures. In: DAGM symposium, Frankfurt, GerCrossRef Müller T, Rabe C, Rannacher J, Franke U, Mester R (2011b) Illumination-robust dense optical flow using census signatures. In: DAGM symposium, Frankfurt, GerCrossRef
go back to reference Pfeiffer D, Franke U (2011) Towards a global optimal multi-layer stixel representation of dense 3D data. In: British machine vision conference (BMVC), Dundee, UK Pfeiffer D, Franke U (2011) Towards a global optimal multi-layer stixel representation of dense 3D data. In: British machine vision conference (BMVC), Dundee, UK
go back to reference Rabe C, Müller T, Wedel A, Franke U (2010) Dense, robust, and accurate motion field estimation from stereo sequences in real-time. In: European conference on computer vision (ECCV), Heraklion, Gr Rabe C, Müller T, Wedel A, Franke U (2010) Dense, robust, and accurate motion field estimation from stereo sequences in real-time. In: European conference on computer vision (ECCV), Heraklion, Gr
go back to reference Scharstein D, Szeliski R (2002) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vis (IJCV) 47(1):7–42, KluwerCrossRefMATH Scharstein D, Szeliski R (2002) A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. Int J Comput Vis (IJCV) 47(1):7–42, KluwerCrossRefMATH
go back to reference Scharwächter T, Enzweiler M, Franke U, Roth S (2013) Efficient multi-cue scene segmentation. In: DAGM symposium, SaarbrückenCrossRef Scharwächter T, Enzweiler M, Franke U, Roth S (2013) Efficient multi-cue scene segmentation. In: DAGM symposium, SaarbrückenCrossRef
go back to reference Shi J, Tomasi C (1994) Good features to track. Computer vision and pattern recognition (CVPR), Seattle Shi J, Tomasi C (1994) Good features to track. Computer vision and pattern recognition (CVPR), Seattle
go back to reference Shimizu M, Okutomi M (2001) Precise sub-pixel estimation on area-based matching. In: International conference on computer vision (ICCV), Vancouver, CA Shimizu M, Okutomi M (2001) Precise sub-pixel estimation on area-based matching. In: International conference on computer vision (ICCV), Vancouver, CA
go back to reference Stein F (2004) Efficient computation of optical flow. In: DAGM symposium, Tuebingen, Ger Stein F (2004) Efficient computation of optical flow. In: DAGM symposium, Tuebingen, Ger
go back to reference Tappen M, Freeman W (2003) Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters. In: International conference on computer vision (ICCV), Nice, Fr Tappen M, Freeman W (2003) Comparison of graph cuts with belief propagation for stereo, using identical MRF parameters. In: International conference on computer vision (ICCV), Nice, Fr
go back to reference Vogel C, Roth S, Schindler K (2013) Piecewise rigid scene flow. In: International conference on computer vision (ICCV), Sydney, AUS Vogel C, Roth S, Schindler K (2013) Piecewise rigid scene flow. In: International conference on computer vision (ICCV), Sydney, AUS
go back to reference Yamaguchi K, McAllester D, Urtasun R (2013) Robust monocular epipolar flow estimation. Computer vision and pattern recognition (CVPR), Portland, OR, USA Yamaguchi K, McAllester D, Urtasun R (2013) Robust monocular epipolar flow estimation. Computer vision and pattern recognition (CVPR), Portland, OR, USA
go back to reference Zach C, Pock T, Bischof H (2007) A duality based approach for realtime TV-L1 optical flow. In: DAGM symposium, Heidelberg, Ger Zach C, Pock T, Bischof H (2007) A duality based approach for realtime TV-L1 optical flow. In: DAGM symposium, Heidelberg, Ger
Metadata
Title
Stereovision for ADAS
Authors
Stefan Gehrig
Uwe Franke
Copyright Year
2016
Publisher
Springer International Publishing
DOI
https://doi.org/10.1007/978-3-319-12352-3_22

Premium Partner