Skip to main content

2019 | OriginalPaper | Buchkapitel

Evaluation of Iterative Calibration of Vehicle Cameras Using Reference Information from Traffic Signs

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Intrinsic camera parameters can be estimated by camera calibration using multiple images of a priori known reference points on a test field. In particular during driving, vehicle cameras might be exposed to mechanical and thermal effects, leading to a change of these parameters over time and making iterative camera calibration useful to correct for these changes. As on roads no special test fields are available, reference information has to be extracted from road scene images. In this contribution, a method for iterative calibration of a vehicle camera using references on traffic signs is proposed. The references are obtained from the shape of traffic signs detected in road scene images, exploiting that the shape is known a priori. A test with a road scene image sequence acquired during a test drive in a car park equipped with traffic signs shows no decrease in the standard deviation of the parameters iteratively estimated with the proposed method compared to test field calibration.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
3.
Zurück zum Zitat Mende, R., Rohling, H.: New automotive applications for smart radar systems (2002) Mende, R., Rohling, H.: New automotive applications for smart radar systems (2002)
4.
Zurück zum Zitat Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2012) Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2012)
6.
Zurück zum Zitat Lemaire, T., Berger, C., Jung, I.K., Lacroix, S.: Vision-based slam: stereo and monocular approaches. Int. J. Comput. Vis. 74, 343 (2007)CrossRef Lemaire, T., Berger, C., Jung, I.K., Lacroix, S.: Vision-based slam: stereo and monocular approaches. Int. J. Comput. Vis. 74, 343 (2007)CrossRef
7.
Zurück zum Zitat Uhrig, J., Schneider, N., Schneider, L., Franke, U., Brox, T., Geiger, A.: Sparsity invariant CNNs. In: International Conference on 3D Vision (3DV) 2017 (2017) Uhrig, J., Schneider, N., Schneider, L., Franke, U., Brox, T., Geiger, A.: Sparsity invariant CNNs. In: International Conference on 3D Vision (3DV) 2017 (2017)
8.
Zurück zum Zitat Heyden, A., Astrom, K.: Euclidean reconstruction from constant intrinsic parameters. In: Proceedings of 13th International Conference on Pattern Recognition, vol. 1, pp. 339–343 (1996) Heyden, A., Astrom, K.: Euclidean reconstruction from constant intrinsic parameters. In: Proceedings of 13th International Conference on Pattern Recognition, vol. 1, pp. 339–343 (1996)
10.
Zurück zum Zitat Hanel, A., et al.: Metric scale calculation for visual mapping algorithms. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (2018)CrossRef Hanel, A., et al.: Metric scale calculation for visual mapping algorithms. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (2018)CrossRef
11.
Zurück zum Zitat Luhmann, T., Robson, S., Kyle, S., Harley, I.: Close Range Photogrammetry. Principles, Methods and Applications. Whittles Publishing (2006) Luhmann, T., Robson, S., Kyle, S., Harley, I.: Close Range Photogrammetry. Principles, Methods and Applications. Whittles Publishing (2006)
12.
Zurück zum Zitat Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge Books Online. Cambridge University Press, Cambridge (2003)MATH Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge Books Online. Cambridge University Press, Cambridge (2003)MATH
13.
Zurück zum Zitat Brown, D.C.: Close-range camera calibration. Photogramm. Eng. 37, 855–866 (1971) Brown, D.C.: Close-range camera calibration. Photogramm. Eng. 37, 855–866 (1971)
14.
Zurück zum Zitat El-Hakim, S.: Real-time image metrology with CCD cameras. Photogramm. Eng. Remote. Sens. 52, 1757–1766 (1986) El-Hakim, S.: Real-time image metrology with CCD cameras. Photogramm. Eng. Remote. Sens. 52, 1757–1766 (1986)
15.
Zurück zum Zitat Fraser, C.S., Shortis, M.R.: Variation of distortion within the photographic field. Photogramm. Eng. Remote. Sens. 58, 851–855 (1992) Fraser, C.S., Shortis, M.R.: Variation of distortion within the photographic field. Photogramm. Eng. Remote. Sens. 58, 851–855 (1992)
16.
Zurück zum Zitat Heng, L., Li, B., Pollefeys, M.: CamOdoCal: automatic intrinsic and extrinsic calibration of a rig with multiple generic cameras and odometry. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1793–1800. IEEE (2013) Heng, L., Li, B., Pollefeys, M.: CamOdoCal: automatic intrinsic and extrinsic calibration of a rig with multiple generic cameras and odometry. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1793–1800. IEEE (2013)
17.
Zurück zum Zitat Friel, M., Savage, D.A., Hughes, C., Ermilios, P.: Online vehicle camera calibration based on road surface texture tracking and geometric properties. Patent (2012) Friel, M., Savage, D.A., Hughes, C., Ermilios, P.: Online vehicle camera calibration based on road surface texture tracking and geometric properties. Patent (2012)
18.
Zurück zum Zitat Hanel, A., Stilla, U.: Structure-from-motion for calibration of a vehicle camera system with non-overlapping fields-of-view in an urban environment. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. 42, 181–188 (2017)CrossRef Hanel, A., Stilla, U.: Structure-from-motion for calibration of a vehicle camera system with non-overlapping fields-of-view in an urban environment. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. 42, 181–188 (2017)CrossRef
20.
Zurück zum Zitat Thatcham Research and ADAS Repair Group: Code of Practice For the Replacement & Refitting of Automotive Glazing for vehicles fitted with screen mounted Advanced Driver Assistance Systems (ADAS) (2016) Thatcham Research and ADAS Repair Group: Code of Practice For the Replacement & Refitting of Automotive Glazing for vehicles fitted with screen mounted Advanced Driver Assistance Systems (ADAS) (2016)
21.
Zurück zum Zitat Broggi, A., Bertozzi, M., Fascioli, A.: Self-calibration of a stereo vision system for automotive applications. In: Proceedings of the 2001 IEEE International Conference on Robotics and Automation, vol. 4, pp. 3698–3703 (2001) Broggi, A., Bertozzi, M., Fascioli, A.: Self-calibration of a stereo vision system for automotive applications. In: Proceedings of the 2001 IEEE International Conference on Robotics and Automation, vol. 4, pp. 3698–3703 (2001)
22.
Zurück zum Zitat Bellino, M., Holzmann, F., Kolski, S., de Meneses, Y.L., Jacot, J.: Calibration of an embedded camera for driver-assistant systems. In: Proceedings of the 2005 IEEE Intelligent Transportation Systems, 2005, pp. 354–359 (2005) Bellino, M., Holzmann, F., Kolski, S., de Meneses, Y.L., Jacot, J.: Calibration of an embedded camera for driver-assistant systems. In: Proceedings of the 2005 IEEE Intelligent Transportation Systems, 2005, pp. 354–359 (2005)
23.
Zurück zum Zitat Ribeiro, A.A.G.A., Dihl, L.L., Jung, C.R.: Automatic camera calibration for driver assistance systems. In: Proceeedings of 13th International Conference on Systems, Signals and Image Processing, pp. 173–176 (2006) Ribeiro, A.A.G.A., Dihl, L.L., Jung, C.R.: Automatic camera calibration for driver assistance systems. In: Proceeedings of 13th International Conference on Systems, Signals and Image Processing, pp. 173–176 (2006)
24.
Zurück zum Zitat Hanel, A., Hoegner, L., Stilla, U.: Towards the influence of a car windshield on depth calculation with a stereo camera system. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. 41, 461–468 (2016)CrossRef Hanel, A., Hoegner, L., Stilla, U.: Towards the influence of a car windshield on depth calculation with a stereo camera system. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. 41, 461–468 (2016)CrossRef
25.
Zurück zum Zitat Hella Gutmann Solutions GmbH: CSC-Tool. Operating Instructions (2016) Hella Gutmann Solutions GmbH: CSC-Tool. Operating Instructions (2016)
26.
Zurück zum Zitat Paula, M.D., Jung, C., Silveira, L.D.: Automatic on-the-fly extrinsic camera calibration of onboard vehicular cameras. Expert. Syst. Appl. Int. J. 41, 1997–2007 (2014)CrossRef Paula, M.D., Jung, C., Silveira, L.D.: Automatic on-the-fly extrinsic camera calibration of onboard vehicular cameras. Expert. Syst. Appl. Int. J. 41, 1997–2007 (2014)CrossRef
27.
Zurück zum Zitat Department of Transport - Ireland: Traffic Signs Manual (2010) Department of Transport - Ireland: Traffic Signs Manual (2010)
31.
Zurück zum Zitat Dang, T., Hoffmann, C., Stiller, C.: Continuous stereo self-calibration by camera parameter tracking. IEEE Trans. Image Process. 18, 1536–1550 (2009)MathSciNetCrossRef Dang, T., Hoffmann, C., Stiller, C.: Continuous stereo self-calibration by camera parameter tracking. IEEE Trans. Image Process. 18, 1536–1550 (2009)MathSciNetCrossRef
32.
Zurück zum Zitat Smith, M.J., Cope, E.: The effects of temperature variation on single-lens-reflex digital camera calibration parameters. In: International Archives of Photogrammetry, Remote Sensing and Spatial Information Science, vol. XXXVIII, pp. 554–559 (2010) Smith, M.J., Cope, E.: The effects of temperature variation on single-lens-reflex digital camera calibration parameters. In: International Archives of Photogrammetry, Remote Sensing and Spatial Information Science, vol. XXXVIII, pp. 554–559 (2010)
33.
Zurück zum Zitat Luhmann, T., Robson, S., Kyle, S., Boehm, J.: Close-range Photogrammetry and 3D Imaging. De Gruyter Textbook. De Gruyter, Berlin (2013)CrossRef Luhmann, T., Robson, S., Kyle, S., Boehm, J.: Close-range Photogrammetry and 3D Imaging. De Gruyter Textbook. De Gruyter, Berlin (2013)CrossRef
34.
Zurück zum Zitat Hastedt, H., Ekkel, T., Luhmann, T.: Evaluation of the quality of action cameras with wide-angle lenses in uav photogrammetry. In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XL-1/W4 (2016)CrossRef Hastedt, H., Ekkel, T., Luhmann, T.: Evaluation of the quality of action cameras with wide-angle lenses in uav photogrammetry. In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XL-1/W4 (2016)CrossRef
36.
Zurück zum Zitat Wu, Y., Liu, Y., Li, J., Liu, H., Hu, X.: Traffic sign detection based on convolutional neural networks. In: The 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–7 (2013) Wu, Y., Liu, Y., Li, J., Liu, H., Hu, X.: Traffic sign detection based on convolutional neural networks. In: The 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–7 (2013)
37.
Zurück zum Zitat Zhu, Z., Liang, D., Zhang, S., Huang, X., Li, B., Hu, S.: Traffic-sign detection and classification in the wild. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2110–2118 (2016) Zhu, Z., Liang, D., Zhang, S., Huang, X., Li, B., Hu, S.: Traffic-sign detection and classification in the wild. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2110–2118 (2016)
38.
Zurück zum Zitat Lecun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998)CrossRef Lecun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998)CrossRef
39.
Zurück zum Zitat Comaschi, F., Stuijk, S., Basten, T., Corporaal, H.: RASW: a run-time adaptive sliding window to improve Viola-Jones object detection. In: 2013 Seventh International Conference on Distributed Smart Cameras (ICDSC), pp. 1–6 (2013) Comaschi, F., Stuijk, S., Basten, T., Corporaal, H.: RASW: a run-time adaptive sliding window to improve Viola-Jones object detection. In: 2013 Seventh International Conference on Distributed Smart Cameras (ICDSC), pp. 1–6 (2013)
40.
Zurück zum Zitat Fukunaga, K., Hostetler, L.: The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans. Inf. Theory 21, 32–40 (1975)MathSciNetCrossRef Fukunaga, K., Hostetler, L.: The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans. Inf. Theory 21, 32–40 (1975)MathSciNetCrossRef
42.
Zurück zum Zitat Suzuki, S., Abe, K.: Topological structural analysis of digitized binary images by border following. Comput. Vis. Graph. Image Process. 30, 32–46 (1985)CrossRef Suzuki, S., Abe, K.: Topological structural analysis of digitized binary images by border following. Comput. Vis. Graph. Image Process. 30, 32–46 (1985)CrossRef
43.
Zurück zum Zitat Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)MathSciNetCrossRef Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)MathSciNetCrossRef
44.
Zurück zum Zitat Soilán, M., Riveiro, B., Martínez-Sánchez, J., Arias, P.: Traffic sign detection in MLS acquired point clouds for geometric and image-based semantic inventory. ISPRS J. Photogramm. Remote. Sens. 114, 92–101 (2016)CrossRef Soilán, M., Riveiro, B., Martínez-Sánchez, J., Arias, P.: Traffic sign detection in MLS acquired point clouds for geometric and image-based semantic inventory. ISPRS J. Photogramm. Remote. Sens. 114, 92–101 (2016)CrossRef
45.
Zurück zum Zitat Schneider, C.T., Boesemann, W., Godding, R.: AICON 3D systems GmbH (2014) Schneider, C.T., Boesemann, W., Godding, R.: AICON 3D systems GmbH (2014)
46.
Zurück zum Zitat Stallkamp, J., Schlipsing, M., Salmen, J., Igel, C.: Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition. Neural Netw. 32, 323–332 (2012). Selected Papers from IJCNN 2011CrossRef Stallkamp, J., Schlipsing, M., Salmen, J., Igel, C.: Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition. Neural Netw. 32, 323–332 (2012). Selected Papers from IJCNN 2011CrossRef
47.
Zurück zum Zitat Houben, S., Stallkamp, J., Salmen, J., Schlipsing, M., Igel, C.: Detection of traffic signs in real-world images: the German traffic sign detection benchmark. In: International Joint Conference on Neural Networks. Number 1288 (2013) Houben, S., Stallkamp, J., Salmen, J., Schlipsing, M., Igel, C.: Detection of traffic signs in real-world images: the German traffic sign detection benchmark. In: International Joint Conference on Neural Networks. Number 1288 (2013)
48.
Zurück zum Zitat Hanel, A., Stilla, U.: Iterative calibration of a vehicle camera using traffic signs detected by a convolutional neural network. In: Proceedings of the 3rd International Conference on Vehicle Technology and Intelligent Transport Systems (2018) Hanel, A., Stilla, U.: Iterative calibration of a vehicle camera using traffic signs detected by a convolutional neural network. In: Proceedings of the 3rd International Conference on Vehicle Technology and Intelligent Transport Systems (2018)
49.
Zurück zum Zitat Cordts, M., et al.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016) Cordts, M., et al.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)
Metadaten
Titel
Evaluation of Iterative Calibration of Vehicle Cameras Using Reference Information from Traffic Signs
verfasst von
Alexander Hanel
Uwe Stilla
Copyright-Jahr
2019
DOI
https://doi.org/10.1007/978-3-030-26633-2_12