Skip to main content
Top

2019 | OriginalPaper | Chapter

Evaluation of Iterative Calibration of Vehicle Cameras Using Reference Information from Traffic Signs

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Intrinsic camera parameters can be estimated by camera calibration using multiple images of a priori known reference points on a test field. In particular during driving, vehicle cameras might be exposed to mechanical and thermal effects, leading to a change of these parameters over time and making iterative camera calibration useful to correct for these changes. As on roads no special test fields are available, reference information has to be extracted from road scene images. In this contribution, a method for iterative calibration of a vehicle camera using references on traffic signs is proposed. The references are obtained from the shape of traffic signs detected in road scene images, exploiting that the shape is known a priori. A test with a road scene image sequence acquired during a test drive in a car park equipped with traffic signs shows no decrease in the standard deviation of the parameters iteratively estimated with the proposed method compared to test field calibration.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference Mende, R., Rohling, H.: New automotive applications for smart radar systems (2002) Mende, R., Rohling, H.: New automotive applications for smart radar systems (2002)
4.
go back to reference Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2012) Geiger, A., Lenz, P., Urtasun, R.: Are we ready for autonomous driving? The KITTI vision benchmark suite. In: Conference on Computer Vision and Pattern Recognition (CVPR) (2012)
6.
go back to reference Lemaire, T., Berger, C., Jung, I.K., Lacroix, S.: Vision-based slam: stereo and monocular approaches. Int. J. Comput. Vis. 74, 343 (2007)CrossRef Lemaire, T., Berger, C., Jung, I.K., Lacroix, S.: Vision-based slam: stereo and monocular approaches. Int. J. Comput. Vis. 74, 343 (2007)CrossRef
7.
go back to reference Uhrig, J., Schneider, N., Schneider, L., Franke, U., Brox, T., Geiger, A.: Sparsity invariant CNNs. In: International Conference on 3D Vision (3DV) 2017 (2017) Uhrig, J., Schneider, N., Schneider, L., Franke, U., Brox, T., Geiger, A.: Sparsity invariant CNNs. In: International Conference on 3D Vision (3DV) 2017 (2017)
8.
go back to reference Heyden, A., Astrom, K.: Euclidean reconstruction from constant intrinsic parameters. In: Proceedings of 13th International Conference on Pattern Recognition, vol. 1, pp. 339–343 (1996) Heyden, A., Astrom, K.: Euclidean reconstruction from constant intrinsic parameters. In: Proceedings of 13th International Conference on Pattern Recognition, vol. 1, pp. 339–343 (1996)
10.
go back to reference Hanel, A., et al.: Metric scale calculation for visual mapping algorithms. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (2018)CrossRef Hanel, A., et al.: Metric scale calculation for visual mapping algorithms. In: The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (2018)CrossRef
11.
go back to reference Luhmann, T., Robson, S., Kyle, S., Harley, I.: Close Range Photogrammetry. Principles, Methods and Applications. Whittles Publishing (2006) Luhmann, T., Robson, S., Kyle, S., Harley, I.: Close Range Photogrammetry. Principles, Methods and Applications. Whittles Publishing (2006)
12.
go back to reference Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge Books Online. Cambridge University Press, Cambridge (2003)MATH Hartley, R., Zisserman, A.: Multiple View Geometry in Computer Vision. Cambridge Books Online. Cambridge University Press, Cambridge (2003)MATH
13.
go back to reference Brown, D.C.: Close-range camera calibration. Photogramm. Eng. 37, 855–866 (1971) Brown, D.C.: Close-range camera calibration. Photogramm. Eng. 37, 855–866 (1971)
14.
go back to reference El-Hakim, S.: Real-time image metrology with CCD cameras. Photogramm. Eng. Remote. Sens. 52, 1757–1766 (1986) El-Hakim, S.: Real-time image metrology with CCD cameras. Photogramm. Eng. Remote. Sens. 52, 1757–1766 (1986)
15.
go back to reference Fraser, C.S., Shortis, M.R.: Variation of distortion within the photographic field. Photogramm. Eng. Remote. Sens. 58, 851–855 (1992) Fraser, C.S., Shortis, M.R.: Variation of distortion within the photographic field. Photogramm. Eng. Remote. Sens. 58, 851–855 (1992)
16.
go back to reference Heng, L., Li, B., Pollefeys, M.: CamOdoCal: automatic intrinsic and extrinsic calibration of a rig with multiple generic cameras and odometry. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1793–1800. IEEE (2013) Heng, L., Li, B., Pollefeys, M.: CamOdoCal: automatic intrinsic and extrinsic calibration of a rig with multiple generic cameras and odometry. In: IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 1793–1800. IEEE (2013)
17.
go back to reference Friel, M., Savage, D.A., Hughes, C., Ermilios, P.: Online vehicle camera calibration based on road surface texture tracking and geometric properties. Patent (2012) Friel, M., Savage, D.A., Hughes, C., Ermilios, P.: Online vehicle camera calibration based on road surface texture tracking and geometric properties. Patent (2012)
18.
go back to reference Hanel, A., Stilla, U.: Structure-from-motion for calibration of a vehicle camera system with non-overlapping fields-of-view in an urban environment. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. 42, 181–188 (2017)CrossRef Hanel, A., Stilla, U.: Structure-from-motion for calibration of a vehicle camera system with non-overlapping fields-of-view in an urban environment. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. 42, 181–188 (2017)CrossRef
20.
go back to reference Thatcham Research and ADAS Repair Group: Code of Practice For the Replacement & Refitting of Automotive Glazing for vehicles fitted with screen mounted Advanced Driver Assistance Systems (ADAS) (2016) Thatcham Research and ADAS Repair Group: Code of Practice For the Replacement & Refitting of Automotive Glazing for vehicles fitted with screen mounted Advanced Driver Assistance Systems (ADAS) (2016)
21.
go back to reference Broggi, A., Bertozzi, M., Fascioli, A.: Self-calibration of a stereo vision system for automotive applications. In: Proceedings of the 2001 IEEE International Conference on Robotics and Automation, vol. 4, pp. 3698–3703 (2001) Broggi, A., Bertozzi, M., Fascioli, A.: Self-calibration of a stereo vision system for automotive applications. In: Proceedings of the 2001 IEEE International Conference on Robotics and Automation, vol. 4, pp. 3698–3703 (2001)
22.
go back to reference Bellino, M., Holzmann, F., Kolski, S., de Meneses, Y.L., Jacot, J.: Calibration of an embedded camera for driver-assistant systems. In: Proceedings of the 2005 IEEE Intelligent Transportation Systems, 2005, pp. 354–359 (2005) Bellino, M., Holzmann, F., Kolski, S., de Meneses, Y.L., Jacot, J.: Calibration of an embedded camera for driver-assistant systems. In: Proceedings of the 2005 IEEE Intelligent Transportation Systems, 2005, pp. 354–359 (2005)
23.
go back to reference Ribeiro, A.A.G.A., Dihl, L.L., Jung, C.R.: Automatic camera calibration for driver assistance systems. In: Proceeedings of 13th International Conference on Systems, Signals and Image Processing, pp. 173–176 (2006) Ribeiro, A.A.G.A., Dihl, L.L., Jung, C.R.: Automatic camera calibration for driver assistance systems. In: Proceeedings of 13th International Conference on Systems, Signals and Image Processing, pp. 173–176 (2006)
24.
go back to reference Hanel, A., Hoegner, L., Stilla, U.: Towards the influence of a car windshield on depth calculation with a stereo camera system. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. 41, 461–468 (2016)CrossRef Hanel, A., Hoegner, L., Stilla, U.: Towards the influence of a car windshield on depth calculation with a stereo camera system. Int. Arch. Photogramm. Remote. Sens. Spat. Inf. Sci. 41, 461–468 (2016)CrossRef
25.
go back to reference Hella Gutmann Solutions GmbH: CSC-Tool. Operating Instructions (2016) Hella Gutmann Solutions GmbH: CSC-Tool. Operating Instructions (2016)
26.
go back to reference Paula, M.D., Jung, C., Silveira, L.D.: Automatic on-the-fly extrinsic camera calibration of onboard vehicular cameras. Expert. Syst. Appl. Int. J. 41, 1997–2007 (2014)CrossRef Paula, M.D., Jung, C., Silveira, L.D.: Automatic on-the-fly extrinsic camera calibration of onboard vehicular cameras. Expert. Syst. Appl. Int. J. 41, 1997–2007 (2014)CrossRef
27.
go back to reference Department of Transport - Ireland: Traffic Signs Manual (2010) Department of Transport - Ireland: Traffic Signs Manual (2010)
31.
go back to reference Dang, T., Hoffmann, C., Stiller, C.: Continuous stereo self-calibration by camera parameter tracking. IEEE Trans. Image Process. 18, 1536–1550 (2009)MathSciNetCrossRef Dang, T., Hoffmann, C., Stiller, C.: Continuous stereo self-calibration by camera parameter tracking. IEEE Trans. Image Process. 18, 1536–1550 (2009)MathSciNetCrossRef
32.
go back to reference Smith, M.J., Cope, E.: The effects of temperature variation on single-lens-reflex digital camera calibration parameters. In: International Archives of Photogrammetry, Remote Sensing and Spatial Information Science, vol. XXXVIII, pp. 554–559 (2010) Smith, M.J., Cope, E.: The effects of temperature variation on single-lens-reflex digital camera calibration parameters. In: International Archives of Photogrammetry, Remote Sensing and Spatial Information Science, vol. XXXVIII, pp. 554–559 (2010)
33.
go back to reference Luhmann, T., Robson, S., Kyle, S., Boehm, J.: Close-range Photogrammetry and 3D Imaging. De Gruyter Textbook. De Gruyter, Berlin (2013)CrossRef Luhmann, T., Robson, S., Kyle, S., Boehm, J.: Close-range Photogrammetry and 3D Imaging. De Gruyter Textbook. De Gruyter, Berlin (2013)CrossRef
34.
go back to reference Hastedt, H., Ekkel, T., Luhmann, T.: Evaluation of the quality of action cameras with wide-angle lenses in uav photogrammetry. In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XL-1/W4 (2016)CrossRef Hastedt, H., Ekkel, T., Luhmann, T.: Evaluation of the quality of action cameras with wide-angle lenses in uav photogrammetry. In: International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences, vol. XL-1/W4 (2016)CrossRef
36.
go back to reference Wu, Y., Liu, Y., Li, J., Liu, H., Hu, X.: Traffic sign detection based on convolutional neural networks. In: The 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–7 (2013) Wu, Y., Liu, Y., Li, J., Liu, H., Hu, X.: Traffic sign detection based on convolutional neural networks. In: The 2013 International Joint Conference on Neural Networks (IJCNN), pp. 1–7 (2013)
37.
go back to reference Zhu, Z., Liang, D., Zhang, S., Huang, X., Li, B., Hu, S.: Traffic-sign detection and classification in the wild. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2110–2118 (2016) Zhu, Z., Liang, D., Zhang, S., Huang, X., Li, B., Hu, S.: Traffic-sign detection and classification in the wild. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2110–2118 (2016)
38.
go back to reference Lecun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998)CrossRef Lecun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998)CrossRef
39.
go back to reference Comaschi, F., Stuijk, S., Basten, T., Corporaal, H.: RASW: a run-time adaptive sliding window to improve Viola-Jones object detection. In: 2013 Seventh International Conference on Distributed Smart Cameras (ICDSC), pp. 1–6 (2013) Comaschi, F., Stuijk, S., Basten, T., Corporaal, H.: RASW: a run-time adaptive sliding window to improve Viola-Jones object detection. In: 2013 Seventh International Conference on Distributed Smart Cameras (ICDSC), pp. 1–6 (2013)
40.
go back to reference Fukunaga, K., Hostetler, L.: The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans. Inf. Theory 21, 32–40 (1975)MathSciNetCrossRef Fukunaga, K., Hostetler, L.: The estimation of the gradient of a density function, with applications in pattern recognition. IEEE Trans. Inf. Theory 21, 32–40 (1975)MathSciNetCrossRef
42.
go back to reference Suzuki, S., Abe, K.: Topological structural analysis of digitized binary images by border following. Comput. Vis. Graph. Image Process. 30, 32–46 (1985)CrossRef Suzuki, S., Abe, K.: Topological structural analysis of digitized binary images by border following. Comput. Vis. Graph. Image Process. 30, 32–46 (1985)CrossRef
43.
go back to reference Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)MathSciNetCrossRef Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)MathSciNetCrossRef
44.
go back to reference Soilán, M., Riveiro, B., Martínez-Sánchez, J., Arias, P.: Traffic sign detection in MLS acquired point clouds for geometric and image-based semantic inventory. ISPRS J. Photogramm. Remote. Sens. 114, 92–101 (2016)CrossRef Soilán, M., Riveiro, B., Martínez-Sánchez, J., Arias, P.: Traffic sign detection in MLS acquired point clouds for geometric and image-based semantic inventory. ISPRS J. Photogramm. Remote. Sens. 114, 92–101 (2016)CrossRef
45.
go back to reference Schneider, C.T., Boesemann, W., Godding, R.: AICON 3D systems GmbH (2014) Schneider, C.T., Boesemann, W., Godding, R.: AICON 3D systems GmbH (2014)
46.
go back to reference Stallkamp, J., Schlipsing, M., Salmen, J., Igel, C.: Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition. Neural Netw. 32, 323–332 (2012). Selected Papers from IJCNN 2011CrossRef Stallkamp, J., Schlipsing, M., Salmen, J., Igel, C.: Man vs. computer: benchmarking machine learning algorithms for traffic sign recognition. Neural Netw. 32, 323–332 (2012). Selected Papers from IJCNN 2011CrossRef
47.
go back to reference Houben, S., Stallkamp, J., Salmen, J., Schlipsing, M., Igel, C.: Detection of traffic signs in real-world images: the German traffic sign detection benchmark. In: International Joint Conference on Neural Networks. Number 1288 (2013) Houben, S., Stallkamp, J., Salmen, J., Schlipsing, M., Igel, C.: Detection of traffic signs in real-world images: the German traffic sign detection benchmark. In: International Joint Conference on Neural Networks. Number 1288 (2013)
48.
go back to reference Hanel, A., Stilla, U.: Iterative calibration of a vehicle camera using traffic signs detected by a convolutional neural network. In: Proceedings of the 3rd International Conference on Vehicle Technology and Intelligent Transport Systems (2018) Hanel, A., Stilla, U.: Iterative calibration of a vehicle camera using traffic signs detected by a convolutional neural network. In: Proceedings of the 3rd International Conference on Vehicle Technology and Intelligent Transport Systems (2018)
49.
go back to reference Cordts, M., et al.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016) Cordts, M., et al.: The cityscapes dataset for semantic urban scene understanding. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2016)
Metadata
Title
Evaluation of Iterative Calibration of Vehicle Cameras Using Reference Information from Traffic Signs
Authors
Alexander Hanel
Uwe Stilla
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-26633-2_12

Premium Partner