Skip to main content
Top

2018 | OriginalPaper | Chapter

Virtual Environment for Training Autonomous Vehicles

Authors : Jerome Leudet, Tommi Mikkonen, François Christophe, Tomi Männistö

Published in: Towards Autonomous Robotic Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Driver assistance and semi-autonomous features are regularly added to commercial vehicles with two key stakes: collecting data for training self-driving algorithms, and using these vehicles as testbeds for these algorithms. Due to the nature of algorithms used in autonomous vehicles, their behavior in unknown situation is not fully predictable. This calls for extensive testing. In this paper, we propose to use a virtual environment for both testing algorithms for autonomous vehicles and acquiring simulated data for their training. The benefit of this environment is to able to train algorithms with realistic simulated sensor data before their deployment in real life. To this end, the proposed virtual environment has the capacity to generate similar data than real sensors (e.g. cameras, LiDar, ...). After reviewing state-of-the-art techniques and datasets available for the automotive industry, we identify that dynamic data generated on-demand is needed to improve the current results in training autonomous vehicles. Our proposition describes the benefits a virtual environment brings in improving the development, quality and confidence in the algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ackerman, E., Pratt, G.: Toyota’s Gill Pratt on Self-Driving Cars and the Reality of Full Autonomy. IEEE Spectrum (2017) Ackerman, E., Pratt, G.: Toyota’s Gill Pratt on Self-Driving Cars and the Reality of Full Autonomy. IEEE Spectrum (2017)
2.
go back to reference Brock, A., Lim, T., Ritchie, J.M., Weston, N.: FreezeOut: accelerate training by progressively freezing layers (2017) Brock, A., Lim, T., Ritchie, J.M., Weston, N.: FreezeOut: accelerate training by progressively freezing layers (2017)
3.
go back to reference Brostow, G.J., Fauqueur, J., Cipolla, R.: Semantic object classes in video: a high-definition ground truth database. Pattern Recogn. Lett. 30(2), 88–97 (2009)CrossRef Brostow, G.J., Fauqueur, J., Cipolla, R.: Semantic object classes in video: a high-definition ground truth database. Pattern Recogn. Lett. 30(2), 88–97 (2009)CrossRef
4.
go back to reference Contestabile, M., Alajaji, M., Almubarak, B.: Will current electric vehicle policy lead to cost-effective electrification of passenger car transport? Energy Policy 110, 20–30 (2017)CrossRef Contestabile, M., Alajaji, M., Almubarak, B.: Will current electric vehicle policy lead to cost-effective electrification of passenger car transport? Energy Policy 110, 20–30 (2017)CrossRef
5.
go back to reference Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., Schiele, B.: The Cityscapes dataset for semantic urban scene understanding. In: CVPR, pp. 3213–3223 (2016) Cordts, M., Omran, M., Ramos, S., Rehfeld, T., Enzweiler, M., Benenson, R., Franke, U., Roth, S., Schiele, B.: The Cityscapes dataset for semantic urban scene understanding. In: CVPR, pp. 3213–3223 (2016)
6.
go back to reference Cutler, M., Walsh, T.J., How, J.P.: Real-world reinforcement learning via multifidelity simulators. IEEE Trans. Robot. 31(3), 655–671 (2015)CrossRef Cutler, M., Walsh, T.J., How, J.P.: Real-world reinforcement learning via multifidelity simulators. IEEE Trans. Robot. 31(3), 655–671 (2015)CrossRef
7.
go back to reference Geiger, A., Lenz, P., Stiller, C., Urtasun, R.: Vision meets robotics: the KITTI dataset. Int. J. Robot. Res. 32(11), 1231–1237 (2013)CrossRef Geiger, A., Lenz, P., Stiller, C., Urtasun, R.: Vision meets robotics: the KITTI dataset. Int. J. Robot. Res. 32(11), 1231–1237 (2013)CrossRef
8.
go back to reference He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. Arxiv.Org 7(3), 171–180 (2015) He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. Arxiv.Org 7(3), 171–180 (2015)
9.
go back to reference Janai, J., Güney, F., Behl, A., Geiger, A.: Computer vision for autonomous vehicles: problems, datasets and state-of-the-art (2017) Janai, J., Güney, F., Behl, A., Geiger, A.: Computer vision for autonomous vehicles: problems, datasets and state-of-the-art (2017)
10.
go back to reference Johnson-Roberson, M., Barto, C., Mehta, R., Sridhar, S.N., Rosaen, K., Vasudevan, R.: Driving in the matrix: can virtual worlds replace human-generated annotations for real world tasks? (2016) Johnson-Roberson, M., Barto, C., Mehta, R., Sridhar, S.N., Rosaen, K., Vasudevan, R.: Driving in the matrix: can virtual worlds replace human-generated annotations for real world tasks? (2016)
11.
go back to reference Klambauer, G., Unterthiner, T., Mayr, A., Hochreiter, S.: Self-Normalizing Neural Networks (2017) Klambauer, G., Unterthiner, T., Mayr, A., Hochreiter, S.: Self-Normalizing Neural Networks (2017)
12.
go back to reference Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1–9 (2012) Krizhevsky, A., Sutskever, I., Hinton, G.E.: ImageNet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1–9 (2012)
13.
go back to reference Leibo, J.Z., Liao, Q., Poggio, T.: Subtasks of unconstrained face recognition. In: International Joint Conference on Computer Vision Theory and Applications, pp. 1–9 (2013) Leibo, J.Z., Liao, Q., Poggio, T.: Subtasks of unconstrained face recognition. In: International Joint Conference on Computer Vision Theory and Applications, pp. 1–9 (2013)
14.
go back to reference Maddern, W., Pascoe, G., Linegar, C., Newman, P.: 1 year, 1000 km: the Oxford Robotcar dataset. Int. J. Robot. Res. 36, 3–15 (2016)CrossRef Maddern, W., Pascoe, G., Linegar, C., Newman, P.: 1 year, 1000 km: the Oxford Robotcar dataset. Int. J. Robot. Res. 36, 3–15 (2016)CrossRef
15.
go back to reference Muoio, D.: These 19 companies are racing to build self-driving cars in the next 5 years. Business Insider Nordic (2017) Muoio, D.: These 19 companies are racing to build self-driving cars in the next 5 years. Business Insider Nordic (2017)
16.
go back to reference Palmer, K., Tate, J.E., Wadud, Z., Nellthorp, J.: Total cost of ownership and market share for hybrid and electric vehicles in the UK, US and Japan. Appl. Energy 209, 108–119 (2018)CrossRef Palmer, K., Tate, J.E., Wadud, Z., Nellthorp, J.: Total cost of ownership and market share for hybrid and electric vehicles in the UK, US and Japan. Appl. Energy 209, 108–119 (2018)CrossRef
17.
go back to reference Ros, G., Sellart, L., Materzynska, J., Vazquez, D., Lopez, A.M.: The SYNTHIA dataset: a large collection of synthetic images for semantic segmentation of urban scenes (2016) Ros, G., Sellart, L., Materzynska, J., Vazquez, D., Lopez, A.M.: The SYNTHIA dataset: a large collection of synthetic images for semantic segmentation of urban scenes (2016)
18.
go back to reference Ros, G., Sellart, L., Materzynska, J., Vazquez, D., Lopez, A.M.: The SYNTHIA dataset: a large collection of synthetic images for semantic segmentation of urban scenes. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3234–3243. IEEE (2016) Ros, G., Sellart, L., Materzynska, J., Vazquez, D., Lopez, A.M.: The SYNTHIA dataset: a large collection of synthetic images for semantic segmentation of urban scenes. In: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3234–3243. IEEE (2016)
19.
go back to reference Ros, G., Stent, S., Alcantarilla, P.F., Watanabe, T.: Training constrained deconvolutional networks for road scene semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (2016) Ros, G., Stent, S., Alcantarilla, P.F., Watanabe, T.: Training constrained deconvolutional networks for road scene semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (2016)
20.
go back to reference SAE: Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. Glob. Ground Veh. Stand. (J3016), 30 (2016) SAE: Taxonomy and definitions for terms related to driving automation systems for on-road motor vehicles. Glob. Ground Veh. Stand. (J3016), 30 (2016)
21.
go back to reference Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations (ICRL), pp. 1–14 (2015) Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. In: International Conference on Learning Representations (ICRL), pp. 1–14 (2015)
22.
go back to reference Singh, S.: Critical reasons for crashes investigated in the national motor vehicle crash causation survey. Technical report, Department of Transportation - NHTSAs National Center for Statistics and Analysis, Washington, DC, USA (2015) Singh, S.: Critical reasons for crashes investigated in the national motor vehicle crash causation survey. Technical report, Department of Transportation - NHTSAs National Center for Statistics and Analysis, Washington, DC, USA (2015)
23.
go back to reference Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–1958 (2014)MathSciNetMATH Srivastava, N., Hinton, G., Krizhevsky, A., Sutskever, I., Salakhutdinov, R.: Dropout: a simple way to prevent neural networks from overfitting. J. Mach. Learn. Res. 15, 1929–1958 (2014)MathSciNetMATH
24.
go back to reference Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–9. IEEE (2015) Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., Rabinovich, A.: Going deeper with convolutions. In: 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1–9. IEEE (2015)
25.
go back to reference Technical Committee ISO/TC 22: ISO1:2011(en), Road vehicles Functional safety Part 1: Vocabulary (2011) Technical Committee ISO/TC 22: ISO1:2011(en), Road vehicles Functional safety Part 1: Vocabulary (2011)
26.
go back to reference Torralba, A., Efros, A.A.: Unbiased look at dataset bias. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1521–1528 (2011) Torralba, A., Efros, A.A.: Unbiased look at dataset bias. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pp. 1521–1528 (2011)
27.
go back to reference Von Ahn, L., Liu, R., Blum, M.: Peekaboom: a game for locating objects in images. In: Proceedings of the SIGCHI conference on Human Factors in computing systems - CHI 2006, p. 55 (2006) Von Ahn, L., Liu, R., Blum, M.: Peekaboom: a game for locating objects in images. In: Proceedings of the SIGCHI conference on Human Factors in computing systems - CHI 2006, p. 55 (2006)
28.
go back to reference Zhang, J., Cho, K.: Query-efficient imitation learning for end-to-end autonomous driving (2016) Zhang, J., Cho, K.: Query-efficient imitation learning for end-to-end autonomous driving (2016)
Metadata
Title
Virtual Environment for Training Autonomous Vehicles
Authors
Jerome Leudet
Tommi Mikkonen
François Christophe
Tomi Männistö
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-96728-8_14

Premium Partner