Skip to main content
Top

Comparative Analysis of Reinforcement Learning Algorithms for Autonomous Driving in Simulated 2D Environments: Optimizing Reward Functions and Hyperparameters

  • 2026
  • OriginalPaper
  • Chapter
Published in:

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter delves into the comparative analysis of reinforcement learning algorithms, specifically Proximal Policy Optimization (PPO) and Deep Q-Network (DQN), for training autonomous driving agents in simulated 2D environments. The study explores the optimization of reward functions and hyperparameters to enhance navigation and obstacle avoidance. Key topics include the impact of frame stacking on agent performance, the effectiveness of curriculum learning in gradually increasing task complexity, and the influence of different reward structures and penalties on learning outcomes. The findings reveal that DQN consistently outperforms PPO in the discrete-action environments used in this study, particularly when enhanced with frame stacking. The analysis also highlights the importance of tailoring training strategies and reward functions to specific tasks, providing valuable insights for future research in autonomous driving and reinforcement learning.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Business + Economics & Engineering + Technology"

Online-Abonnement

Springer Professional "Business + Economics & Engineering + Technology" gives you access to:

  • more than 130.000 books
  • more than 540 journals

from the following subject areas:

  • Automotive
  • Construction + Real Estate
  • Business IT + Informatics
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Mechanical Engineering + Materials
  • Surfaces + Materials Technology
  • Insurance + Risk


Secure your knowledge advantage now!

Springer Professional "Engineering + Technology"

Online-Abonnement

Springer Professional "Engineering + Technology" gives you access to:

  • more than 75.000 books
  • more than 390 journals

from the following specialised fileds:

  • Automotive
  • Business IT + Informatics
  • Construction + Real Estate
  • Electrical Engineering + Electronics
  • Energy + Sustainability
  • Mechanical Engineering + Materials
  • Surfaces + Materials Technology





 

Secure your knowledge advantage now!

Springer Professional "Business + Economics"

Online-Abonnement

Springer Professional "Business + Economics" gives you access to:

  • more than 100.000 books
  • more than 340 journals

from the following specialised fileds:

  • Construction + Real Estate
  • Business IT + Informatics
  • Finance + Banking
  • Management + Leadership
  • Marketing + Sales
  • Insurance + Risk



Secure your knowledge advantage now!

Title
Comparative Analysis of Reinforcement Learning Algorithms for Autonomous Driving in Simulated 2D Environments: Optimizing Reward Functions and Hyperparameters
Authors
Alexander Brunner
Gabriele Kotsis
Ismail Khalil
Copyright Year
2026
DOI
https://doi.org/10.1007/978-3-032-08603-7_8
This content is only visible if you are logged in and have the appropriate permissions.

Premium Partner

    Image Credits
    Neuer Inhalt/© ITandMEDIA, Nagarro GmbH/© Nagarro GmbH, AvePoint Deutschland GmbH/© AvePoint Deutschland GmbH, AFB Gemeinnützige GmbH/© AFB Gemeinnützige GmbH, USU GmbH/© USU GmbH, Ferrari electronic AG/© Ferrari electronic AG