Skip to main content
Top

2024 | OriginalPaper | Chapter

Multi-agent Reinforcement Learning for Online Placement of Mobile EV Charging Stations

Authors : Lo Pang-Yun Ting, Chi-Chun Lin, Shih-Hsun Lin, Yu-Lin Chu, Kun-Ta Chuang

Published in: Advances in Knowledge Discovery and Data Mining

Publisher: Springer Nature Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

As global interest shifts toward sustainable transportation with the proliferation of electric vehicles (EVs), the demand for an efficient, real-time, and robust charging infrastructure becomes increasingly pronounced. This paper introduces an approach to address the imbalance between the surging EV demand and the existing charging infrastructure: the concept of Mobile Charging Stations (MCSs). The research develops an algorithm for the dynamic placement of MCSs to significantly reduce the waiting time for EV owners. The core of this research is the Two-stage Placement and Management with Multi-Agent Reinforcement Learning (2PM-MARL) for a dynamic balancing of charging demand and supply. The complexity of the problem is elaborated by showing the NP-hard nature of the MCS placement issue through a relation to the Uncapacitated Facility Location Problem (UFLP), underscoring the computational challenges and emphasizing the need for intelligent real-time solutions. Our framework is validated through comprehensive experiments using real-world charging session data. The results exhibit significant reductions in the waiting time, suggesting the potential practicality and efficiency of our proposed model.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
2.
go back to reference Afshar, S., Disfani, V.R.: Optimal scheduling of electric vehicles in the presence of mobile charging stations. In: IEEE PESGM (2022) Afshar, S., Disfani, V.R.: Optimal scheduling of electric vehicles in the presence of mobile charging stations. In: IEEE PESGM (2022)
4.
go back to reference Elghitani, F., El-Saadany, E.F.: Efficient assignment of electric vehicles to charging stations. IEEE Trans. Smart Grid 12, 761–773 (2021)CrossRef Elghitani, F., El-Saadany, E.F.: Efficient assignment of electric vehicles to charging stations. IEEE Trans. Smart Grid 12, 761–773 (2021)CrossRef
5.
go back to reference Hardman, S., et al.: A review of consumer preferences of and interactions with electric vehicle charging infrastructure. Transp. Res. Part D: Transp. Environ. 62, 508–523 (2018)CrossRef Hardman, S., et al.: A review of consumer preferences of and interactions with electric vehicle charging infrastructure. Transp. Res. Part D: Transp. Environ. 62, 508–523 (2018)CrossRef
6.
go back to reference Hussain, S., Kim, Y.S., Thakur, S., Breslin, J.G.: Optimization of waiting time for electric vehicles using a fuzzy inference system. IEEE T-ITS 23, 15396–15407 (2022) Hussain, S., Kim, Y.S., Thakur, S., Breslin, J.G.: Optimization of waiting time for electric vehicles using a fuzzy inference system. IEEE T-ITS 23, 15396–15407 (2022)
8.
go back to reference Lee, K.B., Ahmed, M.A., Kang, D.K., Kim, Y.C.: Deep reinforcement learning based optimal route and charging station selection. Energies 13, 6255 (2020)CrossRef Lee, K.B., Ahmed, M.A., Kang, D.K., Kim, Y.C.: Deep reinforcement learning based optimal route and charging station selection. Energies 13, 6255 (2020)CrossRef
9.
go back to reference Lin, K., Zhao, R., Xu, Z., Zhou, J.: Efficient large-scale fleet management via multi-agent deep reinforcement learning. In: ACM SIGKDD (2018) Lin, K., Zhao, R., Xu, Z., Zhou, J.: Efficient large-scale fleet management via multi-agent deep reinforcement learning. In: ACM SIGKDD (2018)
10.
go back to reference Liu, L., Xi, Z., Zhu, K., Wang, R., Hossain, E.: Mobile charging station placements in internet of electric vehicles: a federated learning approach. IEEE T-ITS 23, 24561–24577 (2022) Liu, L., Xi, Z., Zhu, K., Wang, R., Hossain, E.: Mobile charging station placements in internet of electric vehicles: a federated learning approach. IEEE T-ITS 23, 24561–24577 (2022)
11.
go back to reference Liu, Q., Zeng, Y., Chen, L., Zheng, X.: Social-aware optimal electric vehicle charger deployment on road network. In: ACM SIGSPATIAL (2019) Liu, Q., Zeng, Y., Chen, L., Zheng, X.: Social-aware optimal electric vehicle charger deployment on road network. In: ACM SIGSPATIAL (2019)
12.
go back to reference Moradipari, A., Alizadeh, M.: Pricing and routing mechanisms for differentiated services in an electric vehicle public charging station network. IEEE Trans. Smart Grid 11, 1489–1499 (2019)CrossRef Moradipari, A., Alizadeh, M.: Pricing and routing mechanisms for differentiated services in an electric vehicle public charging station network. IEEE Trans. Smart Grid 11, 1489–1499 (2019)CrossRef
13.
go back to reference Sadeghianpourhamami, N., Deleu, J., Develder, C.: Definition and evaluation of model-free coordination of electrical vehicle charging with reinforcement learning. IEEE Trans. Smart Grid 11, 203–214 (2018)CrossRef Sadeghianpourhamami, N., Deleu, J., Develder, C.: Definition and evaluation of model-free coordination of electrical vehicle charging with reinforcement learning. IEEE Trans. Smart Grid 11, 203–214 (2018)CrossRef
14.
go back to reference Sadreddini, Z., Guner, S., Erdinç, O.: Design of a decision-based multicriteria reservation system for the EV parking lot. IEEE TTE 7, 2429–2438 (2021) Sadreddini, Z., Guner, S., Erdinç, O.: Design of a decision-based multicriteria reservation system for the EV parking lot. IEEE TTE 7, 2429–2438 (2021)
16.
go back to reference Tang, X., et al.: Value function is all you need: a unified learning framework for ride hailing platforms. In: ACM SIGKDD (2021) Tang, X., et al.: Value function is all you need: a unified learning framework for ride hailing platforms. In: ACM SIGKDD (2021)
17.
go back to reference Ting, L.P.Y., Wu, P.H., Chung, H.Y., Chuang, K.T.: An incentive dispatch algorithm for utilization-perfect EV charging management. In: Gama, J., Li, T., Yu, Y., Chen, E., Zheng, Y., Teng, F. (eds.) Advances in Knowledge Discovery and Data Mining. Lecture Notes in Computer Science(), vol. 13282, pp. 132–146. Springer, Cham (2022). https://doi.org/10.1007/978-3-031-05981-0_11CrossRef Ting, L.P.Y., Wu, P.H., Chung, H.Y., Chuang, K.T.: An incentive dispatch algorithm for utilization-perfect EV charging management. In: Gama, J., Li, T., Yu, Y., Chen, E., Zheng, Y., Teng, F. (eds.) Advances in Knowledge Discovery and Data Mining. Lecture Notes in Computer Science(), vol. 13282, pp. 132–146. Springer, Cham (2022). https://​doi.​org/​10.​1007/​978-3-031-05981-0_​11CrossRef
18.
go back to reference von Wahl, L., Tempelmeier, N., Sao, A., Demidova, E.: Reinforcement learning-based placement of charging stations in urban road networks. In: ACM SIGKDD (2022) von Wahl, L., Tempelmeier, N., Sao, A., Demidova, E.: Reinforcement learning-based placement of charging stations in urban road networks. In: ACM SIGKDD (2022)
19.
go back to reference Yan, L., Shen, H., Kang, L., Zhao, J., Xu, C.: Reinforcement learning based scheduling for cooperative EV-to-EV dynamic wireless charging. In: IEEE MASS (2020) Yan, L., Shen, H., Kang, L., Zhao, J., Xu, C.: Reinforcement learning based scheduling for cooperative EV-to-EV dynamic wireless charging. In: IEEE MASS (2020)
20.
go back to reference Zheng, B., et al.: Soup: spatial-temporal demand forecasting and competitive supply in transportation. IEEE TKDE 35, 2034–2047 (2023) Zheng, B., et al.: Soup: spatial-temporal demand forecasting and competitive supply in transportation. IEEE TKDE 35, 2034–2047 (2023)
Metadata
Title
Multi-agent Reinforcement Learning for Online Placement of Mobile EV Charging Stations
Authors
Lo Pang-Yun Ting
Chi-Chun Lin
Shih-Hsun Lin
Yu-Lin Chu
Kun-Ta Chuang
Copyright Year
2024
Publisher
Springer Nature Singapore
DOI
https://doi.org/10.1007/978-981-97-2262-4_23

Premium Partner