Skip to main content
Erschienen in:
Buchtitelbild

2023 | OriginalPaper | Buchkapitel

Coupling User Preference with External Rewards to Enable Driver-centered and Resource-aware EV Charging Recommendation

verfasst von : Chengyin Li, Zheng Dong, Nathan Fisher, Dongxiao Zhu

Erschienen in: Machine Learning and Knowledge Discovery in Databases

Verlag: Springer Nature Switzerland

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Electric Vehicle (EV) charging recommendation that both accommodates user preference and adapts to the ever-changing external environment arises as a cost-effective strategy to alleviate the range anxiety of private EV drivers. Previous studies focus on centralized strategies to achieve optimized resource allocation, particularly useful for privacy-indifferent taxi fleets and fixed-route public transits. However, private EV driver seeks a more personalized and resource-aware charging recommendation that is tailor-made to accommodate the user preference (when and where to charge) yet sufficiently adaptive to the spatiotemporal mismatch between charging supply and demand. Here we propose a novel Regularized Actor-Critic (RAC) charging recommendation approach that would allow each EV driver to strike an optimal balance between the user preference (historical charging pattern) and the external reward (driving distance and wait time). Experimental results on two real-world datasets demonstrate the unique features and superior performance of our approach to the competing methods.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat O’Donovan, C., Frith, J.: Electric buses in cities: driving towards cleaner air and lower co 2. Tech. Rep, Bloomberg New Energy Finance, NY, USA (2018) O’Donovan, C., Frith, J.: Electric buses in cities: driving towards cleaner air and lower co 2. Tech. Rep, Bloomberg New Energy Finance, NY, USA (2018)
2.
Zurück zum Zitat Wang, X., Yuen, C., Hassan, N.U., An, N., Wu, W.: Electric vehicle charging station placement for urban public bus systems. IEEE Trans. Intell. Transp. Syst. 18(1), 128–139 (2016)CrossRef Wang, X., Yuen, C., Hassan, N.U., An, N., Wu, W.: Electric vehicle charging station placement for urban public bus systems. IEEE Trans. Intell. Transp. Syst. 18(1), 128–139 (2016)CrossRef
3.
Zurück zum Zitat Wang, G., Xie, X., Zhang, F., Liu, Y., Zhang, D.: Bcharge: data-driven real-time charging scheduling for large-scale electric bus fleets. In: RTSS, pp. 45–55 (2018) Wang, G., Xie, X., Zhang, F., Liu, Y., Zhang, D.: Bcharge: data-driven real-time charging scheduling for large-scale electric bus fleets. In: RTSS, pp. 45–55 (2018)
4.
Zurück zum Zitat Guo, T., You, P., Yang, Z.: Recommendation of geographic distributed charging stations for electric vehicles: a game theoretical approach. In: 2017 IEEE Power & Energy Society General Meeting, pp. 1–5 (2017) Guo, T., You, P., Yang, Z.: Recommendation of geographic distributed charging stations for electric vehicles: a game theoretical approach. In: 2017 IEEE Power & Energy Society General Meeting, pp. 1–5 (2017)
5.
Zurück zum Zitat Cao, Y., Kaiwartya, O., Zhuang, Y., Ahmad, N., Sun, Y., Lloret, J.: A decentralized deadline-driven electric vehicle charging recommendation. IEEE Syst. J. (2018) Cao, Y., Kaiwartya, O., Zhuang, Y., Ahmad, N., Sun, Y., Lloret, J.: A decentralized deadline-driven electric vehicle charging recommendation. IEEE Syst. J. (2018)
6.
Zurück zum Zitat Qiang, Y., Li, C., Brocanelli, M., Zhu, D.: Counterfactual interpolation augmentation (CIA): a unified approach to enhance fairness and explainability of DNN. In: IJCAI (2022) Qiang, Y., Li, C., Brocanelli, M., Zhu, D.: Counterfactual interpolation augmentation (CIA): a unified approach to enhance fairness and explainability of DNN. In: IJCAI (2022)
7.
Zurück zum Zitat Li, X., Li, X., Pan, D., Zhu, D.: Improving adversarial robustness via probabilistically compact loss with logit constraints. In: AAAI, vol. 35, pp. 8482–8490 (2021) Li, X., Li, X., Pan, D., Zhu, D.: Improving adversarial robustness via probabilistically compact loss with logit constraints. In: AAAI, vol. 35, pp. 8482–8490 (2021)
8.
Zurück zum Zitat Pan, D., Li, X., Zhu, D.: Explaining deep neural network models with adversarial gradient integration. In: IJCAI, pp. 2876–2883 (2021) Pan, D., Li, X., Zhu, D.: Explaining deep neural network models with adversarial gradient integration. In: IJCAI, pp. 2876–2883 (2021)
9.
Zurück zum Zitat Pan, D., Li, X., Li, X., Zhu, D.: Explainable recommendation via interpretable feature mapping and evaluation of explainability. In: IJCAI, pp. 2690–2696 (2020) Pan, D., Li, X., Li, X., Zhu, D.: Explainable recommendation via interpretable feature mapping and evaluation of explainability. In: IJCAI, pp. 2690–2696 (2020)
10.
Zurück zum Zitat Zhao, K., et al.: Discovering subsequence patterns for next poi recommendation. In: IJCAI, pp. 3216–3222 (2020) Zhao, K., et al.: Discovering subsequence patterns for next poi recommendation. In: IJCAI, pp. 3216–3222 (2020)
11.
Zurück zum Zitat Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized markov chains for next-basket recommendation. In: WWW 2010, pp. 811–820 (2010) Rendle, S., Freudenthaler, C., Schmidt-Thieme, L.: Factorizing personalized markov chains for next-basket recommendation. In: WWW 2010, pp. 811–820 (2010)
12.
Zurück zum Zitat Zhu, Y., et al.: What to do next: modeling user behaviors by time-LSTM. In: IJCAI, vol. 17, pp. 3602–3608 (2017) Zhu, Y., et al.: What to do next: modeling user behaviors by time-LSTM. In: IJCAI, vol. 17, pp. 3602–3608 (2017)
13.
Zurück zum Zitat Kong, D., Wu, F.: HST-LSTM: a hierarchical spatial-temporal long-short term memory network for location prediction. In: IJCAI, vol. 18, pp. 2341–2347 (2018) Kong, D., Wu, F.: HST-LSTM: a hierarchical spatial-temporal long-short term memory network for location prediction. In: IJCAI, vol. 18, pp. 2341–2347 (2018)
14.
Zurück zum Zitat Zhao, P., et al.: Where to go next: a spatio-temporal gated network for next poi recommendation. In: AAAI, vol. 33, pp. 5877–5884 (2019) Zhao, P., et al.: Where to go next: a spatio-temporal gated network for next poi recommendation. In: AAAI, vol. 33, pp. 5877–5884 (2019)
15.
Zurück zum Zitat Li, L., Zheng, L., Yang, F., Li, T.: Modeling and broadening temporal user interest in personalized news recommendation. Expert Syst. Appl. 41(7), 3168–3177 (2014)CrossRef Li, L., Zheng, L., Yang, F., Li, T.: Modeling and broadening temporal user interest in personalized news recommendation. Expert Syst. Appl. 41(7), 3168–3177 (2014)CrossRef
16.
Zurück zum Zitat Liu, Q., Wu, S., Wang, L., Tan, T.: Predicting the next location: a recurrent model with spatial and temporal contexts. In: AAAI, vol. 30 (2016) Liu, Q., Wu, S., Wang, L., Tan, T.: Predicting the next location: a recurrent model with spatial and temporal contexts. In: AAAI, vol. 30 (2016)
17.
Zurück zum Zitat Huang, L., Ma, Y., Wang, S., Liu, Y.: An attention-based spatiotemporal LSTM network for next poi recommendation. IEEE Trans. Serv. Comput. (2019) Huang, L., Ma, Y., Wang, S., Liu, Y.: An attention-based spatiotemporal LSTM network for next poi recommendation. IEEE Trans. Serv. Comput. (2019)
18.
Zurück zum Zitat Wu, Y., Li, K., Zhao, G., Qian, X.: Long-and short-term preference learning for next poi recommendation. In: CIKM 2019, pp. 2301–2304 (2019) Wu, Y., Li, K., Zhao, G., Qian, X.: Long-and short-term preference learning for next poi recommendation. In: CIKM 2019, pp. 2301–2304 (2019)
19.
Zurück zum Zitat Wang, E., et al.: Joint charging and relocation recommendation for e-taxi drivers via multi-agent mean field hierarchical reinforcement learning. IEEE Trans. Mobile Comput. (2020) Wang, E., et al.: Joint charging and relocation recommendation for e-taxi drivers via multi-agent mean field hierarchical reinforcement learning. IEEE Trans. Mobile Comput. (2020)
20.
Zurück zum Zitat Zhang, W., et al.: Intelligent electric vehicle charging recommendation based on multi-agent reinforcement learning. In: WWW 2021, pp. 1856–1867 (2021) Zhang, W., et al.: Intelligent electric vehicle charging recommendation based on multi-agent reinforcement learning. In: WWW 2021, pp. 1856–1867 (2021)
21.
Zurück zum Zitat Massimo, D., Ricci, F.: Harnessing a generalised user behaviour model for next-poi recommendation. In: RecSys 2018, pp. 402–406 (2018) Massimo, D., Ricci, F.: Harnessing a generalised user behaviour model for next-poi recommendation. In: RecSys 2018, pp. 402–406 (2018)
22.
Zurück zum Zitat Zheng, G., et al.: DRN: a deep reinforcement learning framework for news recommendation. In: WWW 2018 (2018) Zheng, G., et al.: DRN: a deep reinforcement learning framework for news recommendation. In: WWW 2018 (2018)
23.
Zurück zum Zitat Wang, L., Zhang, W., He, X., Zha, H.: Supervised reinforcement learning with recurrent neural network for dynamic treatment recommendation. In: KDD 2018, pp. 2447–2456 (2018) Wang, L., Zhang, W., He, X., Zha, H.: Supervised reinforcement learning with recurrent neural network for dynamic treatment recommendation. In: KDD 2018, pp. 2447–2456 (2018)
24.
Zurück zum Zitat Watkins, C.J., Dayan, P.: Q-learning. Mach. Learn. 8(3–4), 279–292 (1992) Watkins, C.J., Dayan, P.: Q-learning. Mach. Learn. 8(3–4), 279–292 (1992)
25.
Zurück zum Zitat Sutton, R.S., McAllester, D.A., Singh, S.P., Mansour, Y., et al.: Policy gradient methods for reinforcement learning with function approximation. In: NIPS, vol. 99, pp. 1057–1063 (1999) Sutton, R.S., McAllester, D.A., Singh, S.P., Mansour, Y., et al.: Policy gradient methods for reinforcement learning with function approximation. In: NIPS, vol. 99, pp. 1057–1063 (1999)
26.
Zurück zum Zitat Schmitt, S., Hessel, M., Simonyan, K.: Off-policy actor-critic with shared experience replay. In: ICML (2020) Schmitt, S., Hessel, M., Simonyan, K.: Off-policy actor-critic with shared experience replay. In: ICML (2020)
Metadaten
Titel
Coupling User Preference with External Rewards to Enable Driver-centered and Resource-aware EV Charging Recommendation
verfasst von
Chengyin Li
Zheng Dong
Nathan Fisher
Dongxiao Zhu
Copyright-Jahr
2023
DOI
https://doi.org/10.1007/978-3-031-26412-2_1

Premium Partner