Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
SLX-Digitalkonferenz: Zukunftswerkstatt 2024

Mehr Umsatz mit Top-Kontakten

Am 7. Mai erfahren Sie, wie Vertriebsteams Leadgenerierung, Leadnurturing und Leadstrategien effizient steuern können.
Erweiterte Suche
Anmelden
nach oben
Erschienen in:
Dual-Mode OFDM-IM by Encoding All Possible Subcarrier Activation Patterns Kapitel lesen Erstes Kapitel lesen

2019 | OriginalPaper | Buchkapitel

A Reinforcement Learning Based Joint Spectrum Allocation and Power Control Algorithm for D2D Communication Underlaying Cellular Networks

verfasst von : Wentai Chen, Jun Zheng

Erschienen in: Artificial Intelligence for Communications and Networks

Verlag: Springer International Publishing

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper studies the spectrum allocation and power control (SA-PC) problem in device-to-device (D2D) communication underlaying a cellular network. A distributed multi-agent reinforcement learning (MARL) based joint SA-PC algorithm is proposed for performing spectrum allocation and power control for each D2D user in the network. The proposed algorithm uses Q learning, a typical form of reinforcement learning (RL), to select the optimal resource block (RB) and power level for each D2D user. In the Q-learning algorithm, each D2D user is treated as an individual agent and maintains a single-state Q table. Each agent selects an RB and a power level according to its Q table in the learning process. Simulation results show that the proposed Q-learning based joint SA-PC algorithm can achieve good throughput performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Vorheriges Kapitel Neural Networks in Hybrid Precoding for Millimeter Wave Massive MIMO Systems
Nächstes Kapitel Improved Neural Machine Translation with POS-Tagging Through Joint Decoding
Literatur
1.
Asadi, A., Wang, Q., Mancuso, V.: A survey on device-to-device communication in cellular networks. IEEE Commun. Surv. Tutor. 16(4), 1801–1819 (2014)CrossRef
2.
Cai, X., Zheng, J., Zhang, Y., Murata, H.: A capacity oriented resource allocation algorithm for device-to-device communication in mobile cellular networks. In: Proceedings of IEEE ICC 2014, Sydney, Australia, June 2014
3.
Chen, B., Zheng, J., Zhang, Y.: A time division scheduling resource allocation for D2D communication in cellular networks. In: Proceedings of IEEE ICC 2015, London, UK, June 2015
4.
Cai, X., Zheng, J., Zhang, Y.: A graph coloring based resource allocation algorithm for D2D communication in cellular networks. In: Proceedings of IEEE ICC 2015, London, UK, June 2015
5.
Chen, B., Zheng, J., Zhang, Y., Murata, H.: SARA: a service-aware resource allocation scheme for device-to-device communication underlaying cellular networks. In: Proceedings of IEEE Globecom 2014, Austin, USA, December 2014, pp. 4916–4921 (2014)
6.
Zulhasnine, M., Huang, C., Srinivasan, A.: Efficient resource allocation for device-to-device communication underlaying LTE networks. In: Proceedings of 2010 IEEE 6th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob 2010), Niagara Falls, Canada, pp. 11–13, October 2010
7.
Esmat, H., Elmesalawy, M., Ibrahim, I.: Adaptive resource sharing algorithm for device-to-device communications underlaying cellular networks. IEEE Commun. Lett. 20(3), 530–533 (2016)CrossRef
8.
Hsu, C., Chen, W.: Joint power control and channel assignment for green device-to-device communication. In: Proceedings of 2018 16th International Conference on Pervasive Intelligence and Computing (PiCom 2018), Athens, Greece, pp. 881–884 (2018)
9.
Luo, Y., Shi, Z., Zhou, X., Liu, Q., Yi, Q.: Dynamic resource allocations based on q-learning for D2D communication in cellular networks. In: Proceedings of 2014 11th International Computer Conference on Wavelet Active Media Technology and Information Processing (ICCWAMTIP), Chengdu, China, 19–21 December 2014
10.
Nie, S., Fan, Z., Zhao, M., Gu, X., Zhang, L.: Q-learning based power control algorithm for D2D communication. In: Proceedings of 2016 IEEE 27th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC 2016), Valencia, Spain, pp. 1–6 (2016)
11.
Fan, Z., Gu, X., Nie, S., Chen, M.: D2D power control based on supervised and unsupervised learning. In: Proceedings of 2017 3rd IEEE International Conference on Computer and Communications (ICCC 2017), Chengdu, China, pp. 558–563 (2017)
12.
Khan, M.I., Alam, M.M., Le Moullec, Y., Yaacoub, E.: Cooperative reinforcement learning for adaptive power allocation in device-to-device communication. In: Proceedings of 2018 IEEE 4th World Forum on Internet of Things (WF-IoT), Singapore, pp. 476–481 (2018)
13.
Sutton, R.S., Barto, A.G.: Reinforcement learning: an introduction. IEEE Trans. Neural Netw. 9(5), 1054 (1998)CrossRef
14.
Lauer, M., Riedmiller, M.: An algorithm for distributed reinforcement learning in cooperative multi-agent systems. In: Proceedings of 2000 17th International Conference on Machine Learning, San Francisco, CA, pp. 535–542 (2000)
Metadaten
Titel
A Reinforcement Learning Based Joint Spectrum Allocation and Power Control Algorithm for D2D Communication Underlaying Cellular Networks
verfasst von
Wentai Chen
Jun Zheng
Copyright-Jahr
2019
Buch
Artificial Intelligence for Communications and Networks

Print ISBN: 978-3-030-22967-2

Electronic ISBN: 978-3-030-22968-9

Copyright-Jahr: 2019

DOI
https://doi.org/10.1007/978-3-030-22968-9_13