Skip to main content
Erschienen in: Wireless Networks 6/2020

10.05.2020

Joint optimization of power control and time slot allocation for wireless body area networks via deep reinforcement learning

verfasst von: Lili Wang, Ge Zhang, Jun Li, Gaoshang Lin

Erschienen in: Wireless Networks | Ausgabe 6/2020

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

E-healthcare system based on wireless body area network (WBAN) promises to produce potential benefits in health-care industry. A major issue of such an on-body networked system is the energy efficiency, that is, how to improve the reliability and effectiveness of physiological data transmission with the energy constraints of tiny wireless sensors. Motivated by this, we consider an individual WBAN scenario, focusing on finding an adaptive time slot allocation and power control scheme to maximize the average energy efficiency for implementing the task of health monitoring. We formulate the maximization problem with latency and sensors’ energy budget constraints as a markov decision process (MDP). As a solution, we propose a deep reinforcement learning-based scheme to make a sequence decision for the MDP, which jointly optimizes power control and slot allocation. Simulation results show that the proposed scheme is energy efficient and has a good convergence.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Movassaghi, S., Abolhasan, M., Lipman, J., Smith, D., & Jamalipour, A. (2014). Wireless body area networks: A survey. IEEE Communications Surveys & Tutorials,16(3), 1658–1686.CrossRef Movassaghi, S., Abolhasan, M., Lipman, J., Smith, D., & Jamalipour, A. (2014). Wireless body area networks: A survey. IEEE Communications Surveys & Tutorials,16(3), 1658–1686.CrossRef
2.
Zurück zum Zitat Salayma, M., Al-Dubai, A., Romdhani, I., & Nasser, Y. (2017). Wireless body area network (WBAN): a survey on reliability, fault tolerance, and technologies coexistence. ACM Computing Surveys (CSUR),50(1), 3.CrossRef Salayma, M., Al-Dubai, A., Romdhani, I., & Nasser, Y. (2017). Wireless body area network (WBAN): a survey on reliability, fault tolerance, and technologies coexistence. ACM Computing Surveys (CSUR),50(1), 3.CrossRef
3.
Zurück zum Zitat Yazdandoost, K., & Sayrafian, K. (2009). Channel model for body area network (Ban). IEEE p802. 15-08-0780-09-0006. IEEE 802.15 working group document. Yazdandoost, K., & Sayrafian, K. (2009). Channel model for body area network (Ban). IEEE p802. 15-08-0780-09-0006. IEEE 802.15 working group document.
4.
Zurück zum Zitat Hayajneh, T., Almashaqbeh, G., Ullah, S., & Vasilakos, A. V. (2014). A survey of wireless technologies coexistence in WBAN: analysis and open research issues. Wireless Networks,20(8), 2165–2199.CrossRef Hayajneh, T., Almashaqbeh, G., Ullah, S., & Vasilakos, A. V. (2014). A survey of wireless technologies coexistence in WBAN: analysis and open research issues. Wireless Networks,20(8), 2165–2199.CrossRef
5.
Zurück zum Zitat Davenport, D. (2009). Medwin physical layer proposal. IEEE 802.15 document repository. IEEE 802.15-09-0328-01-0006. Davenport, D. (2009). Medwin physical layer proposal. IEEE 802.15 document repository. IEEE 802.15-09-0328-01-0006.
6.
Zurück zum Zitat Kaur, T., & Kumar, D. (2016). TDMA-based mac protocols for wireless sensor networks: A survey and comparative analysis. In 2016 5th international conference on wireless networks and embedded systems (WECON) (pp. 1–6). IEEE. Kaur, T., & Kumar, D. (2016). TDMA-based mac protocols for wireless sensor networks: A survey and comparative analysis. In 2016 5th international conference on wireless networks and embedded systems (WECON) (pp. 1–6). IEEE.
7.
Zurück zum Zitat Salayma, M., Al-Dubai, A., Romdhani, I., & Nasser, Y. (2017). New dynamic, reliable and energy efficient scheduling for wireless body area networks (WBAN). In 2017 IEEE international conference on communications (ICC) (pp. 1–6). IEEE. Salayma, M., Al-Dubai, A., Romdhani, I., & Nasser, Y. (2017). New dynamic, reliable and energy efficient scheduling for wireless body area networks (WBAN). In 2017 IEEE international conference on communications (ICC) (pp. 1–6). IEEE.
8.
Zurück zum Zitat Kim, S., & Eom, D. S. (2014). Link-state-estimation-based transmission power control in wireless body area networks. IEEE Journal of Biomedical Health Informatics,18(4), 1294–1302.CrossRef Kim, S., & Eom, D. S. (2014). Link-state-estimation-based transmission power control in wireless body area networks. IEEE Journal of Biomedical Health Informatics,18(4), 1294–1302.CrossRef
9.
Zurück zum Zitat Goswami, D., Sarma, K. C., & Mahanta, A. (2015). Experimental determination of path loss and delay dispersion parameters for on-body UWB WBAN channel. In IEEE international conference on signal processing. Goswami, D., Sarma, K. C., & Mahanta, A. (2015). Experimental determination of path loss and delay dispersion parameters for on-body UWB WBAN channel. In IEEE international conference on signal processing.
10.
Zurück zum Zitat Chaganti, V. G., Hanlen, L. W., & Lamahewa, T. A. (2011). Semi-markov modeling for body area networks. In 2011 IEEE international conference on communications (ICC) (pp. 1–5). IEEE. Chaganti, V. G., Hanlen, L. W., & Lamahewa, T. A. (2011). Semi-markov modeling for body area networks. In 2011 IEEE international conference on communications (ICC) (pp. 1–5). IEEE.
11.
Zurück zum Zitat Li, H., Yang, B., Yu, W., Guan, X., Gong, X., & Yu, G. (2014). Joint sleep scheduling and opportunistic transmission in wireless body area networks. In The 26th Chinese control and decision conference (2014 CCDC) (pp. 1886–1891). IEEE. Li, H., Yang, B., Yu, W., Guan, X., Gong, X., & Yu, G. (2014). Joint sleep scheduling and opportunistic transmission in wireless body area networks. In The 26th Chinese control and decision conference (2014 CCDC) (pp. 1886–1891). IEEE.
12.
Zurück zum Zitat Taleb, S., Hajj, H., & Dawy, Z. (2018). VCAMS: Viterbi-based context aware mobile sensing to trade-off energy and delay. IEEE Transactions on Mobile Computing,17(1), 225–242.CrossRef Taleb, S., Hajj, H., & Dawy, Z. (2018). VCAMS: Viterbi-based context aware mobile sensing to trade-off energy and delay. IEEE Transactions on Mobile Computing,17(1), 225–242.CrossRef
13.
Zurück zum Zitat Li, J., Liu, Q., Wu, P., Shu, F., & Jin, S. (2018). Task offloading for UAV-based mobile edge computing via deep reinforcement learning. In 2018 IEEE/CIC international conference on communications in China (ICCC) (pp. 798–802). IEEE. Li, J., Liu, Q., Wu, P., Shu, F., & Jin, S. (2018). Task offloading for UAV-based mobile edge computing via deep reinforcement learning. In 2018 IEEE/CIC international conference on communications in China (ICCC) (pp. 798–802). IEEE.
14.
Zurück zum Zitat Chen, Guihong, Zhan, Yiju, Sheng, Geyi, Xiao, Liang, & Wang, Yonghua. (2019). Reinforcement learning-based sensor access control for WBANs. Access IEEE,7, 8483–8494.CrossRef Chen, Guihong, Zhan, Yiju, Sheng, Geyi, Xiao, Liang, & Wang, Yonghua. (2019). Reinforcement learning-based sensor access control for WBANs. Access IEEE,7, 8483–8494.CrossRef
15.
Zurück zum Zitat Kleinrock, L. (1975). Queueing systems. Vol. I: Theory. IEEE Transactions on Communications,65(6), 990–991.MATH Kleinrock, L. (1975). Queueing systems. Vol. I: Theory. IEEE Transactions on Communications,65(6), 990–991.MATH
16.
Zurück zum Zitat Jain, R. K., Chiu, D.-M. W., & Hawe, W. R. (1984). A quantitative measure of fairness and discrimination. Hudson, MA: Eastern Research Laboratory, Digital Equipment Corporation. Jain, R. K., Chiu, D.-M. W., & Hawe, W. R. (1984). A quantitative measure of fairness and discrimination. Hudson, MA: Eastern Research Laboratory, Digital Equipment Corporation.
17.
Zurück zum Zitat Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. Cambridge: MIT Press.MATH Sutton, R. S., & Barto, A. G. (2018). Reinforcement learning: An introduction. Cambridge: MIT Press.MATH
18.
Zurück zum Zitat Anschel, O., Baram, N., & Shimkin, N. (2017). Averaged-DQN: Variance reduction and stabilization for deep reinforcement learning. In Proceedings of the 34th international conference on machine learning-volume 70 (pp. 176–185). JMLR.org. Anschel, O., Baram, N., & Shimkin, N. (2017). Averaged-DQN: Variance reduction and stabilization for deep reinforcement learning. In Proceedings of the 34th international conference on machine learning-volume 70 (pp. 176–185). JMLR.org.
19.
Zurück zum Zitat Umehira, M., Fujita, S., Gao, Z., & Wang, J. (2013). Dynamic channel assignment based on interference measurement with threshold for multibeam mobile satellite networks. In 2013 19th Asia-Pacific conference on communications (APCC) (pp. 688–692). IEEE. Umehira, M., Fujita, S., Gao, Z., & Wang, J. (2013). Dynamic channel assignment based on interference measurement with threshold for multibeam mobile satellite networks. In 2013 19th Asia-Pacific conference on communications (APCC) (pp. 688–692). IEEE.
Metadaten
Titel
Joint optimization of power control and time slot allocation for wireless body area networks via deep reinforcement learning
verfasst von
Lili Wang
Ge Zhang
Jun Li
Gaoshang Lin
Publikationsdatum
10.05.2020
Verlag
Springer US
Erschienen in
Wireless Networks / Ausgabe 6/2020
Print ISSN: 1022-0038
Elektronische ISSN: 1572-8196
DOI
https://doi.org/10.1007/s11276-020-02353-9

Weitere Artikel der Ausgabe 6/2020

Wireless Networks 6/2020 Zur Ausgabe

Neuer Inhalt