Skip to main content
Top
Published in: Optical and Quantum Electronics 1/2024

01-01-2024

Optimizing optical network longevity via Q-learning-based routing protocol for energy efficiency and throughput enhancement

Authors: Ashwini V. Jatti, V. J. K. Kishor Sonti

Published in: Optical and Quantum Electronics | Issue 1/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In optical networks, increasing longevity is of critical importance. This article describes a cutting-edge routing protocol based on Q-learning techniques that have been meticulously constructed to extend the lifetime of optical networks by enhancing energy effectiveness and throughput. The protocol dynamically manages energy usage using Q-learning, a reinforcement learning approach. The primary objective is to choose routing algorithms that optimize long-term revenues for individual nodes while increasing energy efficiency. In a detailed study, the protocol's performance is compared to that of well-known rivals such as Low-Energy Adaptive Clustering Hierarchy (LEACH), Multi-Hop Low-Energy Adaptive Clustering Hierarchy (M-LEACH), and Balanced Low-Energy Adaptive Clustering Hierarchy (B-LEACH) (B-LEACH). The evaluation considers several factors, including network durability as measured by active/inactive node ratios, energy efficiency as measured by per-round energy consumption, quality of service as measured by throughput per round, and scalability as measured over networks with 40, 70, and 100 nodes. The complete examination for each network configuration spans over 5,000 cycles. M-LEACH outperforms LEACH and B-LEACH in all performance measures in the simulation results test, establishing a new benchmark. It is fascinating to compare the performance of the unique Q-learning-based protocol to that of LEACH, M-LEACH, and B-LEACH. Regarding network durability, energy efficiency, quality of service, and scalability, the proposed protocol outperforms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Abadi, A.F.E., Asghari, S.E., Sharifani, S., Asghari, S.A. and Marvasti, M.B.: A survey on utilizing reinforcement learning in wireless sensor networks routing protocols. In: 2022 13th International Conference on Information and Knowledge Technology (IKT) (pp. 1-7). IEEE Abadi, A.F.E., Asghari, S.E., Sharifani, S., Asghari, S.A. and Marvasti, M.B.: A survey on utilizing reinforcement learning in wireless sensor networks routing protocols. In: 2022 13th International Conference on Information and Knowledge Technology (IKT) (pp. 1-7). IEEE
go back to reference Abbasloo, S., Yen, C.Y., Chao, H.J.: Classic meets modern: A pragmatic learning-based congestion control for the internet. In: Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, New York, NY, USA, pp 632–647 (2020) Abbasloo, S., Yen, C.Y., Chao, H.J.: Classic meets modern: A pragmatic learning-based congestion control for the internet. In: Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, New York, NY, USA, pp 632–647 (2020)
go back to reference Abdollahi, M., Ni, W., Abolhasan, M., Li, S.: Software-defined networking-based adaptive routing for multi-hop multi-frequency wireless mesh. IEEE Trans. Veh. Technol. 70(12), 13073–13086 (2021)CrossRef Abdollahi, M., Ni, W., Abolhasan, M., Li, S.: Software-defined networking-based adaptive routing for multi-hop multi-frequency wireless mesh. IEEE Trans. Veh. Technol. 70(12), 13073–13086 (2021)CrossRef
go back to reference Baruah, P. Urgaonkar, R.: Learning-enforced time domain routing to mobile sinks in wireless sensor fields, in Proc. 29th Annu. IEEE Int. Conf. Local Comput. Netw., Tampa, FL, USA, pp. 525–532 (2004) Baruah, P. Urgaonkar, R.: Learning-enforced time domain routing to mobile sinks in wireless sensor fields, in Proc. 29th Annu. IEEE Int. Conf. Local Comput. Netw., Tampa, FL, USA, pp. 525–532 (2004)
go back to reference Chen, Y.R., Rezapour, A., Tzeng, W.G., Tsai, S.C.: Rl-routing: an sdn routing algorithm based on deep reinforcement learning. IEEE Trans. Netw. Sci. Eng. 7, 3185–3199 (2020)CrossRef Chen, Y.R., Rezapour, A., Tzeng, W.G., Tsai, S.C.: Rl-routing: an sdn routing algorithm based on deep reinforcement learning. IEEE Trans. Netw. Sci. Eng. 7, 3185–3199 (2020)CrossRef
go back to reference DiValerio, V., Presti, F.L., Petrioli, C., Picari, L., Spaccini, D., Basagni, S.: CARMA: channel-aware reinforcement learning-based multi-path adaptive routing for underwater wireless sensor networks. IEEE J. Sel. Areas Commun. 37(11), 2634–2647 (2019)CrossRef DiValerio, V., Presti, F.L., Petrioli, C., Picari, L., Spaccini, D., Basagni, S.: CARMA: channel-aware reinforcement learning-based multi-path adaptive routing for underwater wireless sensor networks. IEEE J. Sel. Areas Commun. 37(11), 2634–2647 (2019)CrossRef
go back to reference El-Semary, M., Diab, H.: BP-AODV: blackhole protected AODV routing protocol for MANETs based on chaotic map. IEEE Access 7, 95197–95211 (2019)CrossRef El-Semary, M., Diab, H.: BP-AODV: blackhole protected AODV routing protocol for MANETs based on chaotic map. IEEE Access 7, 95197–95211 (2019)CrossRef
go back to reference Gobinath, J., Hemajothi, S., Leena Jasmine, J.S.: 5Energy-efficient routing protocol with multi-hop fuzzy logic for wireless networks. Intell. Autom. Soft Comput. 36, 2457–2471 (2023)CrossRef Gobinath, J., Hemajothi, S., Leena Jasmine, J.S.: 5Energy-efficient routing protocol with multi-hop fuzzy logic for wireless networks. Intell. Autom. Soft Comput. 36, 2457–2471 (2023)CrossRef
go back to reference Haddad, S., Sayah, J., El-Hassan, B., Kallab, C., Chakroun, M., Turkey, N., Charafeddine, J., Hamdan, H.: Mathematical model with energy and clustering energy based routing protocols as remediation to the directional source aware routing protocol in wireless sensor networks wireless sensor. Network 14, 23–39 (2022). https://doi.org/10.4236/wsn.2022.142002CrossRef Haddad, S., Sayah, J., El-Hassan, B., Kallab, C., Chakroun, M., Turkey, N., Charafeddine, J., Hamdan, H.: Mathematical model with energy and clustering energy based routing protocols as remediation to the directional source aware routing protocol in wireless sensor networks wireless sensor. Network 14, 23–39 (2022). https://​doi.​org/​10.​4236/​wsn.​2022.​142002CrossRef
go back to reference Haseeb, K., Ud-Din, I., Almogren, A., Islam, N., Altameem, A.: RTS: a robust and trusted scheme for IoT-based mobile wireless mesh networks. IEEE Access 8, 68379–68390 (2020)CrossRef Haseeb, K., Ud-Din, I., Almogren, A., Islam, N., Altameem, A.: RTS: a robust and trusted scheme for IoT-based mobile wireless mesh networks. IEEE Access 8, 68379–68390 (2020)CrossRef
go back to reference Huang, R., Chu, X., Zhang, J., Hu, Y.H., Yan, H.: A machine-learning-enabled context-driven control mechanism for software-defined smart home networks. Sens. Mater. 31, 2103–2129 (2019) Huang, R., Chu, X., Zhang, J., Hu, Y.H., Yan, H.: A machine-learning-enabled context-driven control mechanism for software-defined smart home networks. Sens. Mater. 31, 2103–2129 (2019)
go back to reference Javed, Z., Yau, K.A., Mohamad, H., Ramli, N., Qadir, J., Ni, Q.: RL-budget: a learning-based cluster size adjustment scheme for cognitive radio networks. IEEE Access 6, 1055–1072 (2018)CrossRef Javed, Z., Yau, K.A., Mohamad, H., Ramli, N., Qadir, J., Ni, Q.: RL-budget: a learning-based cluster size adjustment scheme for cognitive radio networks. IEEE Access 6, 1055–1072 (2018)CrossRef
go back to reference Kulkarni, R.V., Forster, A., Venayagamoorthy, G.K.: Computational intelligence in wireless sensor networks: a survey. IEEE Commun. Surveys Tuts. 13, 6896 (2011)CrossRef Kulkarni, R.V., Forster, A., Venayagamoorthy, G.K.: Computational intelligence in wireless sensor networks: a survey. IEEE Commun. Surveys Tuts. 13, 6896 (2011)CrossRef
go back to reference Liu, W.X.: Intelligent routing based on deep reinforcement learning in software-defined data-center networks. In: Proceedings of the 2019 IEEE Symposium on Computers and Communications (ISCC), Barcelona, Spain,pp. 1–6 (2019) Liu, W.X.: Intelligent routing based on deep reinforcement learning in software-defined data-center networks. In: Proceedings of the 2019 IEEE Symposium on Computers and Communications (ISCC), Barcelona, Spain,pp. 1–6 (2019)
go back to reference Malekian, R., Karadimce, A., Abdullah A.H.: AODV and OLSR routing protocols in MANET. In: Proc. IEEE 33rd Int. Conf. Distrib. Comput. Syst. Workshops, pp. 286–289 (2013) Malekian, R., Karadimce, A., Abdullah A.H.: AODV and OLSR routing protocols in MANET. In: Proc. IEEE 33rd Int. Conf. Distrib. Comput. Syst. Workshops, pp. 286–289 (2013)
go back to reference Mammeri, Z.: Reinforcement learning based routing in networks: review and classification of approaches. IEEE Access 7, 55916–55950 (2019)CrossRef Mammeri, Z.: Reinforcement learning based routing in networks: review and classification of approaches. IEEE Access 7, 55916–55950 (2019)CrossRef
go back to reference Meng, Z., Wang, M., Bai, J., Xu, M., Mao, H., Hu, H.: Interpreting deep learning-based networking systems. In: Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, New York, NY, USA, pp. 154–171 (2020) Meng, Z., Wang, M., Bai, J., Xu, M., Mao, H., Hu, H.: Interpreting deep learning-based networking systems. In: Proceedings of the Annual conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication, New York, NY, USA, pp. 154–171 (2020)
go back to reference Mutombo, V.K., Shin, S.Y., Hong, J.: EBR-RL: Energy Balancing Routing protocol based on Reinforcement Learning for WSN In 36th ACM/SIGAPP Symposium on Applied Computing (SAC ’21), March 22–26, 2021, Virtual Event, Republic of Korea. ACM, New York, NY, USA, 6 pages. https://doi.org/10.1145/3412841.3442063 Mutombo, V.K., Shin, S.Y., Hong, J.: EBR-RL: Energy Balancing Routing protocol based on Reinforcement Learning for WSN In 36th ACM/SIGAPP Symposium on Applied Computing (SAC ’21), March 22–26, 2021, Virtual Event, Republic of Korea. ACM, New York, NY, USA, 6 pages. https://​doi.​org/​10.​1145/​3412841.​3442063
go back to reference Nowe, K., Steenhaut, M., Fakir, Verbeeck, K.: Q-learning for adaptive load based routing in Proc. IEEE Int. Conf. Syst., Man, Cybern., San Diego, CA, USA, pp. 3965–3970 (1998) Nowe, K., Steenhaut, M., Fakir, Verbeeck, K.: Q-learning for adaptive load based routing in Proc. IEEE Int. Conf. Syst., Man, Cybern., San Diego, CA, USA, pp. 3965–3970 (1998)
go back to reference Razzaque, M.A., Ahmed, M.H.U., Hong, C.S., Lee, S.: Qos-aware distributed adaptive cooperative routing in wireless sensor networks. Ad. Hoc. Netw. 19, 28–42 (2014)CrossRef Razzaque, M.A., Ahmed, M.H.U., Hong, C.S., Lee, S.: Qos-aware distributed adaptive cooperative routing in wireless sensor networks. Ad. Hoc. Netw. 19, 28–42 (2014)CrossRef
go back to reference Ren, L., Wang, W., Xu, H.: A reinforcement learning method for constraint-satisfied services composition. IEEE Trans. Services Comput. 13(5), 786–800 (2020)CrossRef Ren, L., Wang, W., Xu, H.: A reinforcement learning method for constraint-satisfied services composition. IEEE Trans. Services Comput. 13(5), 786–800 (2020)CrossRef
go back to reference Sun, Y., Peng, M., Zhou, Y., Huang, Y., Mao, S.: Application of machine learning in wireless networks: key techniques and open issues. IEEE Commun. Surv. Tuts. 21(4), 3072–3108 (2019)CrossRef Sun, Y., Peng, M., Zhou, Y., Huang, Y., Mao, S.: Application of machine learning in wireless networks: key techniques and open issues. IEEE Commun. Surv. Tuts. 21(4), 3072–3108 (2019)CrossRef
go back to reference Wang, Z., Crowcroft, J.: Quality-of-service routing for supporting multimedia applications. IEEE J. Sel. Areas Commun. 14(7), 1228–1234 (1996)CrossRef Wang, Z., Crowcroft, J.: Quality-of-service routing for supporting multimedia applications. IEEE J. Sel. Areas Commun. 14(7), 1228–1234 (1996)CrossRef
go back to reference Wang, M., Cui, Y., Wang, X., Xiao, S., Jiang, J.: Machine learning for networking: workflow, advances and opportunities. IEEE Netw. 32(2), 92–99 (2018)CrossRef Wang, M., Cui, Y., Wang, X., Xiao, S., Jiang, J.: Machine learning for networking: workflow, advances and opportunities. IEEE Netw. 32(2), 92–99 (2018)CrossRef
go back to reference Wang, V., Wang, T.: Adaptive routing for sensor networks using reinforcement learning in Proc. 6th IEEE Int. Conf. Comput. Inf. Technol. (CIT), p. 219 (2006) Wang, V., Wang, T.: Adaptive routing for sensor networks using reinforcement learning in Proc. 6th IEEE Int. Conf. Comput. Inf. Technol. (CIT), p. 219 (2006)
go back to reference Younus, M.U., Khan, M.K., Anjum, M.R., Afridi, S., Arain, Z.A., Jamali, A.A.: Optimizing the lifetime of software defined wireless sensor network via reinforcement learning. IEEE Access 9, 259–272 (2020)CrossRef Younus, M.U., Khan, M.K., Anjum, M.R., Afridi, S., Arain, Z.A., Jamali, A.A.: Optimizing the lifetime of software defined wireless sensor network via reinforcement learning. IEEE Access 9, 259–272 (2020)CrossRef
go back to reference Yu, C., Lan, J., Guo, Z., Hu, Y.: Drom: optimizing the routing in software-defined networks with deep reinforcement learning. IEEE Access 6, 64533–64539 (2018)CrossRef Yu, C., Lan, J., Guo, Z., Hu, Y.: Drom: optimizing the routing in software-defined networks with deep reinforcement learning. IEEE Access 6, 64533–64539 (2018)CrossRef
go back to reference Zhang, Y., Huang, Q.: A learning-based adaptive routing tree for wireless sensor networks in Proc. IEEE 3rd Consum. Commun. Netw. Conf., pp. 12–21 (2006) Zhang, Y., Huang, Q.: A learning-based adaptive routing tree for wireless sensor networks in Proc. IEEE 3rd Consum. Commun. Netw. Conf., pp. 12–21 (2006)
Metadata
Title
Optimizing optical network longevity via Q-learning-based routing protocol for energy efficiency and throughput enhancement
Authors
Ashwini V. Jatti
V. J. K. Kishor Sonti
Publication date
01-01-2024
Publisher
Springer US
Published in
Optical and Quantum Electronics / Issue 1/2024
Print ISSN: 0306-8919
Electronic ISSN: 1572-817X
DOI
https://doi.org/10.1007/s11082-023-05658-z

Other articles of this Issue 1/2024

Optical and Quantum Electronics 1/2024 Go to the issue