Top

Optical and Quantum Electronics

Published in:

01-12-2023

Deep reinforcement learning for comprehensive route optimization in elastic optical networks using generative strategies

Authors: P. N. Renjith, G. Sujatha, M. Vinoth, G. D. Vignesh, M. Ramkumar Prabhu, B. Mouleswararao

Published in: Optical and Quantum Electronics | Issue 13/2023

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The latest advances in Deeper Reinforcement Learning (DRL) have completely changed how decision-making and automatic control issues are solved. The study community increasingly applies DRL methods to networking-related optimization issues like routing. Previous suggestions, though, frequently came short of conventional routing methods and could not produce satisfactory outcomes. Because of the constant development of one network efficiency parameter at the cost of individuals, most conventional safeguarding and restoring techniques will become ineffective. We believe that collectively considering the primary network parameters will be more advantageous for thorough network efficiency optimization. Additionally, elastic optical networking (EONS)’ highly adaptive characteristics necessitate the development of innovative machine learning-driven systems that adjust to the constantly changing nature of operations to execute the analysis. This study investigates how to develop DRL agents for resolving a route optimization issue using a generative strategy (GS). Our research findings indicate DRL agents operate better when employing our unique description.

previous article Machine learning aided design and optimization of MEMS optical phased array with silicon micro mirrors for nanofabrication

next article Photonic integrated cmos-compatible true time delay based broadband beamformer

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Chen, X., Guo, J., Zhu, Z., Proietti, R., Castro, A., Yoo, S.B.: Deep-RMSA: a deep-reinforcement-learning routing, modulation and spectrum assignment agent for elastic optical networks. In: Proceedings of the optical fiber communications conference and exposition (OFC), pp. 1–3 San Diego, USA (2018)

Chen, X., Li, B., Proietti, R., Lu, H., Zhu, Z., Yoo, S.B.: DeepRMSA: a deep reinforcement learning framework for routing, modulation and spectrum assignment in elastic optical networks. J. Light. Technol. 37, 4155–4163 (2019)ADSCrossRef

Dinarte, H.A., Correia, B.V., Chaves, D.A., Almeida, R.C.: Routing and spectrum assignment: a metaheuristic for hybrid ordering selection in elastic optical networks. Comput. Netw. 197, 108287 (2021)CrossRef

Halder, J., Acharya, T., Chatterjee, M., Bhattacharya, U.: E-S-RSM-RSA: a novel energy and spectrum efficient regenerator aware multipath based survivable RSA in offline EON. IEEE Trans. Green Commun. Netw. 5, 1451–1466 (2021)CrossRef

Huang, Y.C., Zhang, J., Yu, S.: Self-learning routing for optical networks. In: Lecture Notes in Computer Science, pp. 467–478. Springer, Berlin/Heidelberg, Germany, (2020)

Huang, W., Yuan, B., Wang, S., Zhang, J., Li, J., Zhang, X.: A generic intelligent routing method using deep reinforcement learning with graph neural networks. IET Commun. 16(19), 2343–2351 (2022). https://doi.org/10.1049/cmu2.12487

Jayachitra, S., NitheeshKanna, K., Pavithra, G., Ranjeetha, T.: A novel eye cataract diagnosis and classification using deep neural network. J. Phys. Conf. Ser. 1937(1), 1–7 (2021)CrossRef

Kachhoria, R., Jaiswal, S., Khairnar, S., Rajeswari, K., Pede, S., Kharat, R., Galande, S., Khadse, C.: Lie group deep learning technique to identify the precision errors by map geometry functions in smart manufacturing. Int. J. Adv. Manuf. Technol. (2023). https://doi.org/10.1007/s00170-023-10834-2CrossRef

Koch, R., Kühl, S., Morais, R.M., Spinnler, B., Schairer, W., Sommernkorn-Krombholz, B., Pachnicke, S.: Reinforcement learning for generalized parameter optimization in elastic optical networks. J. Light. Technol. 40, 567–574 (2022)ADSCrossRef

Leonid, T.T., Kanna, H., Claudia Christy V.J., Hamritha, A.S., Lokesh, C.: Human wildlife conflict mitigation using YOLO algorithm. In: 2023 Eighth international conference on science technology engineering and mathematics (ICONSTEM), pp. 1–7, Chennai, India (2023) https://doi.org/10.1109/ICONSTEM56934.2023.10142629.

Li, B., Zhu, Z.: DeepCoop: leveraging cooperative DRL agents to achieve scalable network automation for multi-domain SD-EONs. In: Proceedings of the optical fiber communication conference (OFC), pp. 73–76, San Diego, USA (2020)

Markkandan, S., Sharma, A., Singh, S.P., et al.: SVM-based compliance discrepancies detection using remote sensing for organic farms. Arab. J. Geosci.geosci. 14, 1334 (2021). https://doi.org/10.1007/s12517-021-07700-4CrossRef

Mestres, A., Rodriguez-Natal, A., Carner, J., Barlet-Ros, P., Alarcón, E., et al.: Knowledge-defined networking. SIGCOMM Comput. Commun. Rev. 47, 2–10 (2017)CrossRef

Pujol-Perich, D., Suárez-Varela, J., Ferriol, M., Xiao, S., Wu, B., Cabellos-Aparicio, A., Barlet-Ros, P.: IGNNITION: Bridging the gap between graph neural networks and networking systems. IEEE Netw. 35, 171–177 (2021)CrossRef

Ruban, S.R., Selvam, J.D.R., Wins, K.L.D., Kandavalli, S.R.: Optimization of cutting parameters of hybrid metal matrix composite AA6061/ZrB2 and ZrC during dry turning. In: IOP conference series: materials science and engineering, 993(1), 1–9 (2020)

Silver, D. et al.: Mastering chess and shogi by self-play with a general reinforcement learning algorithm. arXiv:171201815 (2017).

Stampa, G., Arias, M., Sanchez-Charles, D., Muntés-Mulero, V., Cabellos, A.: A deep-reinforcement learning approach for softwaredefined networking routing optimization. CoNEXT Stud. Work. 1–5 (2017)

Suárez-Varela, J., Mestres, A., Yu, J., Kuang, L., Feng, H., Cabellos-Aparicio, A., Barlet-Ros, P.: Routing in optical transport networks with deep reinforcement learning. J. Opt. Commun. Netw. 11, 547–558 (2019)CrossRef

Tang, B., Chen, J., Huang, Y.C., Xue, Y., Zhou, W.: Optical network routing by deep reinforcement learning and knowledge distillation. In: Proceedings of the Asia Communications and Photonics Conference (ACP), pp. 1–3, Shanghai, China (2021)

Xu, L., Huang, Y.C., Xue, Y., Hu, X.: Spectrum continuity and contiguity aware state representation for deep reinforcement learning-based routing of EONs. In: Proceedings of the IEEE optoelectronics global conference (OGC), pp. 73–76, Shenzhen, China (2021)

Yan, B., Zhao, Y., Li, Y., Yu, X., Zhang, J., Wang, Y., Yan, L., Rahman, S.: Actor-critic-based resource allocation for multimodal optical networks. In: Proceedings of the IEEE globecom workshops (GC Wkshps), pp. 1–6, Abu Dhabi, United Arab Emirates (2018)

Zhao, Y., Yan, B., Liu, D., He, Y., Wang, D., Zhang, J.: SOON: Self-optimizing optical networks with machine learning. Opt. Express 26, 28713–28726 (2018)ADSCrossRef

Zhao, Z., Zhao, Y., Ma, H., Li, Y., Rahman, S., Han, D., Zhang, H., Zhang, J.: Cost-efficient routing, modulation, wavelength and port assignment using reinforcement learning in optical transport networks. Opt. Fiber Technol.fiber Technol. 64, 102571 (2021)CrossRef

Title: Deep reinforcement learning for comprehensive route optimization in elastic optical networks using generative strategies
Authors: P. N. Renjith
G. Sujatha
M. Vinoth
G. D. Vignesh
M. Ramkumar Prabhu
B. Mouleswararao
Publication date: 01-12-2023
Publisher: Springer US
Published in: Optical and Quantum Electronics / Issue 13/2023
Print ISSN: 0306-8919
Electronic ISSN: 1572-817X
DOI: https://doi.org/10.1007/s11082-023-05501-5

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 13/2023

Optical conformable recursional and normalized electromagnetic fields

Distributed computing model for channel bandwidth allocation and optimization using machine learning techniques

Accessible soliton solutions with initial phase-front curvature in strongly nonlocal nonlinear media

Coherent-Circular Polarized Shift Keying Modulation Analysis over Malaga Distribution and Ғ Distribution with Pointing Errors in Free Space Optical Communication

Abundant optical solitons to the (2+1)-dimensional Kundu-Mukherjee-Naskar equation in fiber communication systems

Structural, linear/nonlinear optical and electrical studies on PVP/CMC blend filled with hydrogen titanate nanotubes and TMAI