Skip to main content
Top
Published in: International Journal of Machine Learning and Cybernetics 11/2021

02-01-2021 | Original Article

A reinforcement learning optimization for future smart cities using software defined networking

Authors: Kulandaivel Rajkumar, Manikandan Ramachandran, Fadi Al-Turjman, Rizwan Patan

Published in: International Journal of Machine Learning and Cybernetics | Issue 11/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Nowadays smart cities towards software defined network (SDN) approach will become better flexibility and manageability. A stronger, more dynamic network is an SDN network, which is precisely what a smart city network must be if it wants to be viable on a real-world scale. SDN architecture is developed to implement a learning framework for network optimization. The proposed method is called mixed-integer and reinforcement learned network optimization (MI-RLNO) for SDN monitoring. In the first phase, mixed-integer programming formulation is used as an optimization formulation for latency and convergence time. In the second phase, a reinforced Q Learning model is designed that uses communication and computation time as input state vector. Optimization formulation is used as the actions and strategies to be followed during the design and operation of communication networks, therefore contributing fairness and throughput. Simulation results improved the efficiency of the MI-RLNO method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Barmpounakis S, Maroulis N, Papadakis M, Tsiatsios G, Soukaras D, Alonistioti N (2019) Network slicing-enabled RAN management for 5G: cross-layer control based on SDN and SDR. Comput Netw 166:106987CrossRef Barmpounakis S, Maroulis N, Papadakis M, Tsiatsios G, Soukaras D, Alonistioti N (2019) Network slicing-enabled RAN management for 5G: cross-layer control based on SDN and SDR. Comput Netw 166:106987CrossRef
2.
go back to reference Castillo EF, Granville LZ, Ordonez A, Rendon OMC (2020) IPro: an Approach for intelligent SDN monitoring. Comput Netw 170:107108CrossRef Castillo EF, Granville LZ, Ordonez A, Rendon OMC (2020) IPro: an Approach for intelligent SDN monitoring. Comput Netw 170:107108CrossRef
3.
go back to reference Gifty R, Bharathi R (2020) Weibull cumulative distribution based real-time response and performance capacity modeling of cyber-physical systems through software defined networking. Comput Commun 150:235–244CrossRef Gifty R, Bharathi R (2020) Weibull cumulative distribution based real-time response and performance capacity modeling of cyber-physical systems through software defined networking. Comput Commun 150:235–244CrossRef
4.
go back to reference Lin K, Li C, Tian D, Ghoneim A, Hossain MS, Amin SU (2019) Artificial-intelligence-based data analytics for cognitive communication in heterogeneous wireless networks. Artif Intell Cogn Wirel Commun IEEE Wirel Commun 26:83–89CrossRef Lin K, Li C, Tian D, Ghoneim A, Hossain MS, Amin SU (2019) Artificial-intelligence-based data analytics for cognitive communication in heterogeneous wireless networks. Artif Intell Cogn Wirel Commun IEEE Wirel Commun 26:83–89CrossRef
5.
go back to reference Dai Y, Xu D, Maharjan S, Chen Z, He Q, Zhang Y (2019) Blockchain and deep reinforcement learning empowered intelligent 5G beyond. IEEE Netw 33:10–17CrossRef Dai Y, Xu D, Maharjan S, Chen Z, He Q, Zhang Y (2019) Blockchain and deep reinforcement learning empowered intelligent 5G beyond. IEEE Netw 33:10–17CrossRef
6.
go back to reference Huang X, Yu R, Kang J, He Y, Zhang Y (2017) Exploring mobile edge computing for 5G-enabled software defined vehicular networks, emerging technology for 5G enabled vehicular networks. IEEE Wirel Commun 24:55–63CrossRef Huang X, Yu R, Kang J, He Y, Zhang Y (2017) Exploring mobile edge computing for 5G-enabled software defined vehicular networks, emerging technology for 5G enabled vehicular networks. IEEE Wirel Commun 24:55–63CrossRef
7.
go back to reference Zhou Z, Feng J, Zhang C, Chang Z, Zhang Y, Huq KMS (2018) SAGECELL: software-defined space-air-ground integrated moving cells, orchestration of ultra-dense 5G networks. IEEE Commun Mag 56:92–99CrossRef Zhou Z, Feng J, Zhang C, Chang Z, Zhang Y, Huq KMS (2018) SAGECELL: software-defined space-air-ground integrated moving cells, orchestration of ultra-dense 5G networks. IEEE Commun Mag 56:92–99CrossRef
8.
go back to reference Guan I, Huang Y, Chen M, Wu H, Ohtsuki T, Zhang Y (2017) Exploiting interference for capacity improvement in software-defined vehicular networks. IEEE Access 5:10662–10673CrossRef Guan I, Huang Y, Chen M, Wu H, Ohtsuki T, Zhang Y (2017) Exploiting interference for capacity improvement in software-defined vehicular networks. IEEE Access 5:10662–10673CrossRef
9.
go back to reference Huang X, Yu R, Kang J, Gao Y, Maharjan S, Gjessing S, Zhang Y (2017) Software defined energy harvesting networking for 5g green communications. IEEE Wirel Commun 24:38–45CrossRef Huang X, Yu R, Kang J, Gao Y, Maharjan S, Gjessing S, Zhang Y (2017) Software defined energy harvesting networking for 5g green communications. IEEE Wirel Commun 24:38–45CrossRef
10.
go back to reference Li Q, Yao H, Mai T, Jiang C, Zhang Y (2015) Reinforcement-Learning-and Belief-Learning-Based Double Auction Mechanism for Edge Computing Resource Allocation. IEEE Internet Things J 7(7):5976–5985CrossRef Li Q, Yao H, Mai T, Jiang C, Zhang Y (2015) Reinforcement-Learning-and Belief-Learning-Based Double Auction Mechanism for Edge Computing Resource Allocation. IEEE Internet Things J 7(7):5976–5985CrossRef
11.
go back to reference Huang X, Yu R, Kang J, Xia Z, Zhang Y (2018) Software defined networking for energy harvesting internet of things. IEEE Internet Things J 5:1389–1399 Huang X, Yu R, Kang J, Xia Z, Zhang Y (2018) Software defined networking for energy harvesting internet of things. IEEE Internet Things J 5:1389–1399
12.
go back to reference Assefa BG, Özkasap Ö (2019) Resdn: A novel metric and method for energy efficient routing in software defined networks. IEEE Trans Netw Serv Manag 17(2):736–749CrossRef Assefa BG, Özkasap Ö (2019) Resdn: A novel metric and method for energy efficient routing in software defined networks. IEEE Trans Netw Serv Manag 17(2):736–749CrossRef
13.
go back to reference Jamali S, Badirzadeh A, Siapoush MS (2019) On the use of the genetic programming for balanced load distribution in software-defined networks. Digit Commun Netw 5:288–296CrossRef Jamali S, Badirzadeh A, Siapoush MS (2019) On the use of the genetic programming for balanced load distribution in software-defined networks. Digit Commun Netw 5:288–296CrossRef
14.
go back to reference Priyadarsini MK, Mukherjee JC, Bera P, Kumar S, Jakaria AHM, Rahman MA (2019) An adaptive load balancing scheme for software-defined network controllers. Comput Netw 164:106918CrossRef Priyadarsini MK, Mukherjee JC, Bera P, Kumar S, Jakaria AHM, Rahman MA (2019) An adaptive load balancing scheme for software-defined network controllers. Comput Netw 164:106918CrossRef
15.
go back to reference Albahar MA (2019) Recurrent neural network model based on a new regularization technique for real-time intrusion detection in SDN environments. Secur Commun Netw 2019:1–9CrossRef Albahar MA (2019) Recurrent neural network model based on a new regularization technique for real-time intrusion detection in SDN environments. Secur Commun Netw 2019:1–9CrossRef
16.
go back to reference Chen Y, Lv K, Hu C (2018) A dynamic hidden forwarding path planning method based on improved Q-learning in SDN environments. Secur Commun Netw 2018:1–12 Chen Y, Lv K, Hu C (2018) A dynamic hidden forwarding path planning method based on improved Q-learning in SDN environments. Secur Commun Netw 2018:1–12
17.
go back to reference Singh AK, Maurya S, Srivastava S (2019) Varna-based optimization: a novel method for capacitated controller placement problem in SDN. Front Comput Sci 14:143402CrossRef Singh AK, Maurya S, Srivastava S (2019) Varna-based optimization: a novel method for capacitated controller placement problem in SDN. Front Comput Sci 14:143402CrossRef
18.
go back to reference Sahoo KS, Panda SK, Sahoo S, Sahoo B, Dash R (2019) Toward secure software-defined networks against distributed denial of service attack. J Supercomput 75:4829–4874CrossRef Sahoo KS, Panda SK, Sahoo S, Sahoo B, Dash R (2019) Toward secure software-defined networks against distributed denial of service attack. J Supercomput 75:4829–4874CrossRef
19.
go back to reference Liu W, Wang Y, Zhang J, Liao H, Liang Z, Liu X (2019) AAMcon: an adaptively distributed SDN controller in datacenter networks. Front Comput Sci 14:146–161CrossRef Liu W, Wang Y, Zhang J, Liao H, Liang Z, Liu X (2019) AAMcon: an adaptively distributed SDN controller in datacenter networks. Front Comput Sci 14:146–161CrossRef
Metadata
Title
A reinforcement learning optimization for future smart cities using software defined networking
Authors
Kulandaivel Rajkumar
Manikandan Ramachandran
Fadi Al-Turjman
Rizwan Patan
Publication date
02-01-2021
Publisher
Springer Berlin Heidelberg
Published in
International Journal of Machine Learning and Cybernetics / Issue 11/2021
Print ISSN: 1868-8071
Electronic ISSN: 1868-808X
DOI
https://doi.org/10.1007/s13042-020-01245-w

Other articles of this Issue 11/2021

International Journal of Machine Learning and Cybernetics 11/2021 Go to the issue