Skip to main content
Top
Published in: Optical and Quantum Electronics 1/2024

01-01-2024

Reinforcement learning-based model for the prevention of beam-forming vector attacks on massive MIMO system

Authors: R. Nithya Paranthaman, Abhishek Sonker, S. Varalakshmi, M. Madiajagan, K. V. Daya Sagar, M. Malathi

Published in: Optical and Quantum Electronics | Issue 1/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Massive multiple-input multiple-output (MMIMO) is a WiFi access technique studied and investigated in response to the worldwide bandwidth bottleneck in the WiFi telecommunication industry. Massive MIMO, which brings multiple antennae to transmission and reception to deliver excellent spectrum and power effectiveness with comparatively simple computation, is among the leading fundamental technologies for next-generation networking. For such a practical implementation of 5G—and further, that networks will realize many implementations of the smart sensor device—it is essential to gain a greater understanding of such a massive MIMO model to address its underlying problems. Because of the significant achievements of reinforcement learning (RL) and deep learning (DL), new and potent techniques are now available to help MIMO telecommunication networks deal with problems. This paper presents a thorough analysis of the convergence among the two fields, emphasizing RL and DL methods for MIMO networks. Throughout this article, a framework for RL-based beam-forming vector assault defense has been presented (reinforcement learning). Its outcomes demonstrated acceptable efficiency as well as the anticipated outcome.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Aytar, Y.: Playing hard exploration games by watching youtube. In: Proceedings of the annual conference on neural information processing systems 2018, NeurIPS 2018, Montreal, QC, Canada (2018) Aytar, Y.: Playing hard exploration games by watching youtube. In: Proceedings of the annual conference on neural information processing systems 2018, NeurIPS 2018, Montreal, QC, Canada (2018)
go back to reference Brunner, G., Richter, O., Wang, Y., Wattenhofer, R.: Teaching a machine to read maps with deep reinforcement learning. In: Proceedings of the AAAI conference on artificial intelligence (AAAI), New Orleans, LA (2018) Brunner, G., Richter, O., Wang, Y., Wattenhofer, R.: Teaching a machine to read maps with deep reinforcement learning. In: Proceedings of the AAAI conference on artificial intelligence (AAAI), New Orleans, LA (2018)
go back to reference Cao, Y., Zhang, G., Li, G., Zhang, J.: A deep Q-network based-resource allocation scheme for massive MIMO-NOMA. IEEE Commun. Lett. 25, 1544–1548 (2021)CrossRef Cao, Y., Zhang, G., Li, G., Zhang, J.: A deep Q-network based-resource allocation scheme for massive MIMO-NOMA. IEEE Commun. Lett. 25, 1544–1548 (2021)CrossRef
go back to reference Coronato, A., Naeem, M., De Pietro, G., Paragliola, G.: Reinforcement learning for intelligent healthcare applications: a survey. Artif. Intell. Med. 109, 101964 (2020)CrossRefPubMed Coronato, A., Naeem, M., De Pietro, G., Paragliola, G.: Reinforcement learning for intelligent healthcare applications: a survey. Artif. Intell. Med. 109, 101964 (2020)CrossRefPubMed
go back to reference Gante, J., Falcao, G., Sousa, L.: Deep learning architectures for accurate millimeter wave positioning in 5G. Neural. Process. Lett. 51, 487–514 (2020)CrossRef Gante, J., Falcao, G., Sousa, L.: Deep learning architectures for accurate millimeter wave positioning in 5G. Neural. Process. Lett. 51, 487–514 (2020)CrossRef
go back to reference He, H., Wen, C.K., Jin, S., Li, G.Y.: Deep learning-based channel estimation for beamspacemmWave massive MIMO systems. IEEE Wirel. Commun. Lett. 7, 852–855 (2018)CrossRef He, H., Wen, C.K., Jin, S., Li, G.Y.: Deep learning-based channel estimation for beamspacemmWave massive MIMO systems. IEEE Wirel. Commun. Lett. 7, 852–855 (2018)CrossRef
go back to reference Jeerige, A., Bein, D., Verma, A.: Comparison of deep reinforcement learning approaches for intelligent game playing. In: Proceedings of the 9th annual computing and communication workshop and conference (CCWC), pp. 0366–0371, Las Vegas, NV (2019) Jeerige, A., Bein, D., Verma, A.: Comparison of deep reinforcement learning approaches for intelligent game playing. In: Proceedings of the 9th annual computing and communication workshop and conference (CCWC), pp. 0366–0371, Las Vegas, NV (2019)
go back to reference Künzel, G., Cainelli, G.P., Müller, I., Pereira, C.E.: Weight adjustments in a routing algorithm for wireless sensor and actuator networks using Q-learning. IFAC-PapersOnLine 51, 58–63 (2018)CrossRef Künzel, G., Cainelli, G.P., Müller, I., Pereira, C.E.: Weight adjustments in a routing algorithm for wireless sensor and actuator networks using Q-learning. IFAC-PapersOnLine 51, 58–63 (2018)CrossRef
go back to reference Le, H.A., Van Chien, T., Nguyen, T.H., Choo, H., Nguyen, V.D.: Machine learning-based 5g-and-beyond channel estimation for MIMO-OFDM communication systems. Sensors 21, 4861 (2021)CrossRefPubMedPubMedCentralADS Le, H.A., Van Chien, T., Nguyen, T.H., Choo, H., Nguyen, V.D.: Machine learning-based 5g-and-beyond channel estimation for MIMO-OFDM communication systems. Sensors 21, 4861 (2021)CrossRefPubMedPubMedCentralADS
go back to reference Li, P., Jiang, Y., Li, W., Zheng, F. and You, X.: A cmdp-based approach for energy efficient power allocation in massive mimo systems. In: 2016 IEEE wireless communications and networking conference, pp. 1–6 (2016) Li, P., Jiang, Y., Li, W., Zheng, F. and You, X.: A cmdp-based approach for energy efficient power allocation in massive mimo systems. In: 2016 IEEE wireless communications and networking conference, pp. 1–6 (2016)
go back to reference Liu, X., Qin, Z., Gao, Y.: Resource allocation for edge computing in IoT networks via reinforcement learning. In: Proceedings of the ICC 2019–2019 IEEE international conference on communications (ICC), pp. 1–6, Shanghai (2019) Liu, X., Qin, Z., Gao, Y.: Resource allocation for edge computing in IoT networks via reinforcement learning. In: Proceedings of the ICC 2019–2019 IEEE international conference on communications (ICC), pp. 1–6, Shanghai (2019)
go back to reference Liu, Y.J., Tang, L., Tong, S., Chen, C.P., Li, D.J.: Reinforcement learning design-based adaptive tracking control with less learning parameters for nonlinear discrete-time MIMO systems. IEEE Trans. Neural Netw. Learn. Syst. 26, 165–176 (2014)MathSciNetCrossRefPubMed Liu, Y.J., Tang, L., Tong, S., Chen, C.P., Li, D.J.: Reinforcement learning design-based adaptive tracking control with less learning parameters for nonlinear discrete-time MIMO systems. IEEE Trans. Neural Netw. Learn. Syst. 26, 165–176 (2014)MathSciNetCrossRefPubMed
go back to reference Maksymyuk, T., Gazda, J., Yaremko, O., Nevinskiy, D.: Deep learning based massive MIMO beamforming for 5G mobile network. In: Proceedings of the 2018 IEEE 4th international symposium on wireless systems within the international conferences on intelligent data acquisition and advanced computing systems (IDAACS-SWS), pp. 241–244, Dortmund, (2018) Maksymyuk, T., Gazda, J., Yaremko, O., Nevinskiy, D.: Deep learning based massive MIMO beamforming for 5G mobile network. In: Proceedings of the 2018 IEEE 4th international symposium on wireless systems within the international conferences on intelligent data acquisition and advanced computing systems (IDAACS-SWS), pp. 241–244, Dortmund, (2018)
go back to reference Mao, Q., Hu, F., Hao, Q.: Deep learning for intelligent wireless networks: a comprehensive survey. IEEE Commun. Surv. Tutor. 20, 2595–2621 (2018)CrossRef Mao, Q., Hu, F., Hao, Q.: Deep learning for intelligent wireless networks: a comprehensive survey. IEEE Commun. Surv. Tutor. 20, 2595–2621 (2018)CrossRef
go back to reference Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., Hassabis, D.: Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)CrossRefPubMedADS Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., Petersen, S., Beattie, C., Sadik, A., Antonoglou, I., King, H., Kumaran, D., Wierstra, D., Legg, S., Hassabis, D.: Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)CrossRefPubMedADS
go back to reference Naeem, M., Paragliola, G., Coronato, A.: A reinforcement learning and deep learning based intelligent system for the support of impaired patients in home treatment. Expert Syst. Appl. 168, 114285 (2021)CrossRef Naeem, M., Paragliola, G., Coronato, A.: A reinforcement learning and deep learning based intelligent system for the support of impaired patients in home treatment. Expert Syst. Appl. 168, 114285 (2021)CrossRef
go back to reference Patel, P.A. Millimeter wave positioning with deep learning. Master's Thesis, California State University, Sacramento, CA, USA, 2020. Patel, P.A. Millimeter wave positioning with deep learning. Master's Thesis, California State University, Sacramento, CA, USA, 2020.
go back to reference Sabarinath, R., Markkandan, S.: “Complexity Analysis and Performance Comparison of Channel Decomposition methods used in MIMO Precoder Design”. International Journal of Applied Engineering Research (IJAER), 2015. Sabarinath, R., Markkandan, S.: “Complexity Analysis and Performance Comparison of Channel Decomposition methods used in MIMO Precoder Design”. International Journal of Applied Engineering Research (IJAER), 2015.
go back to reference Saravanan, M., Kumar, P.S., Sharma, A.: IoT Enabled indoor autonomous mobile robot using CNN and Q-learning. In: Proceedings of the 2019 IEEE international conference on industry 4.0, artificial intelligence, and communications technology (IAICT), Bali, Indonesia, (2019) Saravanan, M., Kumar, P.S., Sharma, A.: IoT Enabled indoor autonomous mobile robot using CNN and Q-learning. In: Proceedings of the 2019 IEEE international conference on industry 4.0, artificial intelligence, and communications technology (IAICT), Bali, Indonesia, (2019)
go back to reference Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., Dieleman, S., Grewe, D., Nham, J., Kalchbrenner, N., Sutskever, I., Lillicrap, T., Leach, M., Kavukcuoglu, K., Graepel, T., Hassabis, D.: Mastering the game of go with deep neural networks and tree search. Nature 529(7587), 484–489 (2016)CrossRefPubMedADS Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., Dieleman, S., Grewe, D., Nham, J., Kalchbrenner, N., Sutskever, I., Lillicrap, T., Leach, M., Kavukcuoglu, K., Graepel, T., Hassabis, D.: Mastering the game of go with deep neural networks and tree search. Nature 529(7587), 484–489 (2016)CrossRefPubMedADS
go back to reference Sutton, R.S., Barto, A.G.: Reinforcement learning: an introduction, 2nd edn. MIT Press, Cambridge (2017) Sutton, R.S., Barto, A.G.: Reinforcement learning: an introduction, 2nd edn. MIT Press, Cambridge (2017)
go back to reference Venkata Lalitha Narla, Renu Kachhoria, M. Arun, Anandakumar Haldorai, D. Vijendra Babu, Bos Mathew Jos. IoT based energy efficient multipath power control for underwater sensor network. International Journal of Systems Assurance Engineering and Management. Published by Springer Verlag Online ISSN: 0976–4348. https://doi.org/10.1007/s13198-021-01560-7 Venkata Lalitha Narla, Renu Kachhoria, M. Arun, Anandakumar Haldorai, D. Vijendra Babu, Bos Mathew Jos. IoT based energy efficient multipath power control for underwater sensor network. International Journal of Systems Assurance Engineering and Management. Published by Springer Verlag Online ISSN: 0976–4348. https://​doi.​org/​10.​1007/​s13198-021-01560-7
go back to reference Wang, X., Gursoy, M.C.: Multiagent double deep Q-learning for beamforming in mmWave MIMO networks. In: Proceedings of the 2020 IEEE 31st annual international symposium on personal, indoor and mobile radio communications, Helsinki, Finland, pp. 1–6 (2020) Wang, X., Gursoy, M.C.: Multiagent double deep Q-learning for beamforming in mmWave MIMO networks. In: Proceedings of the 2020 IEEE 31st annual international symposium on personal, indoor and mobile radio communications, Helsinki, Finland, pp. 1–6 (2020)
go back to reference Wang, Q., Feng, K., Li, X., Jin, S.: PrecoderNet: hybrid beamforming for millimeter wave systems with deep reinforcement learning. IEEE Wirel. Commun. Lett. 9, 1677–1681 (2020)CrossRef Wang, Q., Feng, K., Li, X., Jin, S.: PrecoderNet: hybrid beamforming for millimeter wave systems with deep reinforcement learning. IEEE Wirel. Commun. Lett. 9, 1677–1681 (2020)CrossRef
go back to reference Xin, Y.: Machine learning and deep learning methods for cybersecurity. IEEE Access 6, 35365–35381 (2018)CrossRef Xin, Y.: Machine learning and deep learning methods for cybersecurity. IEEE Access 6, 35365–35381 (2018)CrossRef
go back to reference Zhou, B., Cui, Y., Tao, M.: Stochastic content-centric multicast scheduling for cache-enabled heterogeneous cellular networks. IEEE Trans. Wirel. Commun. 15(9), 6284–6297 (2016)CrossRef Zhou, B., Cui, Y., Tao, M.: Stochastic content-centric multicast scheduling for cache-enabled heterogeneous cellular networks. IEEE Trans. Wirel. Commun. 15(9), 6284–6297 (2016)CrossRef
go back to reference Zimaglia, E.: Deep learning application to 5G physical layer for channel estimation and csi feedback improvement. Ph.D. Thesis, Politecnico di Torino, Torino, Italy, 2019. Zimaglia, E.: Deep learning application to 5G physical layer for channel estimation and csi feedback improvement. Ph.D. Thesis, Politecnico di Torino, Torino, Italy, 2019.
Metadata
Title
Reinforcement learning-based model for the prevention of beam-forming vector attacks on massive MIMO system
Authors
R. Nithya Paranthaman
Abhishek Sonker
S. Varalakshmi
M. Madiajagan
K. V. Daya Sagar
M. Malathi
Publication date
01-01-2024
Publisher
Springer US
Published in
Optical and Quantum Electronics / Issue 1/2024
Print ISSN: 0306-8919
Electronic ISSN: 1572-817X
DOI
https://doi.org/10.1007/s11082-023-05660-5

Other articles of this Issue 1/2024

Optical and Quantum Electronics 1/2024 Go to the issue