Skip to main content
Top

2021 | OriginalPaper | Chapter

A USRP-Based Testbed of Multi-agent Reinforcement Learning for Dynamic Spectrum Anti-Jamming

Authors : Lijun Kong, Ximing Wang, Xufang Pei, Luliang Jia, Dianxiong Liu, Kailing Yao, Yuhua Xu

Published in: Advances in Wireless Communications and Applications

Publisher: Springer Singapore

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this article, we develop a demonstrated multi-agent dynamic spectrum anti-jamming (MDSA) system using LabVIEW software and USRP-based soft defined radio platform. In the system, we design four subsystems, i.e., wireless transmission subsystem, wideband spectrum sensing subsystem, autonomous decision subsystem, and jamming subsystem. A multi-agent collaborative Q-learning (MACQL) algorithm is adopted in the autonomous decision subsystem to avoid the jamming and the co-channel interference between the agents. The dynamic process of the experiment is illustrated by the screenshots of the software. By showing that the data are successfully received and the performance of the MACQL algorithm is better than the sensing-based method, the MDSA system is realized and the effectiveness of the MACQL algorithm is demonstrated.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chen, C., Song, M., Xin, C., Backens, J.: A game-theoretical anti-jamming scheme for cognitive radio networks. IEEE Netw. 27(3), 22–27 (2013)CrossRef Chen, C., Song, M., Xin, C., Backens, J.: A game-theoretical anti-jamming scheme for cognitive radio networks. IEEE Netw. 27(3), 22–27 (2013)CrossRef
2.
go back to reference Slimeni, F., Chtourou, Z., Scheers, B., Le Nir, V., Attia, R.: Cooperative Q-learning based channel selection for cognitive radio networks. Wirel. Netw. (2018) Slimeni, F., Chtourou, Z., Scheers, B., Le Nir, V., Attia, R.: Cooperative Q-learning based channel selection for cognitive radio networks. Wirel. Netw. (2018)
3.
go back to reference Aref, M.A., Jayaweera, S.K., Machuzak, S.: Multi-agent reinforcement learning based cognitive anti-jamming. In: IEEE Wireless Communications and Networking Conference (WCNC), pp. 1–6 (2017) Aref, M.A., Jayaweera, S.K., Machuzak, S.: Multi-agent reinforcement learning based cognitive anti-jamming. In: IEEE Wireless Communications and Networking Conference (WCNC), pp. 1–6 (2017)
4.
go back to reference Aref, M.A., Jayaweera, S.K.: A novel cognitive anti-jamming stochastic game. In: Cognitive Communications for Aerospace Applications Workshop (CCAA), pp. 1–4 (2017) Aref, M.A., Jayaweera, S.K.: A novel cognitive anti-jamming stochastic game. In: Cognitive Communications for Aerospace Applications Workshop (CCAA), pp. 1–4 (2017)
5.
go back to reference Vlassis, N.: A concise introduction to multiagent systems and distributed artificial intelligence. Synthesis Lect. Artif. Intell. Mach. Learn. 1(1), 1–71 (2007)CrossRef Vlassis, N.: A concise introduction to multiagent systems and distributed artificial intelligence. Synthesis Lect. Artif. Intell. Mach. Learn. 1(1), 1–71 (2007)CrossRef
6.
go back to reference Yao, F., Jia, L.: A collaborative multi-agent reinforcement learning anti-jamming algorithm in wireless networks. IEEE Wirel. Commun. Lett. 8(4), 1024–1027 (2019)MathSciNetCrossRef Yao, F., Jia, L.: A collaborative multi-agent reinforcement learning anti-jamming algorithm in wireless networks. IEEE Wirel. Commun. Lett. 8(4), 1024–1027 (2019)MathSciNetCrossRef
7.
go back to reference Xu, Y., Ren, G., Chen, J., Zhang, X., Jia, L., Kong, L.: Interference-Aware cooperative anti-jamming distributed channel selection in UAV communication networks. Appl. Sci. 8(10) (2018) Xu, Y., Ren, G., Chen, J., Zhang, X., Jia, L., Kong, L.: Interference-Aware cooperative anti-jamming distributed channel selection in UAV communication networks. Appl. Sci. 8(10) (2018)
8.
go back to reference Wang, X., Wang, J., Xu, Y., Chen, J., Jia, L., Liu, X., Yang, Y.: Dynamic spectrum anti-jamming communications: challenges and opportunities. Accepted by IEEE Communications Magazine Wang, X., Wang, J., Xu, Y., Chen, J., Jia, L., Liu, X., Yang, Y.: Dynamic spectrum anti-jamming communications: challenges and opportunities. Accepted by IEEE Communications Magazine
11.
go back to reference Zeng, H.: Demo abstract: An anti-jamming wireless communication system. In: IEEE INFOCOM 2018—IEEE Conference on Computer Communications Workshops, Honolulu, HI, pp. 1–2 (2018) Zeng, H.: Demo abstract: An anti-jamming wireless communication system. In: IEEE INFOCOM 2018—IEEE Conference on Computer Communications Workshops, Honolulu, HI, pp. 1–2 (2018)
12.
go back to reference Sharma, N., Rawat, D., Bista, B., Shetty, S.: A testbed using USRP and LabView for dynamic spectrum access in cognitive radio networks. In: 2015 IEEE 29th International Conference on Advanced Information Networking and Applications, Gwangiu, pp. 735–740 (2015) Sharma, N., Rawat, D., Bista, B., Shetty, S.: A testbed using USRP and LabView for dynamic spectrum access in cognitive radio networks. In: 2015 IEEE 29th International Conference on Advanced Information Networking and Applications, Gwangiu, pp. 735–740 (2015)
13.
go back to reference Kong, L., Xu, Y., Pei, X., Ke, M., Wang, X., Bai, W., Feng, Z.: A reinforcement learning approach for dynamic spectrum anti-jamming in fading environment. In: 18th IEEE International Conference on Communication Technology (ICCT’18) (2018) Kong, L., Xu, Y., Pei, X., Ke, M., Wang, X., Bai, W., Feng, Z.: A reinforcement learning approach for dynamic spectrum anti-jamming in fading environment. In: 18th IEEE International Conference on Communication Technology (ICCT’18) (2018)
14.
go back to reference Liu, X., Xu, Y., Jia, L., Wu, Q., Anpalagan. A.: Anti-jamming communications using spectrum waterfall: a deep reinforcement learning approach. IEEE Communi. Lett. 22(5), 998–1001 Liu, X., Xu, Y., Jia, L., Wu, Q., Anpalagan. A.: Anti-jamming communications using spectrum waterfall: a deep reinforcement learning approach. IEEE Communi. Lett. 22(5), 998–1001
15.
go back to reference Ge, J., Chen, X., Ge, L., Kong, L., Pei. X.: Fast wideband spectrum sensing method based on USRP. Commun. Technol. 50(12), 2714–2721 (2017) (in Chinese) Ge, J., Chen, X., Ge, L., Kong, L., Pei. X.: Fast wideband spectrum sensing method based on USRP. Commun. Technol. 50(12), 2714–2721 (2017) (in Chinese)
16.
go back to reference Kong, L., Xu, Y., Chen, X., Zhao, L., Zhou, X.: Design and implementation of data transmission system based on USRP and selective retransmission protocol. Commun. Technol. 51(06), 1259–1267 (2018). (in Chinese) Kong, L., Xu, Y., Chen, X., Zhao, L., Zhou, X.: Design and implementation of data transmission system based on USRP and selective retransmission protocol. Commun. Technol. 51(06), 1259–1267 (2018). (in Chinese)
Metadata
Title
A USRP-Based Testbed of Multi-agent Reinforcement Learning for Dynamic Spectrum Anti-Jamming
Authors
Lijun Kong
Ximing Wang
Xufang Pei
Luliang Jia
Dianxiong Liu
Kailing Yao
Yuhua Xu
Copyright Year
2021
Publisher
Springer Singapore
DOI
https://doi.org/10.1007/978-981-15-5697-5_4