Adaptive Spectrum Management of Cognitive Radio in Intelligent Transportation System

Article Preview

Abstract:

With the rapid development of urban rail transit, the demand of the public in rail transportationto take real-time, reliable and efficient wireless access services, has become the focus of mobilebroadband communications. Wireless cognitive radio (CR) over urban rail transit is a newly emergingparadigm that attempts to opportunistically transmit in licensed frequencies, without affecting the preassignedusers of these bands. To enable this functionality, such a radio must predict its operationalparameters, such as transmit power and spectrum. These tasks, collectively called spectrum management,is difficult to achieve in a dynamic distributed environment, in which CR users may only takelocal decisions, and react to the environmental changes. In this paper, we propose a reinforcementlearning based approach for spectrum management. Our approach uses value functions to evaluate thedesirability of choosing different transmission parameters, and enables efficient assignment of spectrumsand transmit powers by maximizing long-term reward. We then investigate various real-worldscenarios, and compare the communication performance using different sets of learning parameters.The results proves our reinforcement learning based spectrum management can significantly reduceinterference to licensed users, while maintaining a high probability of successful transmissions in acognitive radio ad hoc network.

You might also be interested in these eBooks

Info:

Periodical:

Pages:

765-773

Citation:

Online since:

March 2015

Export:

Price:

[1] F. V. Quickenborne, F. D. Greve, F. D. Turck, A Tunnel based QoS Management Framework for Delivering Broadband Internet on Trains, International Conference on Information Networking (ICOIN 2006). Berlin, Germany: Springer, 2006: 552-561.

DOI: 10.1007/11919568_55

Google Scholar

[2] L. Bart, C. Didier, P. Mario P, Radio over fiber based Solution to Provide Broadband Internet Access tO Train Passengers, IEEE Communications Magazine, 2007, 45(1): 56-62.

DOI: 10.1109/mcom.2007.313395

Google Scholar

[3] T. Wysocki, A. Jamalipour, Spectrum management in cognitive radio: Applications of portfolio theory in wireless communications, IEEE Wireless Communications, vol. 18, no. 4, (2011).

DOI: 10.1109/mwc.2011.5999764

Google Scholar

[4] A. He, K. K. Bae, T. R. Newman, J. Gaeddert, K. Kim, R. Menon, L. M. Tirado, J. J. Neel, Y. P. Zhao, J.H. Reed, W. H. Tranter, A Survey of Artificial Intelligence for Cognitive Radios, IEEE Transactions on Vehicular Technology, Volume 59 , Issue 4 (2010).

DOI: 10.1109/tvt.2010.2043968

Google Scholar

[5] K. Ishizu, M. Kuroda, H. Harada, Bullet train Net work Architecture for Broadband and Real Time Access, 12th IEEE Symposium on Computers and Communications. New York, pp.626-633, (2007).

DOI: 10.1109/iscc.2007.4381563

Google Scholar

[6] M. L. Benitez, F. Casadevall, Spectrum Usage in Cognitive Radio Networks: From Field Measurements to Empirical Models, IEICE Transactions on Communications, Vol. E97-B No. 2, (2014).

DOI: 10.1587/transcom.e97.b.242

Google Scholar

[7] I. F. Akyildiz, W. Y. Lee, M. C. Vuran, and S. Mohanty Next generation / dynamic spectrum access / cognitive radio wireless networks: a survey, Computer Networks Journal (Elsevier), 50: 2127-2159, September (2006).

DOI: 10.1016/j.comnet.2006.05.001

Google Scholar

[8] S. Haykin, Cognitive radio: Brain-empowered wireless communications, IEEE Journal on Selected Areas in Communications, 23(2): 201-220, February (2005).

DOI: 10.1109/jsac.2004.839380

Google Scholar

[9] J. Mitola III, Cognitive radio for exible mobile multimedia communication, In Proc. IEEE International Workshop on Mobile Multimedia Communications (MoMuC) 1999, pages 3-10, November (1999).

DOI: 10.1109/momuc.1999.819467

Google Scholar

[10] M. D. Felice K. R. Chowdhury and L. Bononi, Modeling and performance evaluation of transmission control protocol over cognitive radio ad hoc networks, In ACM MSWIM Conference, October (2009).

DOI: 10.1145/1641804.1641809

Google Scholar

[11] R. Sutton and A. Barto, Reinforcement Learning: An Introduction, Bradford Books, (1998).

Google Scholar

[12] M. D. Waltz and K. S. Fu, A heuristic approach to reinforcment learning control systems, In IEEE Transactions on Automatic Control, 10: 390-398., (1965).

DOI: 10.1109/tac.1965.1098193

Google Scholar

[13] I. F. Akyildiz, W. Y. Lee, and K. R. Chowdhury, Crahns: Cognitive radio ad hoc networks, Ad Hoc Networks Journal (Elsevier), 7(5): 810-836, July (2009).

DOI: 10.1016/j.adhoc.2009.01.001

Google Scholar

[14] I. F. Akyildiz, W. Y. Lee, and K. R. Chowdhury, Spectrum management in cognitive radio ad hoc networks, IEEE Network, 23(4): 6-12, July (2009).

DOI: 10.1109/mnet.2009.5191140

Google Scholar

[15] C. Wu, K. Chowdhury, M. Di Felice, and W. Meleis, Spectrum Management of Cognitive Radio Using Multi-agent Reinforcement Learning, Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), Toronto, Canada, (2010).

Google Scholar

[16] M. Di Felice, K. Chowdhury, C. Wu, L. Bononi, and W. Meleis, Learning-based Spectrum Selection in Cognitive Radio Ad Hoc Networks, Proceedings of the Eight International Conference on Wired/Wireless Internet Communications (WWIC), Invited paper, Lulea, Sweden, (2010).

DOI: 10.1007/978-3-642-13315-2_11

Google Scholar

[17] M. L. Puterman, Markov decision processes, In Wiley, (1994).

Google Scholar