Weitere Artikel dieser Ausgabe durch Wischen aufrufen
This paper studies the packet scheduling problem in Broadband Wireless Access (BWA) networks. The key difficulties of the BWA scheduling problem lie in the high variability of wireless channel capacity and the unknown model of packet arrival process. It is difficult for traditional heuristic scheduling algorithms to handle the situation and guarantee satisfying performance in BWA networks. In this paper, we introduce learning-based approach for a better solution. Specifically, we formulate the packet scheduling problem as an average cost Semi-Markov Decision Process (SMDP). Then, we solve the SMDP by using reinforcement learning. A feature-based linear approximation and the Temporal-Difference learning technique are employed to produce a near optimal solution of the corresponding SMDP problem. The proposed algorithm, called Reinforcement Learning Scheduling (RLS), has in-built capability of self-training. It is able to adaptively and timely regulate its scheduling policy according to the instantaneous network conditions. Simulation results indicate that RLS outperforms two classical scheduling algorithms and simultaneously considers: (i) effective QoS differentiation, (ii) high bandwidth utilization, and (iii) both short-term and long-term fairness.
Cao Y, Victor OK: Scheduling algorithms in broad-band wireless networks. Proceedings of the IEEE 2001, 89(1):76-87. 10.1109/5.904507 CrossRef
Sutton RS: Learning to predict by the methods of temporal differences. Machine Learning 1988, 3(1):9-44.
Wischhof L, Lockwood JW: Packet scheduling for link-sharing and quality of service support in wireless local area. November 2001., (WUCS-01-35):
Shreedhar M, Varghese G: Efficient fair queuing using deficit round-robin. IEEE/ACM Transactions on Networking 1996, 4(3):375-385. 10.1109/90.502236 CrossRef
Parekh AK, Gallage RG: A generalized processor sharing approach to fow control in integrated services networks: the single-node case. IEEE/ACM Transactions on Networking 1993, 1(3):344-357. 10.1109/90.234856 CrossRef
Elliott EO: Estimates of error rates for codes on burst-noise channels. Bell System Technical Journal 1963, 42(9):1977-1997. CrossRef
Lu S, Bharghavan V, Srikant R: Fair scheduling in wireless packet networks. IEEE/ACM Transactions on Networking 1999, 7(4):473-489. 10.1109/90.793003 CrossRef
Eugen Ng TS, Stoica I, Zhang H: Packet fair queueing algorithms for wireless networks with location-dependent errors. Proceedings of the 17th Annual IEEE Conference on Computer Communications (INFOCOM '98), March 1998, San Francisco, Calif, USA 3: 1103-1111.
Wong WK, Zhu H, Leung VCM: Soft QoS provisioning using the token bank fair queuing scheduling algorithm. IEEE Wireless Communications 2003, 10(3):8-16. 10.1109/MWC.2003.1209591 CrossRef
Andrews M, Kumaran K, Ramanan K, Stolyar A, Whiting P, Vijayakumar R: Providing quality of service over a shared wireless link. IEEE Communications Magazine 2001, 39(2):150-153. 10.1109/35.900644 CrossRef
Jalali A, Padovani R, Pankaj R: Data throughput of CDMA-HDR a high efficiency-high data rate personal communication wireless system. Proceedings of the IEEE Vehicular Technology Conference (VTC '00), 2000 3: 1854-1858.
Liu X, Chong EKP, Shroff NB: Opportunistic transmission scheduling with resource-sharing constraints in wireless networks. IEEE Journal on Selected Areas in Communications 2001, 19(10):2053-2064. 10.1109/49.957318 CrossRef
Borst S, Whiting P: Dynamic rate control algorithms for HDR throughput optimization. Proceedings of the 20th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM '01), April 2001, Anchorage, Alaska, USA 2: 976-985.
Park D, Seo H, Kwon H, Lee BG: Wireless packet scheduling based on the cumulative distribution function of user transmission rates. IEEE Transactions on Communications 2005, 53(11):1919-1929. 10.1109/TCOMM.2005.858675 CrossRef
Bhagwat P, Bhattacharya P, Krishna A, Tripathi SK: Enhancing throughput over wireless LANs using channel state dependent packet scheduling. Proceedings of the 15th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM '96), March 1996 3: 1133-1140. CrossRef
Wang HS, Moayeri N: Finite-state Markov channel—a useful model for radio communication channels. IEEE Transactions on Vehicular Technology 1995, 44(1):163-171. 10.1109/25.350282 CrossRef
Zhang Q, Kassam SA: Finite-state markov model for Rayleigh fading channels. IEEE Transactions on Communications 1999, 47(11):1688-1692. 10.1109/26.803503 CrossRef
Bertsekas DP: Dynamic Programming and Optimal Control, Vol. 1 and Vol. 2. Athena Scientific, Belmont, Mass, USA; 1995. MATH
Liu P, Berry R, Honig ML: A fluid analysis of utility-based wireless scheduling policies. Proceedings of the 43rd IEEE Conference on Decision and Control (CDC '04), December 2004 3: 3283-3288.
Bertsekas DP, Tsitsiklis JN: Neuro-Dynamic Programming. Athena Scientific, Belmont, Mass, USA; 1996. MATH
Baugh CR, Huang J: Traffic Model for 802.16 TG3 MAC/PHY Simulations. IEEE 802.16 working group document, March 2001, http://wirelessman.org/tg3/contrib/802163c-01_30r1.pdf
- QoS Differentiated and Fair Packet Scheduling in Broadband Wireless Access Networks
- Springer International Publishing
- EURASIP Journal on Wireless Communications and Networking
Elektronische ISSN: 1687-1499
Neuer Inhalt/© ITandMEDIA, Product Lifecycle Management/© Eisenhans | vege | Fotolia