Skip to main content
Erschienen in: Telecommunication Systems 1/2018

29.08.2017

A stochastic approximation approach to active queue management

verfasst von: Shalabh Bhatnagar, Sanjeev Patel, Karmeshu

Erschienen in: Telecommunication Systems | Ausgabe 1/2018

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Recently, a dynamic adaptive queue management with random dropping (AQMRD) scheme has been developed to capture the time-dependent variation of average queue size by incorporating the rate of change of average queue size as a parameter. A major issue with AQMRD is the choice of parameters. In this paper, a novel online stochastic approximation based optimization scheme is proposed to dynamically tune the parameters of AQMRD and which is also applicable for other active queue management (AQM) algorithms. Our optimization scheme significantly improves the throughput, average queue size, and loss-rate in relation to other AQM schemes.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Floyd, S., & Jacobson, V. (1993). Random early detection gateways for congestion avoidance. IEEE/ACM Transactions on Networking, 1(4), 397–413.CrossRef Floyd, S., & Jacobson, V. (1993). Random early detection gateways for congestion avoidance. IEEE/ACM Transactions on Networking, 1(4), 397–413.CrossRef
2.
Zurück zum Zitat Athuraliya, S., Li, V. H., Low, S. H., & Elissa, Q. Y. (2002). REM: Active queue management. IEEE Network, 15(3), 48–53.CrossRef Athuraliya, S., Li, V. H., Low, S. H., & Elissa, Q. Y. (2002). REM: Active queue management. IEEE Network, 15(3), 48–53.CrossRef
3.
Zurück zum Zitat Meckenney, P. E. (1990). Stochastic fair queuing. Proceedings IEEE INFOCOM, 2, 733–740. Meckenney, P. E. (1990). Stochastic fair queuing. Proceedings IEEE INFOCOM, 2, 733–740.
4.
Zurück zum Zitat Hollot, C. V., Misra, V., Towsley, D., Gong, W. (2001). On designing improved controllers for AQM routers supporting TCP flows. In Proceedings of the IEEE INFOCOM (pp. 1726–1734). Hollot, C. V., Misra, V., Towsley, D., Gong, W. (2001). On designing improved controllers for AQM routers supporting TCP flows. In Proceedings of the IEEE INFOCOM (pp. 1726–1734).
5.
Zurück zum Zitat Feng, W., Shin, K. G., Kandlur, D. D., & Saha, D. (2002). The BLUE active queue management algorithms. IEEE/ACM Transactions on Networking, 10(4), 513–528.CrossRef Feng, W., Shin, K. G., Kandlur, D. D., & Saha, D. (2002). The BLUE active queue management algorithms. IEEE/ACM Transactions on Networking, 10(4), 513–528.CrossRef
6.
Zurück zum Zitat Feng, G., Agarwal, A . K., Jayaraman, A., & Siew, C . K. (2004). Modified RED gateways under bursty traffic. IEEE Communications Letter, 8(5), 323–325.CrossRef Feng, G., Agarwal, A . K., Jayaraman, A., & Siew, C . K. (2004). Modified RED gateways under bursty traffic. IEEE Communications Letter, 8(5), 323–325.CrossRef
8.
Zurück zum Zitat Feng, C. W., Huang, L. F., Xu, C., & Chang, Y. C. (2017). Congestion control scheme performance analysis based on nonlinear RED. IEEE System Journal, 99, 1–8. Feng, C. W., Huang, L. F., Xu, C., & Chang, Y. C. (2017). Congestion control scheme performance analysis based on nonlinear RED. IEEE System Journal, 99, 1–8.
9.
Zurück zum Zitat Verma, R., Iyer, A., & Karandikar, A. (2003). Active queue management using adaptive RED. Journal of Communications and Networks, 5(3), 275–281.CrossRef Verma, R., Iyer, A., & Karandikar, A. (2003). Active queue management using adaptive RED. Journal of Communications and Networks, 5(3), 275–281.CrossRef
10.
Zurück zum Zitat Zadeh, H. Y., Habibi, A., Li, X., Jafarkhani, H., & Bauer, C. (2012). A statistical study of loss-delay tradeoff for RED queues. IEEE Transactions on Communications, 60(7), 1966–1974.CrossRef Zadeh, H. Y., Habibi, A., Li, X., Jafarkhani, H., & Bauer, C. (2012). A statistical study of loss-delay tradeoff for RED queues. IEEE Transactions on Communications, 60(7), 1966–1974.CrossRef
11.
Zurück zum Zitat Xu, Q., & Sun, J. (2012). New active queue management scheme based on statistical analysis. In Proceedings of WCICA ’12, (pp. 2562–2565). Beijing, China. Xu, Q., & Sun, J. (2012). New active queue management scheme based on statistical analysis. In Proceedings of WCICA ’12, (pp. 2562–2565). Beijing, China.
13.
Zurück zum Zitat Wang, J., Rong, L., & Liu, Y. (2008). A robust proportional controller for AQM based on optimized second-order system model. Computer Communications, 31(10), 2468–2477.CrossRef Wang, J., Rong, L., & Liu, Y. (2008). A robust proportional controller for AQM based on optimized second-order system model. Computer Communications, 31(10), 2468–2477.CrossRef
14.
Zurück zum Zitat Chavan, K., Kumar, R. G., Belur, M. N., & Karandikar, A. (2011). Robust active queue management for wireless networks. IEEE Transactions on Control Systems Technology, 19(6), 1630–1638.CrossRef Chavan, K., Kumar, R. G., Belur, M. N., & Karandikar, A. (2011). Robust active queue management for wireless networks. IEEE Transactions on Control Systems Technology, 19(6), 1630–1638.CrossRef
15.
Zurück zum Zitat Tan, L., Zhang, W., Peng, G., & Chen, G. (2006). Stability of TCP/RED systems in AQM routers. IEEE Transactions on Automatic Control, 51(8), 1393–1398.CrossRef Tan, L., Zhang, W., Peng, G., & Chen, G. (2006). Stability of TCP/RED systems in AQM routers. IEEE Transactions on Automatic Control, 51(8), 1393–1398.CrossRef
16.
Zurück zum Zitat Woo, S., & Kim, K. (2010). Tight upper bound for stability of TCP/RED systems in AQM routers. IEEE Communications Letters, 14(7), 682–684.CrossRef Woo, S., & Kim, K. (2010). Tight upper bound for stability of TCP/RED systems in AQM routers. IEEE Communications Letters, 14(7), 682–684.CrossRef
17.
Zurück zum Zitat Qazi, I. A., Andrew, L. L. H., & Znati, T. K. (2012). Congestion control with multipacket feedback. IEEE/ACM Transactions on Networking, 20(6), 1721–1733.CrossRef Qazi, I. A., Andrew, L. L. H., & Znati, T. K. (2012). Congestion control with multipacket feedback. IEEE/ACM Transactions on Networking, 20(6), 1721–1733.CrossRef
18.
Zurück zum Zitat Poojary, S., & Sharma, V. (2016). Analysis of multiple flows using different high speed TCP protocols on a general network. Performance Evaluation, 104, 4262.CrossRef Poojary, S., & Sharma, V. (2016). Analysis of multiple flows using different high speed TCP protocols on a general network. Performance Evaluation, 104, 4262.CrossRef
19.
Zurück zum Zitat Akyildiz, I. F., Lee, A., Wang, P., Luo, M., & Chou, W. (2015). Research challenges for traffic engineering in software defined networks. IEEE Network, 30(3), 52–58.CrossRef Akyildiz, I. F., Lee, A., Wang, P., Luo, M., & Chou, W. (2015). Research challenges for traffic engineering in software defined networks. IEEE Network, 30(3), 52–58.CrossRef
20.
Zurück zum Zitat Akyildiz, I. F., Nie, S., Lin, S.-C., & Chandrasekaran, M. (2016). 5G roadmap: 10 key enabling technologies. Computer Networks, 106(4), 17–48.CrossRef Akyildiz, I. F., Nie, S., Lin, S.-C., & Chandrasekaran, M. (2016). 5G roadmap: 10 key enabling technologies. Computer Networks, 106(4), 17–48.CrossRef
21.
Zurück zum Zitat Harel, A., Namn, S., & Sturm, J. (1999). Simple bounds for closed queuing networks. Queueing Systems, 31(1), 125–135.CrossRef Harel, A., Namn, S., & Sturm, J. (1999). Simple bounds for closed queuing networks. Queueing Systems, 31(1), 125–135.CrossRef
22.
Zurück zum Zitat Padhye, J., Firoiu, V., Towsley, D. F., & Kurose, J. F. (2000). Modeling TCP Reno performance: A simple model and its empirical validation. IEEE/ACM Transactions on Networking, 8, 133–145.CrossRef Padhye, J., Firoiu, V., Towsley, D. F., & Kurose, J. F. (2000). Modeling TCP Reno performance: A simple model and its empirical validation. IEEE/ACM Transactions on Networking, 8, 133–145.CrossRef
23.
Zurück zum Zitat Yan, J., Muhlbauer, W., & Plattner, B. (2011). An analytical model for streaming over TCP. In NEW2AN (pp. 370–381). Yan, J., Muhlbauer, W., & Plattner, B. (2011). An analytical model for streaming over TCP. In NEW2AN (pp. 370–381).
24.
Zurück zum Zitat Yan, J., & Plattner, B. (2013). A simple solution to find the distribution of TCP window sizes. IEEE Communications Letters, 17(2), 417–419.CrossRef Yan, J., & Plattner, B. (2013). A simple solution to find the distribution of TCP window sizes. IEEE Communications Letters, 17(2), 417–419.CrossRef
25.
Zurück zum Zitat Gemikonakli, E., Ever, E., Mapp, G., & Gemikonaklii, O. (2017). Admission control and buffer management of wireless communication systems with mobile stations and integrated voice and data services. Telecommunication Systems, 65(4), 663–675.CrossRef Gemikonakli, E., Ever, E., Mapp, G., & Gemikonaklii, O. (2017). Admission control and buffer management of wireless communication systems with mobile stations and integrated voice and data services. Telecommunication Systems, 65(4), 663–675.CrossRef
26.
Zurück zum Zitat Salah, K., & Kafhali, S. E. (2017). Performance modeling and analysis of hypoexponential network servers. Telecommunication Systems, 65(4), 717–728.CrossRef Salah, K., & Kafhali, S. E. (2017). Performance modeling and analysis of hypoexponential network servers. Telecommunication Systems, 65(4), 717–728.CrossRef
27.
Zurück zum Zitat Prashanth, L. A., Bhatnagar, S., Fu, M., & Marcus, S. (2017). Adaptive system optimization using random directions stochastic approximation. IEEE Transactions on Automatic Control, 62(5), 2223–2238.CrossRef Prashanth, L. A., Bhatnagar, S., Fu, M., & Marcus, S. (2017). Adaptive system optimization using random directions stochastic approximation. IEEE Transactions on Automatic Control, 62(5), 2223–2238.CrossRef
28.
Zurück zum Zitat Spall, J. C. (1992). Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE Transactions on Automatic Control, 37(3), 332–341.CrossRef Spall, J. C. (1992). Multivariate stochastic approximation using a simultaneous perturbation gradient approximation. IEEE Transactions on Automatic Control, 37(3), 332–341.CrossRef
29.
Zurück zum Zitat Bhatnagar, S. (2007). Adaptive Newton-based smoothed functional algorithms for simulation optimization. ACM Transactions on Modeling and Computer Simulation, 18(1), 2:1–2:35.CrossRef Bhatnagar, S. (2007). Adaptive Newton-based smoothed functional algorithms for simulation optimization. ACM Transactions on Modeling and Computer Simulation, 18(1), 2:1–2:35.CrossRef
30.
Zurück zum Zitat Karmeshu, Bhatnagar, S., & Mishra, V. K. (2011). An optimized SDE model for slotted aloha. IEEE Transactions on Communications, 59(6), 1502–1508. Karmeshu, Bhatnagar, S., & Mishra, V. K. (2011). An optimized SDE model for slotted aloha. IEEE Transactions on Communications, 59(6), 1502–1508.
31.
Zurück zum Zitat Bhatnagar, S., Prasad, H. L., & Prashanth, L. A. (2013). Stochastic recursive algorithms for optimization: Simultaneous perturbation methods., Lecture notes in control and information sciences London: Springer.CrossRef Bhatnagar, S., Prasad, H. L., & Prashanth, L. A. (2013). Stochastic recursive algorithms for optimization: Simultaneous perturbation methods., Lecture notes in control and information sciences London: Springer.CrossRef
32.
Zurück zum Zitat Patro, R. K., & Bhatnagar, S. (2009). A probabilistic constrained nonlinear optimization framework to optimize RED parameters. Performance Evaluation, 66(2), 81–104.CrossRef Patro, R. K., & Bhatnagar, S. (2009). A probabilistic constrained nonlinear optimization framework to optimize RED parameters. Performance Evaluation, 66(2), 81–104.CrossRef
33.
Zurück zum Zitat Karmeshu, Patel, S., & Bhatnagar, S. (2017). Adaptive mean queue size and its rate of change: Queue management with random dropping. Telecommunication Systems, 65(2), 281–295. Karmeshu, Patel, S., & Bhatnagar, S. (2017). Adaptive mean queue size and its rate of change: Queue management with random dropping. Telecommunication Systems, 65(2), 281–295.
34.
Zurück zum Zitat Kushner, H. J., & Clark, D. S. (1978). Stochastic approximation methods for constrained and unconstrained systems. New York: Springer.CrossRef Kushner, H. J., & Clark, D. S. (1978). Stochastic approximation methods for constrained and unconstrained systems. New York: Springer.CrossRef
35.
Zurück zum Zitat Wang, H., & Shin, K. G. (1999). Refined design of random early detection gateways. In Proceedings of IEEE GLOBECOM (pp. 769–775). Wang, H., & Shin, K. G. (1999). Refined design of random early detection gateways. In Proceedings of IEEE GLOBECOM (pp. 769–775).
36.
Zurück zum Zitat Hollot, C. V., Misra, V., Towsley, D., & Gong, W. (2002). Analysis and design of controllers for AQM routers supporting TCP flows. IEEE Transactions on Automatic Control, 47(6), 945–959.CrossRef Hollot, C. V., Misra, V., Towsley, D., & Gong, W. (2002). Analysis and design of controllers for AQM routers supporting TCP flows. IEEE Transactions on Automatic Control, 47(6), 945–959.CrossRef
37.
Zurück zum Zitat Low, S. H., Paganini, F., Wang, J., & Doyle, J. C. (2003). Linear stability of TCP/RED and a scalable control. Computer Networks Journal, 43(5), 633–647.CrossRef Low, S. H., Paganini, F., Wang, J., & Doyle, J. C. (2003). Linear stability of TCP/RED and a scalable control. Computer Networks Journal, 43(5), 633–647.CrossRef
38.
Zurück zum Zitat Bhatnagar, S., & Patro, R. K. (2009). A proof of convergence of the B-RED and P-RED algorithms for random early detection. IEEE Communications Letters, 13(10), 809–811.CrossRef Bhatnagar, S., & Patro, R. K. (2009). A proof of convergence of the B-RED and P-RED algorithms for random early detection. IEEE Communications Letters, 13(10), 809–811.CrossRef
39.
Zurück zum Zitat Adams, R. (2013). Active queue management: A survey. IEEE Communations Surveys & Tutorials, 15(3), 1425–1476.CrossRef Adams, R. (2013). Active queue management: A survey. IEEE Communations Surveys & Tutorials, 15(3), 1425–1476.CrossRef
40.
Zurück zum Zitat Wu, Y., Min, G., & Yang, L. T. (2013). Performance analysis of hybrid wireless networks under bursty and correlated traffic. IEEE Transactions on Vehicular Technology, 62(1), 449–454.CrossRef Wu, Y., Min, G., & Yang, L. T. (2013). Performance analysis of hybrid wireless networks under bursty and correlated traffic. IEEE Transactions on Vehicular Technology, 62(1), 449–454.CrossRef
41.
Zurück zum Zitat Wang, C., Li, B., Thomas Hou, Y., Sohraby, K. & Lin, Y. (2004). LRED: A robust active queue management scheme based on packet loss ratio. In Proceedings on 23rd Annual Joint Conference on IEEE INFOCOM (vol. 1, pp. 112). Wang, C., Li, B., Thomas Hou, Y., Sohraby, K. & Lin, Y. (2004). LRED: A robust active queue management scheme based on packet loss ratio. In Proceedings on 23rd Annual Joint Conference on IEEE INFOCOM (vol. 1, pp. 112).
42.
Zurück zum Zitat Bhatnagar, S., Fu, M. C., Marcus, S. I., & Wang, I. J. (2003). Two-timescale simultaneous perturbation stochastic approximation using deterministic perturbation sequences. ACM Transactions on Modelling and Computer Simulation, 13(2), 180–209.CrossRef Bhatnagar, S., Fu, M. C., Marcus, S. I., & Wang, I. J. (2003). Two-timescale simultaneous perturbation stochastic approximation using deterministic perturbation sequences. ACM Transactions on Modelling and Computer Simulation, 13(2), 180–209.CrossRef
43.
Zurück zum Zitat Bhatnagar, S. (2005). Adaptive multivariate three-timescale stochastic approximation algorithms for simulation based optimization. ACM Transactions on Modeling and Computer Simulation, 15(1), 74–107.CrossRef Bhatnagar, S. (2005). Adaptive multivariate three-timescale stochastic approximation algorithms for simulation based optimization. ACM Transactions on Modeling and Computer Simulation, 15(1), 74–107.CrossRef
44.
Zurück zum Zitat Borkar, V. S. (2008). Stochastic approximation: A dynamical systems viewpoint. Cambridge: Cambridge University Press.CrossRef Borkar, V. S. (2008). Stochastic approximation: A dynamical systems viewpoint. Cambridge: Cambridge University Press.CrossRef
45.
Zurück zum Zitat Bhatnagar, S., & Borkar, V. S. (1997). Multiscale stochastic approximation for parametric optimization of hidden Markov models. Probability in the Engineering and Informational Sciences, 11, 509–522.CrossRef Bhatnagar, S., & Borkar, V. S. (1997). Multiscale stochastic approximation for parametric optimization of hidden Markov models. Probability in the Engineering and Informational Sciences, 11, 509–522.CrossRef
46.
Zurück zum Zitat Bhatnagar, S., Fu, M. C., Marcus, S. I., & Bhatnagar, S. (2001). Two timescale algorithms for simulation optimization of hidden Markov models. IIE Transactions (Pritsker special issue on simulation), 3, 245–258. Bhatnagar, S., Fu, M. C., Marcus, S. I., & Bhatnagar, S. (2001). Two timescale algorithms for simulation optimization of hidden Markov models. IIE Transactions (Pritsker special issue on simulation), 3, 245–258.
Metadaten
Titel
A stochastic approximation approach to active queue management
verfasst von
Shalabh Bhatnagar
Sanjeev Patel
Karmeshu
Publikationsdatum
29.08.2017
Verlag
Springer US
Erschienen in
Telecommunication Systems / Ausgabe 1/2018
Print ISSN: 1018-4864
Elektronische ISSN: 1572-9451
DOI
https://doi.org/10.1007/s11235-017-0377-1

Weitere Artikel der Ausgabe 1/2018

Telecommunication Systems 1/2018 Zur Ausgabe

Neuer Inhalt