Skip to main content
Top

2020 | OriginalPaper | Chapter

Machine Learning Assisted Optical Network Resource Scheduling in Data Center Networks

Authors : Hongxiang Guo, Cen Wang, Yinan Tang, Yong Zhu, Jian Wu, Yong Zuo

Published in: Optical Network Design and Modeling

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Parallel computing allows us to process incredible amounts of data in a timely manner by distributing the workload across multiple nodes and executing computation simultaneously. However, the performance of this parallelism usually suffers from network bottleneck. In optical switching enabled data center networks (DCNs), to satisfy the complex and time-varying bandwidth demands from the parallel computing, it is critical to fully exploit the flexibility of optical networks and meanwhile reasonably schedule the optical resources. Considering that the traffic flows generated by different applications in DCNs usually exhibit different statistical or correlative features, it is promising to schedule the optical resources with the assistance of machine learning. In this paper, we introduce a framework called intelligent optical resources scheduling system, and discuss how this framework can assist resource scheduling based on machine learning approaches. We also present our recent simulation results to verify the performance of the framework.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Chowdhury, M., Stoica, I.: Coflow: a networking abstraction for cluster applications. In: Proceedings of the 11th ACM Workshop on Hot Topics in Networks, pp. 31–36, Washington (2012) Chowdhury, M., Stoica, I.: Coflow: a networking abstraction for cluster applications. In: Proceedings of the 11th ACM Workshop on Hot Topics in Networks, pp. 31–36, Washington (2012)
2.
go back to reference Wang, C., Cao, H., Yang, S., Guo, J., Guo, H., Wu, J.: Decision tree classification based mix-flows scheduling in optical switched DCNs. In: Proceedings on Optical Fiber Communication Conference, San Diego, paper W1C.4 (2018) Wang, C., Cao, H., Yang, S., Guo, J., Guo, H., Wu, J.: Decision tree classification based mix-flows scheduling in optical switched DCNs. In: Proceedings on Optical Fiber Communication Conference, San Diego, paper W1C.4 (2018)
3.
go back to reference Chowdhury, M., Zhong, Y., Stoica, I.: Efficient coflow scheduling with varys. In: Proceedings of the 2014 ACM Conference on SIGCOMM, pp. 443–454, Chicago (2014) Chowdhury, M., Zhong, Y., Stoica, I.: Efficient coflow scheduling with varys. In: Proceedings of the 2014 ACM Conference on SIGCOMM, pp. 443–454, Chicago (2014)
4.
go back to reference Wang, C., Guo, H., Gao, X., Chen, Y., Tang, Y., Wu, J.: Efficient topology reconstruction via machine learning based traffic patterns recognition in optically interconnected computing system. IEEE Access 7, 28548–28558 (2016)CrossRef Wang, C., Guo, H., Gao, X., Chen, Y., Tang, Y., Wu, J.: Efficient topology reconstruction via machine learning based traffic patterns recognition in optically interconnected computing system. IEEE Access 7, 28548–28558 (2016)CrossRef
5.
go back to reference Yang, T., Zhang, D., Guo, H., Wu, J.: Topology reconstruction strategy with the optical switching based small world data center network. In: 21st OptoElectronics and Communications Conference, Niigata, paper WA2-108 (2016) Yang, T., Zhang, D., Guo, H., Wu, J.: Topology reconstruction strategy with the optical switching based small world data center network. In: 21st OptoElectronics and Communications Conference, Niigata, paper WA2-108 (2016)
6.
go back to reference Zhang, D., Yang, T., Guo, H., Wu, J.: Enabling traffic optimized topology reconstruction with the optical switching based small world data center network. In: 41st European Conference on Optical Communication, Valencia, pp. 6–11 (2015) Zhang, D., Yang, T., Guo, H., Wu, J.: Enabling traffic optimized topology reconstruction with the optical switching based small world data center network. In: 41st European Conference on Optical Communication, Valencia, pp. 6–11 (2015)
7.
go back to reference Tang, Y., et al.: Effectively reconfigure the optical circuit switching layer topology in data center network by OCBridge. J. Lightwave Technol. 37(3), 897–908 (2019)CrossRef Tang, Y., et al.: Effectively reconfigure the optical circuit switching layer topology in data center network by OCBridge. J. Lightwave Technol. 37(3), 897–908 (2019)CrossRef
8.
go back to reference Zhang, D., Guo, H., Yang, T., Wu, J.: Optical switching based small-world data center network. Comput. Commun. 103, 153–164 (2017)CrossRef Zhang, D., Guo, H., Yang, T., Wu, J.: Optical switching based small-world data center network. Comput. Commun. 103, 153–164 (2017)CrossRef
Metadata
Title
Machine Learning Assisted Optical Network Resource Scheduling in Data Center Networks
Authors
Hongxiang Guo
Cen Wang
Yinan Tang
Yong Zhu
Jian Wu
Yong Zuo
Copyright Year
2020
DOI
https://doi.org/10.1007/978-3-030-38085-4_18

Premium Partner