Skip to main content

2017 | OriginalPaper | Buchkapitel

Large-Scale and Adaptive Service Composition Using Deep Reinforcement Learning

verfasst von : Hongbing Wang, Mingzhu Gu, Qi Yu, Huanhuan Fei, Jiajie Li, Yong Tao

Erschienen in: Service-Oriented Computing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Service composition provides an effective way to implement a Service-Oriented Architecture (SOA) by combining existing multiple services to meet user requirements. The increasingly complex user requirements and large amount of services pose a significant challenge to service selection and composition. Furthermore, web services are network based, which are inherently dynamic. The environment of service composition may also be complex and unstable. These demand a service composition solution to adapt to the change of environment. In this paper, we propose a new service composition solution based on Deep Reinforcement Learning (DRL) for adaptive and large-scale service composition problems. The experimental results demonstrate the effectiveness, scalability and self-adaptivity of our approach.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Canfora, G., Di Penta, M., Esposito, R., Villani, M.L.: A framework for QOS-aware binding and re-binding of composite web services. J. Syst. Softw. 81(10), 1754–1769 (2008)CrossRef Canfora, G., Di Penta, M., Esposito, R., Villani, M.L.: A framework for QOS-aware binding and re-binding of composite web services. J. Syst. Softw. 81(10), 1754–1769 (2008)CrossRef
2.
Zurück zum Zitat Constantinescu, I., Faltings, B., Binder, W.: Large scale, type-compatible service composition. In: Proceedings of the IEEE International Conference on Web Services (ICWS), pp. 506–513. IEEE (2004) Constantinescu, I., Faltings, B., Binder, W.: Large scale, type-compatible service composition. In: Proceedings of the IEEE International Conference on Web Services (ICWS), pp. 506–513. IEEE (2004)
3.
Zurück zum Zitat Goldberg, D.E., Holland, J.H.: Genetic algorithms and machine learning. Mach. Learn. 3(2), 95–99 (1988)CrossRef Goldberg, D.E., Holland, J.H.: Genetic algorithms and machine learning. Mach. Learn. 3(2), 95–99 (1988)CrossRef
4.
Zurück zum Zitat Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237–285 (1996) Kaelbling, L.P., Littman, M.L., Moore, A.W.: Reinforcement learning: a survey. J. Artif. Intell. Res. 4, 237–285 (1996)
5.
Zurück zum Zitat Lange, S., Riedmiller, M.: Deep auto-encoder neural networks in reinforcement learning. In: The 2010 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2010) Lange, S., Riedmiller, M.: Deep auto-encoder neural networks in reinforcement learning. In: The 2010 International Joint Conference on Neural Networks (IJCNN), pp. 1–8. IEEE (2010)
6.
Zurück zum Zitat Li, W., Badr, Y., Biennier, F.: Service farming: an ad-hoc and QOS-aware web service composition approach. In: Proceedings of the 28th Annual ACM Symposium on Applied Computing, pp. 750–756. ACM (2013) Li, W., Badr, Y., Biennier, F.: Service farming: an ad-hoc and QOS-aware web service composition approach. In: Proceedings of the 28th Annual ACM Symposium on Applied Computing, pp. 750–756. ACM (2013)
7.
Zurück zum Zitat Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., Riedmiller, M.: Playing Atari with deep reinforcement learning. arXiv preprint (2013). arXiv:1312.5602 Mnih, V., Kavukcuoglu, K., Silver, D., Graves, A., Antonoglou, I., Wierstra, D., Riedmiller, M.: Playing Atari with deep reinforcement learning. arXiv preprint (2013). arXiv:​1312.​5602
8.
Zurück zum Zitat Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)CrossRef Mnih, V., Kavukcuoglu, K., Silver, D., Rusu, A.A., Veness, J., Bellemare, M.G., Graves, A., Riedmiller, M., Fidjeland, A.K., Ostrovski, G., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529–533 (2015)CrossRef
9.
Zurück zum Zitat Oh, S.C., Lee, D., Kumara, S.R.: Effective web service composition in diverse and large-scale service networks. IEEE Trans. Serv. Comput. (TSC) 1(1), 15–32 (2008)CrossRef Oh, S.C., Lee, D., Kumara, S.R.: Effective web service composition in diverse and large-scale service networks. IEEE Trans. Serv. Comput. (TSC) 1(1), 15–32 (2008)CrossRef
10.
Zurück zum Zitat Trummer, I., Faltings, B.: Optimizing the tradeoff between discovery, composition, and execution cost in service composition. In: Proceedings of the IEEE International Conference on Web Services (ICWS), pp. 476–483. IEEE (2011) Trummer, I., Faltings, B.: Optimizing the tradeoff between discovery, composition, and execution cost in service composition. In: Proceedings of the IEEE International Conference on Web Services (ICWS), pp. 476–483. IEEE (2011)
11.
Zurück zum Zitat Wang, H., Chen, X., Wu, Q., Yu, Q., Zheng, Z., Bouguettaya, A.: Integrating on-policy reinforcement learning with multi-agent techniques for adaptive service composition. In: Franch, X., Ghose, A.K., Lewis, G.A., Bhiri, S. (eds.) ICSOC 2014. LNCS, vol. 8831, pp. 154–168. Springer, Heidelberg (2014). doi:10.1007/978-3-662-45391-9_11 CrossRef Wang, H., Chen, X., Wu, Q., Yu, Q., Zheng, Z., Bouguettaya, A.: Integrating on-policy reinforcement learning with multi-agent techniques for adaptive service composition. In: Franch, X., Ghose, A.K., Lewis, G.A., Bhiri, S. (eds.) ICSOC 2014. LNCS, vol. 8831, pp. 154–168. Springer, Heidelberg (2014). doi:10.​1007/​978-3-662-45391-9_​11 CrossRef
12.
Zurück zum Zitat Wang, H., Zhou, X., Zhou, X., Liu, W., Li, W., Bouguettaya, A.: Adaptive service composition based on reinforcement learning. In: Maglio, P.P., Weske, M., Yang, J., Fantinato, M. (eds.) ICSOC 2010. LNCS, vol. 6470, pp. 92–107. Springer, Heidelberg (2010). doi:10.1007/978-3-642-17358-5_7 CrossRef Wang, H., Zhou, X., Zhou, X., Liu, W., Li, W., Bouguettaya, A.: Adaptive service composition based on reinforcement learning. In: Maglio, P.P., Weske, M., Yang, J., Fantinato, M. (eds.) ICSOC 2010. LNCS, vol. 6470, pp. 92–107. Springer, Heidelberg (2010). doi:10.​1007/​978-3-642-17358-5_​7 CrossRef
13.
Zurück zum Zitat Yan, Y., Poizat, P., Zhao, L.: Repairing service compositions in a changing world. In: Lee, R., Ormandjieva, O., Abran, A., Constantinides, C. (eds.) Software Engineering Research, Management and Applications 2010. SCI, vol. 296, pp. 17–36. Springer, Heidelberg (2010)CrossRef Yan, Y., Poizat, P., Zhao, L.: Repairing service compositions in a changing world. In: Lee, R., Ormandjieva, O., Abran, A., Constantinides, C. (eds.) Software Engineering Research, Management and Applications 2010. SCI, vol. 296, pp. 17–36. Springer, Heidelberg (2010)CrossRef
Metadaten
Titel
Large-Scale and Adaptive Service Composition Using Deep Reinforcement Learning
verfasst von
Hongbing Wang
Mingzhu Gu
Qi Yu
Huanhuan Fei
Jiajie Li
Yong Tao
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-69035-3_27

Premium Partner