Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Bücher
Zeitschriften
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards MyNewsletter Firmensuche
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
Sustainability in Automotive

Gesamtlebenszyklus wird immer wichtiger

In der Digitalkonferenz am 5. Dezember 2024 geht es um die wachsende Bedeutung der Kreislaufwirtschaft in der Automobilindustrie und wie nachhaltige Werkstoffe sowie wiederverwendbare Komponenten dazu beitragen können.
Erweiterte Suche
Anmelden
nach oben
Erschienen in:
Kapitel lesen Erstes Kapitel lesen

2023 | OriginalPaper | Buchkapitel

A Double Deep Q-Network-Enabled Two-Layer Adaptive Work Package Scheduling Approach

verfasst von : Yaning Zhang, Xiao Li, Chengke Wu, Zhi Chen

Erschienen in: Proceedings of the 27th International Symposium on Advancement of Construction Management and Real Estate

Verlag: Springer Nature Singapore

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Adaptive project scheduling is paramount for project success. However, it is challenging for industrialized construction (IC) projects to their fragmentation with spatial-temporal distributed work packages (e.g., tasks in production, transportation, and on-site assembly). To achieve adaptive project scheduling in IC, this study proposes a double deep Q-network (DDQN)-enabled two-layer adaptive work package (D2-TAWP) approach. First, the project scheduling process is transformed into a Markov decision process to model the sequential decision-making process of scheduling; Second, a two-layer adaptive scheduling approach is developed to schedule tasks of work packages dynamically. Finally, the effectiveness of the D2-TAWP approach is validated by experimental simulation. The results indicate that the D2-TAWP approach can effectively perform work package scheduling compared to traditional heuristics, which paves the way for the next-generation distributed scheduling of IC projects.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Vorheriges Kapitel Heterogeneous Local Policy Responses to Housing Market Regulation: An Interpretive Framework and Evidence from 177 Chinese Cities
Nächstes Kapitel Research on the Differences of Job Stressors Among Construction Project Managers in China
Literatur
1.
Razkenari, M., Bing, Q., Fenner, A., Hakim, H., Costin, A., Kibert, C.J.: Industrialized construction: emerging methods and technologies. 352–359 (2019)
2.
Razkenari, M.A., Fenner, A.E., Hakim, H., Kibert, C.J.: Training for Manufactured Construction (TRAMCON) – Benefits and Challenges for Workforce Development at Manufactured Housing Industry, Modular and Offsite Construction (MOC) Summit Proceedings (2018)
3.
Li, C.Z., Xu, X., Shen, G.Q., Fan, C., Li, X., Hong, J.: A model for simulating schedule risks in prefabrication housing production: a case study of six-day cycle assembly activities in Hong Kong. J. Clean. Prod. 185, 366–381 (2018)CrossRef
4.
Li, X., Wu, C., Xue, F., Yang, Z., Lou, J., Lu, W.: Ontology-based mapping approach for automatic work packaging in modular construction. Autom. Constr. 134, 104083 (2022)CrossRef
5.
Chen, Z., Demeulemeester, E., Bai, S., Guo, Y.: Efficient priority rules for the stochastic resource-constrained project scheduling problem. Eur. J. Oper. Res. 270(3), 957–967 (2018)CrossRef
6.
Sutrisna, M., Ramanayaka, C.D.D., Goulding, J.S.: Developing work breakdown structure matrix for managing offsite construction projects. Archit. Eng. Des. Manag. 14(5), 381–397 (2018)
7.
Li, X., Wu, C., Yang, Z., Guo, Y., Jiang, R.: Knowledge graph-enabled adaptive work packaging approach in modular construction. Knowl.-Based Syst. 260, 110115 (2023)CrossRef
8.
Servranckx, T., Vanhoucke, M.: A tabu search procedure for the resource-constrained project scheduling problem with alternative subgraphs. Eur. J. Oper. Res. 273(3), 841–860 (2019)CrossRef
9.
Gonçalves, J.F., Mendes, J.J.M., Resende, M.G.C.: A genetic algorithm for the resource constrained multi-project scheduling problem. Eur. J. Oper. Res. 189(3), 1171–1190 (2008)CrossRef
10.
Chen, H., Ding, G., Zhang, J., Qin, S.: Research on priority rules for the stochastic resource constrained multi-project scheduling problem with new project arrival. Comput. Ind. Eng. 137, 106060 (2019)CrossRef
11.
Browning, T.R., Yassine, A.A.: Resource-constrained multi-project scheduling: priority rule performance revisited. Int. J. Prod. Econ. 126(2), 212–228 (2010)CrossRef
12.
13.
Liu, D., Xu, Z., Li, F.: A three-stage decomposition algorithm for decentralized multi-project scheduling under uncertainty. Comput. Ind. Eng. 160, 107553 (2021)CrossRef
14.
Tian, M., Liu, R.J., Zhang, G.J.: Solving the resource-constrained multi-project scheduling problem with an improved critical chain method. J. Oper. Res. Soc. 71(8), 1243–1258 (2020)CrossRef
15.
Cui, L., Liu, X., Lu, S., Jia, Z.: A variable neighborhood search approach for the resource-constrained multi-project collaborative scheduling problem. Appl. Soft Comput. 107, 107480 (2021)CrossRef
16.
Liu, D., Xu, Z.: A multi-PR heuristic for distributed multi-project scheduling with uncertain duration. IEEE Access 8, 227780–227792 (2020)CrossRef
17.
Chen, J.C., Lee, H.-Y., Hsieh, W.-H., Chen, T.-L.: Applying hybrid genetic algorithm to multi-mode resource constrained multi-project scheduling problems. J. Chin. Inst. Eng. 45(1), 42–53 (2022)CrossRef
18.
Owida, A.: Resource constrained multi-project scheduling using priority rules: application in the deep-water construction industry. In: International Conference on Industrial Engineering and Operations Management (2020)
19.
Ren, J.F., Ye, C.M., Yang, F.: A novel solution to JSPs based on long short-term memory and policy gradient algorithm. Int. J. Simul. Model. 19(1), 157–168 (2020)CrossRef
20.
Park, J., Chun, J., Kim, S.H., Kim, Y., Park, J.: Learning to schedule job-shop problems: Representation and policy learning using graph neural network and reinforcement learning. Int. J. Prod. Res. 59(11), 3360–3377 (2021)CrossRef
21.
Shahrabi, J., Adibi, M.A., Mahootchi, M.: A reinforcement learning approach to parameter estimation in dynamic job shop scheduling. Comput. Ind. Eng. 110, 75–82 (2017)CrossRef
22.
Li, Z., Wei, X., Jiang, X., Pang, Y.: A kind of reinforcement learning to improve genetic algorithm for multiagent task scheduling. Math. Probl. Eng. 2021, e1796296 (2021)
23.
Li, C.-L., Hall, N.G.: Work package sizing and project performance. Oper. Res. 67(1), 123–142 (2019)CrossRef
24.
Vanhoucke, M., Coelho, J., Debels, D., Maenhout, B., Tavares, L.V.: An evaluation of the adequacy of project network generators with systematically sampled networks. Eur. J. Oper. Res. 187(2), 511–524 (2008)CrossRef
25.
Han, B.-A., Yang, J.-J.: Research on adaptive job shop scheduling problems based on dueling double DQN. IEEE Access 8, 186474–186495 (2020)CrossRef
26.
Osband, I., Blundell, C., Pritzel, A.,Van Roy, B.: Deep exploration via bootstrapped DQN. In: Advances in Neural Information Processing Systems, vol. 29 (2016)
27.
Fedus, W., et al.: Revisiting fundamentals of experience replay. In: International Conference on Machine Learning, pp. 3061–3071 (2020)
28.
Wen, L., Li, X., Gao, L.: A new reinforcement learning based learning rate scheduler for convolutional neural network in fault classification. IEEE Trans. Ind. Electron. 68(12), 12890–12900 (2021)CrossRef
29.
Wang, Z., Schaul, T., Hessel, M., Hasselt, H., Lanctot, M., Freitas, N.: Dueling network architectures for deep reinforcement learning. In: Proceedings of the 33rd International Conference on Machine Learning, pp. 1995–2003 (2016)
30.
Lin, C.-C., Deng, D.-J., Chih, Y.-L., Chiu, H.-T.: Smart manufacturing scheduling with edge computing using multiclass deep Q network. IEEE Trans. Ind. Inf. 15(7), 4276–4284 (2019)CrossRef
31.
Li, H., Cao, Y., Lin, Q., Zhu, H.: Data-driven project buffer sizing in critical chains. Autom. Constr. 135, 104134 (2022)CrossRef
Metadaten
Titel
A Double Deep Q-Network-Enabled Two-Layer Adaptive Work Package Scheduling Approach
verfasst von
Yaning Zhang
Xiao Li
Chengke Wu
Zhi Chen
Copyright-Jahr
2023
Verlag
Springer Nature Singapore
Buch
Proceedings of the 27th International Symposium on Advancement of Construction Management and Real Estate

Print ISBN: 978-981-9936-25-0

Electronic ISBN: 978-981-9936-26-7

Copyright-Jahr: 2023

DOI
https://doi.org/10.1007/978-981-99-3626-7_79