Skip to main content
Top

2018 | OriginalPaper | Chapter

Dynamic Scheduling of the Dual Stocker System Using Reinforcement Learning

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The stocker system is the most widely used material handling system in LCD and flat panel fabrication facilities (FABs). The stocker mainly consists of one or two cranes moving along a single track to transport lots, or cassettes, containing 10 to 30 thin glass substrates between processing machines. Because the stocker system is the primary material handling system in the FABs, its performance directly affects the overall performance. In this study, we investigate the scheduling of a dual stocker system operating with two cranes simultaneously on a single track and propose a learning-based scheduling algorithm for the system. We report some of the results of our long-term efforts to dynamically optimize the dual-crane stocker. We fisrt show the modeling and algorithm to minimize the make-span of the jobs. We incorporate the model to dynamically allocate jobs. In particular, we use a reinforcement learning method in the scheduling algorithm. The model is validated in an extensive simulation study based on actual data.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Aydin, M.E., Öztemel, E.: Dynamic job-shop scheduling using reinforcement learning agents. Robot. Auton. Syst. 33(2–3), 169–178 (2000)CrossRef Aydin, M.E., Öztemel, E.: Dynamic job-shop scheduling using reinforcement learning agents. Robot. Auton. Syst. 33(2–3), 169–178 (2000)CrossRef
2.
go back to reference Bradtke, S.J.: Reinforcement learning applied to linear quadratic regulation. In: Advances in Neural Information Processing Systems, pp. 295–302 (1993) Bradtke, S.J.: Reinforcement learning applied to linear quadratic regulation. In: Advances in Neural Information Processing Systems, pp. 295–302 (1993)
3.
go back to reference Ho, Y.C., Su, T.S.: The machine layout within a TFT-LCD bay with a multiple-stacker crane in-line stocker. Int. J. Prod. Res. 50(18), 5152–5172 (2012)CrossRef Ho, Y.C., Su, T.S.: The machine layout within a TFT-LCD bay with a multiple-stacker crane in-line stocker. Int. J. Prod. Res. 50(18), 5152–5172 (2012)CrossRef
4.
go back to reference Jang, Y.J., Choi, G.H., Kim, S.I.: Modeling and analysis of stocker system in semiconductor and LCD FAB. In: 2005 IEEE International Symposium on Semiconductor Manufacturing, ISSM 2005, pp. 273–276. IEEE (2005) Jang, Y.J., Choi, G.H., Kim, S.I.: Modeling and analysis of stocker system in semiconductor and LCD FAB. In: 2005 IEEE International Symposium on Semiconductor Manufacturing, ISSM 2005, pp. 273–276. IEEE (2005)
5.
go back to reference Mnih, V., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529 (2015)CrossRef Mnih, V., et al.: Human-level control through deep reinforcement learning. Nature 518(7540), 529 (2015)CrossRef
6.
go back to reference Powell, W.B.: Approximate Dynamic Programming: Solving the curses of Dimensionality, vol. 703. Wiley, New York (2007)CrossRef Powell, W.B.: Approximate Dynamic Programming: Solving the curses of Dimensionality, vol. 703. Wiley, New York (2007)CrossRef
7.
go back to reference Su, T.S., Hwang, M.H.: Efficient machine layout design method with a fuzzy set theory within a bay in a TFT-LCD plant. Procedia Manuf. 11, 1863–1870 (2017)CrossRef Su, T.S., Hwang, M.H.: Efficient machine layout design method with a fuzzy set theory within a bay in a TFT-LCD plant. Procedia Manuf. 11, 1863–1870 (2017)CrossRef
8.
go back to reference Wang, Y.C., Usher, J.M.: Application of reinforcement learning for agent-based production scheduling. Eng. Appl. Artif. Intell. 18(1), 73–82 (2005)CrossRef Wang, Y.C., Usher, J.M.: Application of reinforcement learning for agent-based production scheduling. Eng. Appl. Artif. Intell. 18(1), 73–82 (2005)CrossRef
9.
go back to reference Zhang, W., Dietterich, T.G.: A reinforcement learning approach to job-shop scheduling. In: IJCAI, vol. 95, pp. 1114–1120. Citeseer (1995) Zhang, W., Dietterich, T.G.: A reinforcement learning approach to job-shop scheduling. In: IJCAI, vol. 95, pp. 1114–1120. Citeseer (1995)
Metadata
Title
Dynamic Scheduling of the Dual Stocker System Using Reinforcement Learning
Authors
Seol Hwang
Sang Pyo Hong
Young Jae Jang
Copyright Year
2018
DOI
https://doi.org/10.1007/978-3-319-99704-9_59

Premium Partner