Skip to main content
Erschienen in: Journal of Intelligent Manufacturing 4/2014

01.08.2014

Solving large scale disassembly line balancing problem with uncertainty using reinforcement learning

verfasst von: Emre Tuncel, Abe Zeid, Sagar Kamarthi

Erschienen in: Journal of Intelligent Manufacturing | Ausgabe 4/2014

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Due to increasing environmental concerns, manufacturers are forced to take back their products at the end of products’ useful functional life. Manufacturers explore various options including disassembly operations to recover components and subassemblies for reuse, remanufacture, and recycle to extend the life of materials in use and cut down the disposal volume. However, disassembly operations are problematic due to high degree of uncertainty associated with the quality and configuration of product returns. In this research we address the disassembly line balancing problem (DLBP) using a Monte-Carlo based reinforcement learning technique. This reinforcement learning approach is tailored fit to the underlying dynamics of a DLBP. The research results indicate that the reinforcement learning based method is able to perform effectively, even on a complex large scale problem, within a reasonable amount of computational time. The proposed method performed on par or better than the benchmark methods for solving DLBP reported in the literature. Unlike other methods which are usually limited deterministic environments, the reinforcement learning based method is able to operate in deterministic as well as stochastic environments.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Agarwal, S., & Tiwari, M. K. (2006). A collaborative ant colony algorithm to stochastic mixed-model U-shaped disassembly line balancing and sequencing problem. International Journal of Production, 46, 1405–1429.CrossRef Agarwal, S., & Tiwari, M. K. (2006). A collaborative ant colony algorithm to stochastic mixed-model U-shaped disassembly line balancing and sequencing problem. International Journal of Production, 46, 1405–1429.CrossRef
Zurück zum Zitat Aissani, N., Bekrar, A., & et al. (2011). Dynamic scheduling for multi-site companies: a decisional approach based on reinforcement multi-agent learning. Journal of Intelligent Manufacturing: in press. Aissani, N., Bekrar, A., & et al. (2011). Dynamic scheduling for multi-site companies: a decisional approach based on reinforcement multi-agent learning. Journal of Intelligent Manufacturing: in press.
Zurück zum Zitat Altekin, F. T., Kandiller, L., et al. (2008). Profit-oriented disassembly line balancing. International Journal of Production Research, 46, 2675–2693. Altekin, F. T., Kandiller, L., et al. (2008). Profit-oriented disassembly line balancing. International Journal of Production Research, 46, 2675–2693.
Zurück zum Zitat Banda, K., & Zeid, I. (2006). To disassemble or not: A computational methodology for decision making. Journal of Intelligent Manufacturing, 17(5), 621–634.CrossRef Banda, K., & Zeid, I. (2006). To disassemble or not: A computational methodology for decision making. Journal of Intelligent Manufacturing, 17(5), 621–634.CrossRef
Zurück zum Zitat Giudice, F., & Fargione, G. (2007). Disassembly planning of mechanical systems for service and recovery: A genetic algorithms based approach. Journal of Intelligent Manufacturing, 18(3), 313–329.CrossRef Giudice, F., & Fargione, G. (2007). Disassembly planning of mechanical systems for service and recovery: A genetic algorithms based approach. Journal of Intelligent Manufacturing, 18(3), 313–329.CrossRef
Zurück zum Zitat Gungor, A., & Gupta, S. (2002). Disassembly line in product recovery. International Journal of Production Research, 40(11), 2569–2589.CrossRef Gungor, A., & Gupta, S. (2002). Disassembly line in product recovery. International Journal of Production Research, 40(11), 2569–2589.CrossRef
Zurück zum Zitat Gungor, A., & Gupta, S. M. (1999a). Disassembly line balancing. In Proceedings of the 1999 annual meeting of the northeast decision sciences, RI, Newport. Gungor, A., & Gupta, S. M. (1999a). Disassembly line balancing. In Proceedings of the 1999 annual meeting of the northeast decision sciences, RI, Newport.
Zurück zum Zitat Gungor, A., & Gupta, S. M. (1999b). Issues in environmentally concious manufacturing and product recovery: A survey. Computers and Industrial Engineering, 36, 811–853.CrossRef Gungor, A., & Gupta, S. M. (1999b). Issues in environmentally concious manufacturing and product recovery: A survey. Computers and Industrial Engineering, 36, 811–853.CrossRef
Zurück zum Zitat Gungor, A., Gupta, S. M., & et al. (2001). Complications in disassembly line balancing. In Proceedings of SPIE—the international society for optical engineering, SPIE. Gungor, A., Gupta, S. M., & et al. (2001). Complications in disassembly line balancing. In Proceedings of SPIE—the international society for optical engineering, SPIE.
Zurück zum Zitat Gupta, S. M., Erbis, E., & et al. (2004). Disassembly sequencing problem: A case study of a cell phone. In Proceedings of SPIE—The international society for optical engineering, SPIE. Gupta, S. M., Erbis, E., & et al. (2004). Disassembly sequencing problem: A case study of a cell phone. In Proceedings of SPIE—The international society for optical engineering, SPIE.
Zurück zum Zitat Gupta, S. M., & Gungor, A. (2001). Product recovery using a disassembly line: Challenges and solution. In IEEE international symposium on electronics and the environment, Institute of Electrical and Electronics Engineers Inc. Gupta, S. M., & Gungor, A. (2001). Product recovery using a disassembly line: Challenges and solution. In IEEE international symposium on electronics and the environment, Institute of Electrical and Electronics Engineers Inc.
Zurück zum Zitat Gupta, S. M., & Lambert, A. J. D. (2008). Environment conscious manufacturing. Boca Raton: CRC Press. Gupta, S. M., & Lambert, A. J. D. (2008). Environment conscious manufacturing. Boca Raton: CRC Press.
Zurück zum Zitat Homem de Mello, L. S., & Sanderson, A. C. (1990). AND/OR graph representation of assembly plans. IEEE Transactions on Robotics and Automation, 6(2), 188–199.CrossRef Homem de Mello, L. S., & Sanderson, A. C. (1990). AND/OR graph representation of assembly plans. IEEE Transactions on Robotics and Automation, 6(2), 188–199.CrossRef
Zurück zum Zitat Kizilkaya, E. A., & Gupta, S. M. (2005). Impact of different disassembly line balancing algorithms on the performance of dynamic kanban system for disassembly line. In Proceedings of the SPIE—the international society for optical engineering, SPIE, USA. Kizilkaya, E. A., & Gupta, S. M. (2005). Impact of different disassembly line balancing algorithms on the performance of dynamic kanban system for disassembly line. In Proceedings of the SPIE—the international society for optical engineering, SPIE, USA.
Zurück zum Zitat Kongar, E., & Gupta, S. M. (2006). Disassembly sequencing using genetic algorithm. Internationl Journal of Advanced Manufacturing Technology, 30(5–6), 497–506.CrossRef Kongar, E., & Gupta, S. M. (2006). Disassembly sequencing using genetic algorithm. Internationl Journal of Advanced Manufacturing Technology, 30(5–6), 497–506.CrossRef
Zurück zum Zitat Lambert, A. J. D. (2001). Optimum disassembly sequence generation. Environmentally conscious manufacturing. In Proceedings of SPIE—the international society for optical engineering, Vol. 4193, pp. 56–67. Lambert, A. J. D. (2001). Optimum disassembly sequence generation. Environmentally conscious manufacturing. In Proceedings of SPIE—the international society for optical engineering, Vol. 4193, pp. 56–67.
Zurück zum Zitat Lambert, A. J. D. (2007). Optimizing disassembly processes subjected to sequence-dependent cost. Computers and Operations Research, 34(2), 536–551.CrossRef Lambert, A. J. D. (2007). Optimizing disassembly processes subjected to sequence-dependent cost. Computers and Operations Research, 34(2), 536–551.CrossRef
Zurück zum Zitat Lambert, A. J. D., Gupta, S. M. (2005a). Determining optimum and suboptimum disassembly sequences with an application to a cell phone. In Proceedings of the IEEE international symposium on assembly and task planning, Institute of Electrical and Electronics Engineers Computer Society. Lambert, A. J. D., Gupta, S. M. (2005a). Determining optimum and suboptimum disassembly sequences with an application to a cell phone. In Proceedings of the IEEE international symposium on assembly and task planning, Institute of Electrical and Electronics Engineers Computer Society.
Zurück zum Zitat Lambert, A. J. D., & Gupta, S. M. (2005b). Disassembly modeling for assembly, maintenance, and reuse. New York: CRC. Lambert, A. J. D., & Gupta, S. M. (2005b). Disassembly modeling for assembly, maintenance, and reuse. New York: CRC.
Zurück zum Zitat Martinez, M., Pham, F., et al. (2009). Optimal assembly plan generation: A simplifying approach. Journal of Intelligent Manufacturing, 20(1), 15–27. Martinez, M., Pham, F., et al. (2009). Optimal assembly plan generation: A simplifying approach. Journal of Intelligent Manufacturing, 20(1), 15–27.
Zurück zum Zitat McGovern, S., Gupta, S. M. (2004a) Combinatorial optimization methods for disassembly line balancing. In Proceedings of the 2004 SPIE international conference on enviromentally conscious manufacturing, Philadelphia. McGovern, S., Gupta, S. M. (2004a) Combinatorial optimization methods for disassembly line balancing. In Proceedings of the 2004 SPIE international conference on enviromentally conscious manufacturing, Philadelphia.
Zurück zum Zitat McGovern, S., & Gupta, S. M. (2007a). A balancing method and genetic algorithm for disassembly line balancing. European Journal of Operational Research, 179, 692–708.CrossRef McGovern, S., & Gupta, S. M. (2007a). A balancing method and genetic algorithm for disassembly line balancing. European Journal of Operational Research, 179, 692–708.CrossRef
Zurück zum Zitat McGovern, S. M., & Gupta, S. M. (2004b). 2-Opt Heuristic for the Disassembly Line Balancing Problem. In Proceedings of SPIE—the international society for optical engineering, SPIE. McGovern, S. M., & Gupta, S. M. (2004b). 2-Opt Heuristic for the Disassembly Line Balancing Problem. In Proceedings of SPIE—the international society for optical engineering, SPIE.
Zurück zum Zitat McGovern, S. M., & Gupta, S. M. (2007b). Combinatorial optimization analysis of unary NP-complete disassembly line balancing problem. International Journal of Production Research, 45(18–19), 4485–4511. McGovern, S. M., & Gupta, S. M. (2007b). Combinatorial optimization analysis of unary NP-complete disassembly line balancing problem. International Journal of Production Research, 45(18–19), 4485–4511.
Zurück zum Zitat McGovern, S. M., & Gupta, S. M. (2011). The disassembly line—balancing and modeling. New York City: McGraw-Hill. McGovern, S. M., & Gupta, S. M. (2011). The disassembly line—balancing and modeling. New York City: McGraw-Hill.
Zurück zum Zitat Pan, L., & Zeid, I. (2001). A knowledge base for indexing and retrieving disassembly plans. Journal of Intelligent Manufacturing, 12(1), 77–94.CrossRef Pan, L., & Zeid, I. (2001). A knowledge base for indexing and retrieving disassembly plans. Journal of Intelligent Manufacturing, 12(1), 77–94.CrossRef
Zurück zum Zitat Reveliotis, S. A. (2007). Uncertainty management in optimal disassembly planning through learning-based strategies. IIE Transactions, 39(6), 645–658.CrossRef Reveliotis, S. A. (2007). Uncertainty management in optimal disassembly planning through learning-based strategies. IIE Transactions, 39(6), 645–658.CrossRef
Zurück zum Zitat Russell, S., & Norvig, P. (1995). Artificial intelligence: A modern approach. Eaglewood Cliffs, New Jersey: Prentice Hall. Russell, S., & Norvig, P. (1995). Artificial intelligence: A modern approach. Eaglewood Cliffs, New Jersey: Prentice Hall.
Zurück zum Zitat Seo, K.-K., Park, J.-H., et al. (2001). Optimal disassembly sequence using genetic algorithms considering economic and environmental aspects. International Journal of Advanced Manufacturing Technology, 18, 371–380. Seo, K.-K., Park, J.-H., et al. (2001). Optimal disassembly sequence using genetic algorithms considering economic and environmental aspects. International Journal of Advanced Manufacturing Technology, 18, 371–380.
Zurück zum Zitat Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, Massachusetts: The MIT Press. Sutton, R. S., & Barto, A. G. (1998). Reinforcement learning: An introduction. Cambridge, Massachusetts: The MIT Press.
Zurück zum Zitat Tadao, M. (1989). Petri nets: properties, analysis and applications. In Proceedings of the IEEE. Tadao, M. (1989). Petri nets: properties, analysis and applications. In Proceedings of the IEEE.
Zurück zum Zitat Tang, Y., & MengChu, Z. (2006). A systematic approach to design and operation of disassembly lines. IEEE Transactions on Automation Science and Engineering, 3(3), 324–329.CrossRef Tang, Y., & MengChu, Z. (2006). A systematic approach to design and operation of disassembly lines. IEEE Transactions on Automation Science and Engineering, 3(3), 324–329.CrossRef
Zurück zum Zitat Tang, Y., Zhou, M., et al. (2002). Disassembly modeling, plannig, and application. Journal of Manufacturing Systems, 2(3), 200–217. Tang, Y., Zhou, M., et al. (2002). Disassembly modeling, plannig, and application. Journal of Manufacturing Systems, 2(3), 200–217.
Zurück zum Zitat Tewari, A. (2007). Reinforcement learning in large or unknown MDPs. Ph.D: Dissertation, University of California, Berkeley. Tewari, A. (2007). Reinforcement learning in large or unknown MDPs. Ph.D: Dissertation, University of California, Berkeley.
Zurück zum Zitat Turowski, M., Morgan, M., & et al. (2005). Disassembly line design with uncertainty. In Conference proceedings—IEEE international conference on systems, man and cybernetics, Institute of Electrical and Electronics Engineers Inc. Turowski, M., Morgan, M., & et al. (2005). Disassembly line design with uncertainty. In Conference proceedings—IEEE international conference on systems, man and cybernetics, Institute of Electrical and Electronics Engineers Inc.
Zurück zum Zitat Veerakamolmal, P., & Gupta, S. M. (2002). A case-based reasoning approach for automating disassembly process planning. Journal of Intelligent Manufacturing, 13(1), 47–60.CrossRef Veerakamolmal, P., & Gupta, S. M. (2002). A case-based reasoning approach for automating disassembly process planning. Journal of Intelligent Manufacturing, 13(1), 47–60.CrossRef
Zurück zum Zitat Watkins, C., & Dayan, P. (1992). Q-learning. Machine Learning, 8(3), 279–292. Watkins, C., & Dayan, P. (1992). Q-learning. Machine Learning, 8(3), 279–292.
Zurück zum Zitat Watkins, C. J. C. H. (1989). Learning from Delayed Rewards. Ph.D. thesis. U.K., Cambridge University. Watkins, C. J. C. H. (1989). Learning from Delayed Rewards. Ph.D. thesis. U.K., Cambridge University.
Zurück zum Zitat Zeid, I., Gupta, S., et al. (1997). A case-based reasoning approach to planning for disassembly. Journal of Intelligent Manufacturing, 8(2), 97–106. Zeid, I., Gupta, S., et al. (1997). A case-based reasoning approach to planning for disassembly. Journal of Intelligent Manufacturing, 8(2), 97–106.
Metadaten
Titel
Solving large scale disassembly line balancing problem with uncertainty using reinforcement learning
verfasst von
Emre Tuncel
Abe Zeid
Sagar Kamarthi
Publikationsdatum
01.08.2014
Verlag
Springer US
Erschienen in
Journal of Intelligent Manufacturing / Ausgabe 4/2014
Print ISSN: 0956-5515
Elektronische ISSN: 1572-8145
DOI
https://doi.org/10.1007/s10845-012-0711-0

Weitere Artikel der Ausgabe 4/2014

Journal of Intelligent Manufacturing 4/2014 Zur Ausgabe

    Marktübersichten

    Die im Laufe eines Jahres in der „adhäsion“ veröffentlichten Marktübersichten helfen Anwendern verschiedenster Branchen, sich einen gezielten Überblick über Lieferantenangebote zu verschaffen.