Skip to main content

2015 | OriginalPaper | Buchkapitel

Learning-Based Multi-agent System for Solving Combinatorial Optimization Problems: A New Architecture

verfasst von : Nasser Lotfi, Adnan Acan

Erschienen in: Hybrid Artificial Intelligent Systems

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Solving combinatorial optimization problems is an important challenge in all engineering applications. Researchers have been extensively solving these problems using evolutionary computations. This paper introduces a novel learning-based multi-agent system (LBMAS) in which all agents cooperate by acting on a common population and a two-stage archive containing promising fitness-based and positional-based solutions found so far. Metaheuristics as agents perform their own method individually and then share their outcomes. This way, even though individual performance may be low, collaboration of metaheuristics leads the system to reach high performance. In this system, solutions are modified by all running metaheuristics and the system learns gradually how promising metaheuristics are, in order to apply them based on their effectiveness. Finally, the performance of LBMAS is experimentally evaluated on Multiprocessor Scheduling Problem (MSP) which is an outstanding combinatorial optimization problem. Obtained results in comparison to well-known competitors show that our multi-agent system achieves better results in reasonable running times.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley Longman Publishing Co., Boston (1989)MATH Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley Longman Publishing Co., Boston (1989)MATH
2.
Zurück zum Zitat Acan, A., Unveren, A.: A two-stage memory powered Great Deluge algorithm for global optimization. J. Soft Comput. (2014). Acan, A., Unveren, A.: A two-stage memory powered Great Deluge algorithm for global optimization. J. Soft Comput. (2014).
3.
Zurück zum Zitat Price, K.V.: An introduction to differential evolution. In: Corne, D., Dorgio, M., Glover, F., Dasgupta, D., Moscato, P., Poli, R., Price, K.V. (eds.) New Ideas in Optimization. McGraw-Hill, London (1999) Price, K.V.: An introduction to differential evolution. In: Corne, D., Dorgio, M., Glover, F., Dasgupta, D., Moscato, P., Poli, R., Price, K.V. (eds.) New Ideas in Optimization. McGraw-Hill, London (1999)
4.
Zurück zum Zitat Storn, R., Price, K.: Differential evolution - a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11(4), 341–359 (1997)MATHMathSciNet Storn, R., Price, K.: Differential evolution - a simple and efficient heuristic for global optimization over continuous spaces. J. Global Optim. 11(4), 341–359 (1997)MATHMathSciNet
5.
Zurück zum Zitat Bertsimas, D., Tsitsiklis, J.: Simulated annealing. Stat. Sci. 8(1), 10–15 (1993) Bertsimas, D., Tsitsiklis, J.: Simulated annealing. Stat. Sci. 8(1), 10–15 (1993)
6.
Zurück zum Zitat Dorigo, M., Caro, G.D., Lotfi, N.: The ant colony optimizationmeta-heuristic. In: Corne, D., Dorgio, M., Glover, F., Dasgupta, D., moscato, P., Poli, R., Price, K.V. (eds.) New Ideas in Optimization, pp. 11–32. McGraw-Hill, New York (1999) Dorigo, M., Caro, G.D., Lotfi, N.: The ant colony optimizationmeta-heuristic. In: Corne, D., Dorgio, M., Glover, F., Dasgupta, D., moscato, P., Poli, R., Price, K.V. (eds.) New Ideas in Optimization, pp. 11–32. McGraw-Hill, New York (1999)
7.
Zurück zum Zitat Dueck, G.: New optimization heuristics, the great deluge algorithm and the record-to-record travel. J. Comput. Phys. 104(1), 86–92 (1993)MATHMathSciNet Dueck, G.: New optimization heuristics, the great deluge algorithm and the record-to-record travel. J. Comput. Phys. 104(1), 86–92 (1993)MATHMathSciNet
8.
Zurück zum Zitat Chelouah, R., Siarry, P.: Tabu search applied to global optimization. Eur. J. Oper. Res. 123(2), 256–270 (2000)MATHMathSciNet Chelouah, R., Siarry, P.: Tabu search applied to global optimization. Eur. J. Oper. Res. 123(2), 256–270 (2000)MATHMathSciNet
9.
Zurück zum Zitat Naeem, M., Xue. S., Lee, D.C.: Cross-entropy optimization for sensor selection problems: communications and information technology. In: ISCIT 2009, pp. 396–401, September 2009 Naeem, M., Xue. S., Lee, D.C.: Cross-entropy optimization for sensor selection problems: communications and information technology. In: ISCIT 2009, pp. 396–401, September 2009
10.
Zurück zum Zitat Sycara, K.P.: Multi-agent systems: american association for artificial intelligence. AI Mag. 19(2), 79–92 (1998) Sycara, K.P.: Multi-agent systems: american association for artificial intelligence. AI Mag. 19(2), 79–92 (1998)
11.
Zurück zum Zitat Meignan, D., Creput, J.C., Koukam, A.: An organizational view of metaheuristics. In: Proceedings of First International Workshop on Optimization on Multi-agent Systems, pp. 77–85 (2008) Meignan, D., Creput, J.C., Koukam, A.: An organizational view of metaheuristics. In: Proceedings of First International Workshop on Optimization on Multi-agent Systems, pp. 77–85 (2008)
12.
Zurück zum Zitat Taillard, E.D., Gambardella, L.M., Gendrau, M., Potvin, J.Y.: Adaptive memory programming: a unified view of metaheuristics. Eur. J. Oper. Res. 135, 1–16 (2001)MATH Taillard, E.D., Gambardella, L.M., Gendrau, M., Potvin, J.Y.: Adaptive memory programming: a unified view of metaheuristics. Eur. J. Oper. Res. 135, 1–16 (2001)MATH
13.
Zurück zum Zitat Cadenas, J.M., Garrido, M.C., Munoz, E.: Construction of a cooperative metaheuristic system based on data mining and soft-computing: methodological issues. In: Proceedings of IPMU 2008, pp. 1246–1253 (2008) Cadenas, J.M., Garrido, M.C., Munoz, E.: Construction of a cooperative metaheuristic system based on data mining and soft-computing: methodological issues. In: Proceedings of IPMU 2008, pp. 1246–1253 (2008)
14.
Zurück zum Zitat Aydin, M.E.: Coordinating metaheuristic agents with swarm intelligence. J. Intell. Manuf. 23(4), 991–999 (2013)MathSciNet Aydin, M.E.: Coordinating metaheuristic agents with swarm intelligence. J. Intell. Manuf. 23(4), 991–999 (2013)MathSciNet
15.
Zurück zum Zitat Milano, M., Roli, A.: MAGMA: a multi-agent architecture for metaheuristics. IEEE Trans. Syst. Man Cybern. B Cybern. 33(2), 925–941 (2004) Milano, M., Roli, A.: MAGMA: a multi-agent architecture for metaheuristics. IEEE Trans. Syst. Man Cybern. B Cybern. 33(2), 925–941 (2004)
16.
Zurück zum Zitat Al-Mouhamed, M.A.: Lower bound on the number of processors and time for scheduling precedence graphs with communication costs. IEEE Trans. Softw. Eng. 16(12), 1390–1401 (1990)MathSciNet Al-Mouhamed, M.A.: Lower bound on the number of processors and time for scheduling precedence graphs with communication costs. IEEE Trans. Softw. Eng. 16(12), 1390–1401 (1990)MathSciNet
17.
Zurück zum Zitat Wu, A.S., Yu, H., Jin, S., Lin, KCh., Schiavone, G.: An incremental genetic algorithm approach to multiprocessor scheduling. IEEE Trans. Parallel Distrib. Syst. 15(9), 824–834 (2004) Wu, A.S., Yu, H., Jin, S., Lin, KCh., Schiavone, G.: An incremental genetic algorithm approach to multiprocessor scheduling. IEEE Trans. Parallel Distrib. Syst. 15(9), 824–834 (2004)
18.
Zurück zum Zitat Wu, M.Y.: MCP Revisited. Department of Electrical and Computer Engineering. University of New Mexico (2000) Wu, M.Y.: MCP Revisited. Department of Electrical and Computer Engineering. University of New Mexico (2000)
19.
Zurück zum Zitat Baxter, J., Patel, J.H.:The last algorithm: a heuristic-based static task allocation algorithm. In: Proceeding of International Conference on Parallel Processing, vol. 2, pp. 217−222 (1989) Baxter, J., Patel, J.H.:The last algorithm: a heuristic-based static task allocation algorithm. In: Proceeding of International Conference on Parallel Processing, vol. 2, pp. 217−222 (1989)
20.
Zurück zum Zitat Coffman, E.G.: Computer and Job-Shop Scheduling Theory. Wiley, New York (1976)MATH Coffman, E.G.: Computer and Job-Shop Scheduling Theory. Wiley, New York (1976)MATH
21.
Zurück zum Zitat Hwang, J.J., Chow, Y.C., Anger, F.D., Lee, C.Y.: Scheduling precedence graphs in systems with inter-processor communication times. SIAM J. Comput. 18(2), 244–257 (1989)MATHMathSciNet Hwang, J.J., Chow, Y.C., Anger, F.D., Lee, C.Y.: Scheduling precedence graphs in systems with inter-processor communication times. SIAM J. Comput. 18(2), 244–257 (1989)MATHMathSciNet
22.
Zurück zum Zitat Kim, S.J., Browne, J. C.: A general approach to mapping of parallel computation upon multiprocessor architectures. In: Proceeding Of International Conference on Parallel Processing, Vol. 2 pp. 1−8 (1988) Kim, S.J., Browne, J. C.: A general approach to mapping of parallel computation upon multiprocessor architectures. In: Proceeding Of International Conference on Parallel Processing, Vol. 2 pp. 1−8 (1988)
23.
Zurück zum Zitat Sarkar, V.: Partitioning and Scheduling Parallel Programs for Multiprocessors. MIT Press, Cambridge (1989)MATH Sarkar, V.: Partitioning and Scheduling Parallel Programs for Multiprocessors. MIT Press, Cambridge (1989)MATH
24.
Zurück zum Zitat McCreary, C.L., Khan, A.A., Thompson, J.J., McArdle, M.E.: A comparison of heuristics for scheduling dags on multiprocessors. In: Proceedings of the 8th International Parallel Processing Symposium, pp. 446–451 (1994) McCreary, C.L., Khan, A.A., Thompson, J.J., McArdle, M.E.: A comparison of heuristics for scheduling dags on multiprocessors. In: Proceedings of the 8th International Parallel Processing Symposium, pp. 446–451 (1994)
25.
Zurück zum Zitat Rinehart, M., Kianzad, V., Bhattacharyya, SH.S.: A Modular Genetic Algorithm for Scheduling Task Graphs. Department of Electrical and Computer Engineering, and Institute for Advanced Computer Studies, University of Maryland, College Park (2003) Rinehart, M., Kianzad, V., Bhattacharyya, SH.S.: A Modular Genetic Algorithm for Scheduling Task Graphs. Department of Electrical and Computer Engineering, and Institute for Advanced Computer Studies, University of Maryland, College Park (2003)
26.
Zurück zum Zitat Correa, R.C., Ferreira, A., Rebreyend, P.: Scheduling multiprocessor tasks with genetic algorithms. IEEE Trans. Parallel Distrib. Syst. 10(8), 825–837 (1999) Correa, R.C., Ferreira, A., Rebreyend, P.: Scheduling multiprocessor tasks with genetic algorithms. IEEE Trans. Parallel Distrib. Syst. 10(8), 825–837 (1999)
27.
Zurück zum Zitat Parsa, S., Lotfi, S., Lotfi, N.: An evolutionary approach to task graph scheduling. In: Beliczynski, B., Dzielinski, A., Iwanowski, M., Ribeiro, B. (eds.) ICANNGA 2007. LNCS, vol. 4431, pp. 110–119. Springer, Heidelberg (2007)CrossRef Parsa, S., Lotfi, S., Lotfi, N.: An evolutionary approach to task graph scheduling. In: Beliczynski, B., Dzielinski, A., Iwanowski, M., Ribeiro, B. (eds.) ICANNGA 2007. LNCS, vol. 4431, pp. 110–119. Springer, Heidelberg (2007)CrossRef
28.
Zurück zum Zitat Sih, G.C., Lee, E.A.: Scheduling to account for inter-processor communication within interconnection-constrained processor network. In: 1990 International Conference on Parallel Processing, pp. 9–17, August 1990 Sih, G.C., Lee, E.A.: Scheduling to account for inter-processor communication within interconnection-constrained processor network. In: 1990 International Conference on Parallel Processing, pp. 9–17, August 1990
29.
Zurück zum Zitat El-Rewini, H., Lewis, T.G.: Scheduling parallel program tasks onto arbitrary target machines. J. Parallel Distrib. Comput. 9(2), 138–153 (1990) El-Rewini, H., Lewis, T.G.: Scheduling parallel program tasks onto arbitrary target machines. J. Parallel Distrib. Comput. 9(2), 138–153 (1990)
30.
Zurück zum Zitat Ahmad, E., Dhodhi, M.K., Ahmad, I.: Multiprocessor scheduling by simulated evolution. J. Softw. 5(10), 1128–1136 (2010) Ahmad, E., Dhodhi, M.K., Ahmad, I.: Multiprocessor scheduling by simulated evolution. J. Softw. 5(10), 1128–1136 (2010)
Metadaten
Titel
Learning-Based Multi-agent System for Solving Combinatorial Optimization Problems: A New Architecture
verfasst von
Nasser Lotfi
Adnan Acan
Copyright-Jahr
2015
DOI
https://doi.org/10.1007/978-3-319-19644-2_27