Skip to main content
Erschienen in: Journal of Intelligent Information Systems 2/2016

01.04.2016

Enhancing case-based regression with automatically-generated ensembles of adaptations

verfasst von: Vahid Jalali, David Leake

Erschienen in: Journal of Intelligent Information Systems | Ausgabe 2/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Instance-based methods have been successfully applied to numerical prediction (regression) tasks in many domains. Such methods often rely on a simple combination function to generate a prediction from past instances. Case-based reasoning for regression adds a richer case adaptation step to adjust prior solutions to fit new problems. This article presents a new approach to case adaptation for case-based regression systems, based on applying an ensemble of case adaptation rules generated automatically from pairs of cases in the case base, using the case difference heuristic. It evaluates the method’s performance, considering in particular the effects of using local versus global case information to generate adaptation rules from the case base. Experimental results support that the proposed method generally outperforms baselines and that the accuracy of adaptation based on locally-generated rules is highly competitive with that of global rule-generation methods considering many more cases.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Aha, D., Kibler, D., & Albert, M. (1991). Instance-based learning algorithms. Machine Learning, 6(1), 37–66. Aha, D., Kibler, D., & Albert, M. (1991). Instance-based learning algorithms. Machine Learning, 6(1), 37–66.
Zurück zum Zitat Arshadi, N., & Jurisica, I. (2005). An ensemble of case-based classifiers for high-dimensional biological domains. In Proceedings of the sixth international conference on case-based resoning. ICCBR’05 (pp. 21–34). Berlin: Springer Verlag. Arshadi, N., & Jurisica, I. (2005). An ensemble of case-based classifiers for high-dimensional biological domains. In Proceedings of the sixth international conference on case-based resoning. ICCBR’05 (pp. 21–34). Berlin: Springer Verlag.
Zurück zum Zitat Bay, S.D. (1998). Combining nearest neighbor classifiers through multiple feature subsets. In Proc. 15th international conf. on machine learning (pp. 37–45). Bay, S.D. (1998). Combining nearest neighbor classifiers through multiple feature subsets. In Proc. 15th international conf. on machine learning (pp. 37–45).
Zurück zum Zitat Craw, S., Jarmulak, J., & Rowe, R. (2001). Learning and applying case-based adaptation knowledge. In Aha, D., & Watson, I. (Eds.) Proceedings of the fourth international conference on case-based reasoning (pp. 131–145). Berlin: Springer Verlag. Craw, S., Jarmulak, J., & Rowe, R. (2001). Learning and applying case-based adaptation knowledge. In Aha, D., & Watson, I. (Eds.) Proceedings of the fourth international conference on case-based reasoning (pp. 131–145). Berlin: Springer Verlag.
Zurück zum Zitat Cunningham, P., & Zenobi, G. (2001). Case representation issues for case-based reasoning from ensemble research. In Case-based reasoning research and development: proceedings of the fourth international conference on case-based reasoning. Berlin: Springer Verlag. Cunningham, P., & Zenobi, G. (2001). Case representation issues for case-based reasoning from ensemble research. In Case-based reasoning research and development: proceedings of the fourth international conference on case-based reasoning. Berlin: Springer Verlag.
Zurück zum Zitat Dietterich, T. (2000). Ensemble methods in machine learning. In Proceedings of the first international workshop on multiple classifier systems (pp. 1–15). Berlin: Springer Verlag.CrossRef Dietterich, T. (2000). Ensemble methods in machine learning. In Proceedings of the first international workshop on multiple classifier systems (pp. 1–15). Berlin: Springer Verlag.CrossRef
Zurück zum Zitat Fuchs, B., Lieber, J., Mille, A., & Napoli, A. (2014). Differential adaptation: an operational approach to adaptation for solving numerical problems with CBR. Knowledge-Based Systems, 68, 103–114. Enhancing Experience Reuse and Learning.CrossRef Fuchs, B., Lieber, J., Mille, A., & Napoli, A. (2014). Differential adaptation: an operational approach to adaptation for solving numerical problems with CBR. Knowledge-Based Systems, 68, 103–114. Enhancing Experience Reuse and Learning.CrossRef
Zurück zum Zitat Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I.H. (2009). The WEKA data mining software: an update. SIGKDD Explorer Newsletter, 11(1), 10–18.CrossRef Hall, M., Frank, E., Holmes, G., Pfahringer, B., Reutemann, P., & Witten, I.H. (2009). The WEKA data mining software: an update. SIGKDD Explorer Newsletter, 11(1), 10–18.CrossRef
Zurück zum Zitat Hanney, K., & Keane, M. (1997). The adaptation knowledge bottleneck: How to ease it by learning from cases. In Proceedings of the Second International Conference on Case-Based Reasoning (pp. 359–370). Berlin: Springer Verlag. Hanney, K., & Keane, M. (1997). The adaptation knowledge bottleneck: How to ease it by learning from cases. In Proceedings of the Second International Conference on Case-Based Reasoning (pp. 359–370). Berlin: Springer Verlag.
Zurück zum Zitat Jalali, V., & Leake, D. (2013a). A context-aware approach to selecting adaptations for case-based reasoning. In Modeling and using context (pp. 101–114). Berlin: Springer.CrossRef Jalali, V., & Leake, D. (2013a). A context-aware approach to selecting adaptations for case-based reasoning. In Modeling and using context (pp. 101–114). Berlin: Springer.CrossRef
Zurück zum Zitat Jalali, V., & Leake, D. (2013b). Extending case adaptation with automatically-generated ensembles of adaptation rules. In Case-based reasoning research and development, ICCBR, (Vol. 2013 pp. 188–202). Berlin: Springer.CrossRef Jalali, V., & Leake, D. (2013b). Extending case adaptation with automatically-generated ensembles of adaptation rules. In Case-based reasoning research and development, ICCBR, (Vol. 2013 pp. 188–202). Berlin: Springer.CrossRef
Zurück zum Zitat Jalali, V., & Leake, D. (2013c). On deriving adaptation rule confidence from the rule generation process. In Case-based reasoning research and development, ICCBR, (Vol. 2013 pp. 179–187). Berlin: Springer-Verlag.CrossRef Jalali, V., & Leake, D. (2013c). On deriving adaptation rule confidence from the rule generation process. In Case-based reasoning research and development, ICCBR, (Vol. 2013 pp. 179–187). Berlin: Springer-Verlag.CrossRef
Zurück zum Zitat Jalali, V., & Leake, D. (2014a). Adaptation-guided case base maintenance. In Proceedings of the twenty-eighth conference on artificial intelligence (pp. 1875–1881). AAAI Press. Jalali, V., & Leake, D. (2014a). Adaptation-guided case base maintenance. In Proceedings of the twenty-eighth conference on artificial intelligence (pp. 1875–1881). AAAI Press.
Zurück zum Zitat Jalali, V., & Leake, D. (2014b). An ensemble approach to adaptation-guided retrieval. In Proceedings of the 2014 Florida AI research symposium (pp. 295–300). AAAI Press. Jalali, V., & Leake, D. (2014b). An ensemble approach to adaptation-guided retrieval. In Proceedings of the 2014 Florida AI research symposium (pp. 295–300). AAAI Press.
Zurück zum Zitat Jalali, V., & Leake, D. (2014c). On retention of adaptation rules. In Case-based reasoning research and development, ICCBR (p. 2014). Berlin: Springer. Jalali, V., & Leake, D. (2014c). On retention of adaptation rules. In Case-based reasoning research and development, ICCBR (p. 2014). Berlin: Springer.
Zurück zum Zitat Jarmulak, J., Craw, S., & Rowe, R. (2001). Using case-base data c for design. In Proceedings of the 17th international joint conference on artificial intelligence - Volume 2. IJCAI’01 (pp. 1011–1016). San Francisco: Morgan Kaufmann Publishers Inc. Jarmulak, J., Craw, S., & Rowe, R. (2001). Using case-base data c for design. In Proceedings of the 17th international joint conference on artificial intelligence - Volume 2. IJCAI’01 (pp. 1011–1016). San Francisco: Morgan Kaufmann Publishers Inc.
Zurück zum Zitat Kibler, D., Aha, D.W., & Albert, M.K. (1989). Instance-based prediction of real-valued attributes. Computational Intelligence, 5(2), 51–57.CrossRef Kibler, D., Aha, D.W., & Albert, M.K. (1989). Instance-based prediction of real-valued attributes. Computational Intelligence, 5(2), 51–57.CrossRef
Zurück zum Zitat Kolodner, J., & Leake, D. (1996). A tutorial introduction to case-based reasoning. In Leake, D. (Ed.) Case-based reasoning: experiences, lessons, and future directions (pp. 31–65). Menlo Park: AAAI Press. Kolodner, J., & Leake, D. (1996). A tutorial introduction to case-based reasoning. In Leake, D. (Ed.) Case-based reasoning: experiences, lessons, and future directions (pp. 31–65). Menlo Park: AAAI Press.
Zurück zum Zitat Li, H., & Sun, J. (2012). Case-based reasoning ensemble and business application: a computational approach from multiple case representations driven by randomness. Expert Systems with Applications, 39(3), 3298–3310.CrossRef Li, H., & Sun, J. (2012). Case-based reasoning ensemble and business application: a computational approach from multiple case representations driven by randomness. Expert Systems with Applications, 39(3), 3298–3310.CrossRef
Zurück zum Zitat López de Mántaras, R., McSherry, D., Bridge, D., Leake, D., Smyth, B., Craw, S., Faltings, B., Maher, M., Cox, M., Forbus, K., Keane, M., Aamodt, A., & Watson, I. (2005). Retrieval, reuse, revision, and retention in CBR. Knowledge Engineering Review, 20(3). López de Mántaras, R., McSherry, D., Bridge, D., Leake, D., Smyth, B., Craw, S., Faltings, B., Maher, M., Cox, M., Forbus, K., Keane, M., Aamodt, A., & Watson, I. (2005). Retrieval, reuse, revision, and retention in CBR. Knowledge Engineering Review, 20(3).
Zurück zum Zitat McDonnell, N., & Cunningham, P. (2006). A knowledge-light approach to regression using case-based reasoning. In Proceedings of the 8th European conference on case-based reasoning. ECCBR’06 (pp. 91–105). Berlin: Springer-Verlag. McDonnell, N., & Cunningham, P. (2006). A knowledge-light approach to regression using case-based reasoning. In Proceedings of the 8th European conference on case-based reasoning. ECCBR’06 (pp. 91–105). Berlin: Springer-Verlag.
Zurück zum Zitat McSherry, D. (1998). An adaptation heuristic for case-based estimation. In Proceedings of the fourth European workshop on advances in case-based reasoning. EWCBR ’98 (pp. 184–195). London: Springer-Verlag.CrossRef McSherry, D. (1998). An adaptation heuristic for case-based estimation. In Proceedings of the fourth European workshop on advances in case-based reasoning. EWCBR ’98 (pp. 184–195). London: Springer-Verlag.CrossRef
Zurück zum Zitat Patterson, D., Rooney, N., & Galushka, M. (2002). A regression based adaptation strategy for case-based reasoning. In Proceedings of the eighteenth annual national conference on artificial intelligence (pp. 87–92): AAAI Press. Patterson, D., Rooney, N., & Galushka, M. (2002). A regression based adaptation strategy for case-based reasoning. In Proceedings of the eighteenth annual national conference on artificial intelligence (pp. 87–92): AAAI Press.
Zurück zum Zitat Policastro, C.A., Carvalho, A.C., & Delbem, A.C. (2008). A hybrid case adaptation approach for case-based reasoning. Applied Intelligence, 28(2), 101–119.CrossRef Policastro, C.A., Carvalho, A.C., & Delbem, A.C. (2008). A hybrid case adaptation approach for case-based reasoning. Applied Intelligence, 28(2), 101–119.CrossRef
Zurück zum Zitat Schapire, R.E. (1990). The strength of weak learnability. Machine Learning, 5 (2), 197–227. Schapire, R.E. (1990). The strength of weak learnability. Machine Learning, 5 (2), 197–227.
Zurück zum Zitat Smyth, B., & Keane, M. (1998). Adaptation-guided retrieval: questioning the similarity assumption in reasoning. Artificial Intelligence, 102(2), 249–293.CrossRefMATH Smyth, B., & Keane, M. (1998). Adaptation-guided retrieval: questioning the similarity assumption in reasoning. Artificial Intelligence, 102(2), 249–293.CrossRefMATH
Zurück zum Zitat Wilke, W., Vollrath, I., Althoff, K.D., & Bergmann, R. (1997). A framework for learning adaptation knowledge based on knowledge light approaches. In Proceedings of the fifth german workshop on case-based reasoning (pp. 235–242). Wilke, W., Vollrath, I., Althoff, K.D., & Bergmann, R. (1997). A framework for learning adaptation knowledge based on knowledge light approaches. In Proceedings of the fifth german workshop on case-based reasoning (pp. 235–242).
Zurück zum Zitat Wiratunga, N., Craw, S., & Rowe, R. (2002). Learning to adapt for case-based design. In Proceedings of the 6th European conference on advances in case-based reasoning. ECCBR ’02 (pp. 421–435). London: Springer-Verlag.CrossRef Wiratunga, N., Craw, S., & Rowe, R. (2002). Learning to adapt for case-based design. In Proceedings of the 6th European conference on advances in case-based reasoning. ECCBR ’02 (pp. 421–435). London: Springer-Verlag.CrossRef
Zurück zum Zitat Wiratunga, N., Craw, S., & Rowe, R. (2006). Learning adaptation knowledge to improve case-based reasoning. Artificial Intelligence, 170, 1175–1192.MathSciNetCrossRefMATH Wiratunga, N., Craw, S., & Rowe, R. (2006). Learning adaptation knowledge to improve case-based reasoning. Artificial Intelligence, 170, 1175–1192.MathSciNetCrossRefMATH
Metadaten
Titel
Enhancing case-based regression with automatically-generated ensembles of adaptations
verfasst von
Vahid Jalali
David Leake
Publikationsdatum
01.04.2016
Verlag
Springer US
Erschienen in
Journal of Intelligent Information Systems / Ausgabe 2/2016
Print ISSN: 0925-9902
Elektronische ISSN: 1573-7675
DOI
https://doi.org/10.1007/s10844-015-0377-0

Weitere Artikel der Ausgabe 2/2016

Journal of Intelligent Information Systems 2/2016 Zur Ausgabe

Premium Partner