Skip to main content
Erschienen in: Neural Computing and Applications 6/2012

01.09.2012 | Original Article

SOMwise regression: a new clusterwise regression method

verfasst von: Jorge Muruzábal, Diego Vidaurre, Julián Sánchez

Erschienen in: Neural Computing and Applications | Ausgabe 6/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

We present a novel neural learning architecture for regression data analysis. It combines, at the high level, a self-organizing map (SOM) structure, and, at the low level, a multilayer perceptron at each unit of the SOM structure. The goal is to build a clusterwise regression model, that is, a model recognizing several clusters in the data, where the dependence between predictors and response is variable (typically within some parametric range) from cluster to cluster. The proposed algorithm, called SOMwise Regression, follows closely in the spirit of the standard SOM learning algorithm and has performed satisfactorily on various test problems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bauer H, Pawelzik K (1992) Quantifying the neighborhood preservation of self-organizing feature maps. IEEE Trans Neural Netw 4(3):570–579CrossRef Bauer H, Pawelzik K (1992) Quantifying the neighborhood preservation of self-organizing feature maps. IEEE Trans Neural Netw 4(3):570–579CrossRef
2.
Zurück zum Zitat Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, Oxford Bishop CM (1995) Neural networks for pattern recognition. Oxford University Press, Oxford
3.
Zurück zum Zitat Brusco MJ, Cradit JD, Tashchian A (2003) Multicriterion clusterwise regression for joint segmentation: an application to customer value. J Mark Res 40(2):225–234CrossRef Brusco MJ, Cradit JD, Tashchian A (2003) Multicriterion clusterwise regression for joint segmentation: an application to customer value. J Mark Res 40(2):225–234CrossRef
4.
Zurück zum Zitat Chtourou S, Chtourou M, Hammami O (2008) A hybrid approach for training recurrent neural networks: application to multi-step-ahead prediction of noisy and large data sets. Neural Comput Appl 17(3):245–254CrossRef Chtourou S, Chtourou M, Hammami O (2008) A hybrid approach for training recurrent neural networks: application to multi-step-ahead prediction of noisy and large data sets. Neural Comput Appl 17(3):245–254CrossRef
6.
Zurück zum Zitat Hennig C (1999) Models and methods for clusterwise linear regression. In: Gaul W, Locarek-Junge H (eds) Classification in the information age. Springer, Berlin, pp 179–187CrossRef Hennig C (1999) Models and methods for clusterwise linear regression. In: Gaul W, Locarek-Junge H (eds) Classification in the information age. Springer, Berlin, pp 179–187CrossRef
7.
Zurück zum Zitat Herrmann L, Ultsch A (2007) Label propagation for semi-supervised learning in self-organizing maps. In: 6th International workshop on self-organizing maps, Bielefeld, Germany Herrmann L, Ultsch A (2007) Label propagation for semi-supervised learning in self-organizing maps. In: 6th International workshop on self-organizing maps, Bielefeld, Germany
8.
Zurück zum Zitat Heskes T (1999) Energy functions for self-organizing maps. In: Oja E, Kaski S (eds) Kohonen maps. Elsevier, Amsterdam, pp 303–316CrossRef Heskes T (1999) Energy functions for self-organizing maps. In: Oja E, Kaski S (eds) Kohonen maps. Elsevier, Amsterdam, pp 303–316CrossRef
9.
Zurück zum Zitat Kathirvalavakumar T, Jeyaseeli Subavathi S (2009) Neighborhood based modified backpropagation algorithm using adaptive learning parameters for training feedforward neural networks. Neurocomputing 72(16–18):3915–3921CrossRef Kathirvalavakumar T, Jeyaseeli Subavathi S (2009) Neighborhood based modified backpropagation algorithm using adaptive learning parameters for training feedforward neural networks. Neurocomputing 72(16–18):3915–3921CrossRef
11.
Zurück zum Zitat Kontkanen P, Lahtinen J, Myllymaki P, Silander T, Tirri H (2000) Supervised model-based visualization of high-dimensional data. Intell Data Analysis 4(3–4):213–227MATH Kontkanen P, Lahtinen J, Myllymaki P, Silander T, Tirri H (2000) Supervised model-based visualization of high-dimensional data. Intell Data Analysis 4(3–4):213–227MATH
12.
Zurück zum Zitat Larrañaga P, Calvo B, Santana R, Bielza C, Galdiano J, Inza I, Lozano J, Armañanzas R, Santafé G, Pérez A, Robles V (2006) Machine learning in bioinformatics. Brief Bioinformat 7(1):86–112CrossRef Larrañaga P, Calvo B, Santana R, Bielza C, Galdiano J, Inza I, Lozano J, Armañanzas R, Santafé G, Pérez A, Robles V (2006) Machine learning in bioinformatics. Brief Bioinformat 7(1):86–112CrossRef
13.
Zurück zum Zitat McCormick R (1993) Managerial economics. Prentice-Hall, Englewood Cliffs, NJ McCormick R (1993) Managerial economics. Prentice-Hall, Englewood Cliffs, NJ
14.
Zurück zum Zitat Melssen W, Wehrens R, Buydens L (2006) Supervised Kohonen networks for classification problems. Chemom Intell Lab Syst 83(2):99–113CrossRef Melssen W, Wehrens R, Buydens L (2006) Supervised Kohonen networks for classification problems. Chemom Intell Lab Syst 83(2):99–113CrossRef
15.
Zurück zum Zitat Srivastava S, Zhang L, Jin R, Chan C (2008) A novel method incorporating gene ontology information for unsupervised clustering and feature selection. PLoS ONE 3(12):e3860CrossRef Srivastava S, Zhang L, Jin R, Chan C (2008) A novel method incorporating gene ontology information for unsupervised clustering and feature selection. PLoS ONE 3(12):e3860CrossRef
16.
Zurück zum Zitat Tokunaga K, Furukawa T (2009) Modular network SOM. Neural Netw 22(1):82–90CrossRef Tokunaga K, Furukawa T (2009) Modular network SOM. Neural Netw 22(1):82–90CrossRef
17.
Zurück zum Zitat Tsimboukakis N, Tambouratzis G (2007) Self-organizing word map for context-based document classification. In: 6th International workshop on self-organizing maps, Bielefeld, Germany Tsimboukakis N, Tambouratzis G (2007) Self-organizing word map for context-based document classification. In: 6th International workshop on self-organizing maps, Bielefeld, Germany
18.
Zurück zum Zitat Ultsch A (2003) Maps for the visualization of high-dimensional data spaces. In: Workshop on self-organizing maps, Kyushu, Japan, pp 225–230 Ultsch A (2003) Maps for the visualization of high-dimensional data spaces. In: Workshop on self-organizing maps, Kyushu, Japan, pp 225–230
19.
Zurück zum Zitat Ultsch A, Siemon H (1990) Kohonen’s self-organizing feature maps for exploratory data analysis. In: Proceedings of the international neural networks conference, Kluwer Academic Press, Paris, pp 305–308 Ultsch A, Siemon H (1990) Kohonen’s self-organizing feature maps for exploratory data analysis. In: Proceedings of the international neural networks conference, Kluwer Academic Press, Paris, pp 305–308
20.
Zurück zum Zitat Van Hulle MM (2000) Faithful representations and topographic maps: from distortion- to information-based self-organization. Wiley, New York Van Hulle MM (2000) Faithful representations and topographic maps: from distortion- to information-based self-organization. Wiley, New York
21.
Zurück zum Zitat Vidaurre D, Muruzábal J (2007) A quick assessment of topology preservation for SOM structures. IEEE Trans Neural Netw 18(5):1524–1528CrossRef Vidaurre D, Muruzábal J (2007) A quick assessment of topology preservation for SOM structures. IEEE Trans Neural Netw 18(5):1524–1528CrossRef
22.
Zurück zum Zitat Villmann T, Herrmann M, Martinetz T (1997) Topology preservation in self-organizing feature maps: exact definition and measurement. IEEE Trans Neural Netw 8(2):256–266CrossRef Villmann T, Herrmann M, Martinetz T (1997) Topology preservation in self-organizing feature maps: exact definition and measurement. IEEE Trans Neural Netw 8(2):256–266CrossRef
23.
Zurück zum Zitat Villmann T, Seiffert U, Schleif F, Brüß C, Geweniger T, Hammer B (2006) Fuzzy labeled self-organizing map with label-adjusted prototypes, LNAI, vol 4087. Springer, Ulm, Germany, pp 46–56 Villmann T, Seiffert U, Schleif F, Brüß C, Geweniger T, Hammer B (2006) Fuzzy labeled self-organizing map with label-adjusted prototypes, LNAI, vol 4087. Springer, Ulm, Germany, pp 46–56
24.
Zurück zum Zitat Weiss GM (2004) Mining with rarity: a unifying framework. SIGKDD Explor Newsl 6(1):7–19CrossRef Weiss GM (2004) Mining with rarity: a unifying framework. SIGKDD Explor Newsl 6(1):7–19CrossRef
25.
Zurück zum Zitat Xiao Y, Clauset A, Harris R, Bayram E, Santago P, Schmitt J (2005) Supervised self-organizing maps in drug discovery: 1. Robust behavior with overdetermined data sets. J Chem Inf Model 45(6):1749–1758CrossRef Xiao Y, Clauset A, Harris R, Bayram E, Santago P, Schmitt J (2005) Supervised self-organizing maps in drug discovery: 1. Robust behavior with overdetermined data sets. J Chem Inf Model 45(6):1749–1758CrossRef
Metadaten
Titel
SOMwise regression: a new clusterwise regression method
verfasst von
Jorge Muruzábal
Diego Vidaurre
Julián Sánchez
Publikationsdatum
01.09.2012
Verlag
Springer-Verlag
Erschienen in
Neural Computing and Applications / Ausgabe 6/2012
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-011-0536-3

Weitere Artikel der Ausgabe 6/2012

Neural Computing and Applications 6/2012 Zur Ausgabe