Skip to main content

2012 | OriginalPaper | Buchkapitel

5. Semisupervised Dynamic Fuzzy K-Nearest Neighbors

verfasst von : Laurent Hartert, Moamar Sayed-Mouchaweh

Erschienen in: Learning in Non-Stationary Environments

Verlag: Springer New York

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This chapter presents a semi-supervised dynamic classification method to deal with the problem of diagnosis of industrial evolving systems. Indeed, when a functioning mode evolves, the system characteristics change and the observations, i.e. the patterns representing observations in the feature space, obtained on the system change too. Thus, each class membership function must be adapted to take into account these temporal changes and to keep representative patterns only. This requires an adaptive method with a mechanism for adjusting its parameters over time. The developed approach is named Semi-Supervised Dynamic Fuzzy K-Nearest Neighbors (SS-DFKNN) and comprises three phases: a detection phase to detect and confirm classes evolutions, an adaptation phase realized incrementally to update the evolved classes parameters and to create new classes if necessary and a validation phase to keep useful classes only. To illustrate this approach, the diagnosis of a welding system is realized to detect the weldings quality (good or bad), based on acoustic noises issued of weldings operations.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Amadou-Boubacar, H., Lecoeuche, S., Maouche, S.: Self-adaptive kernel machine: Online clustering in RKHS. In: Proceedings of the IEEE IJCNN05. Montreal, Canada (2005) Amadou-Boubacar, H., Lecoeuche, S., Maouche, S.: Self-adaptive kernel machine: Online clustering in RKHS. In: Proceedings of the IEEE IJCNN05. Montreal, Canada (2005)
3.
Zurück zum Zitat Angelov, P., Filev, D., Kasabov, N.: Evolving Intelligent Systems—Methodology and Applications. John Wiley & Sons, New York (2010)CrossRef Angelov, P., Filev, D., Kasabov, N.: Evolving Intelligent Systems—Methodology and Applications. John Wiley & Sons, New York (2010)CrossRef
4.
Zurück zum Zitat Angstenberger, L.: Dynamic fuzzy pattern recognition. Ph.D. thesis, Fakultät für Wirtschaftswissenschaften der Rheinisch-Westfälischen Technischen Hochschule (2000). Aachen, Germany Angstenberger, L.: Dynamic fuzzy pattern recognition. Ph.D. thesis, Fakultät für Wirtschaftswissenschaften der Rheinisch-Westfälischen Technischen Hochschule (2000). Aachen, Germany
5.
Zurück zum Zitat Beringer, J., Hüllermeier, E.: Efficient instance-based learning on data streams. Intelligent Data Analysis 11(6), 627–650 (2007) Beringer, J., Hüllermeier, E.: Efficient instance-based learning on data streams. Intelligent Data Analysis 11(6), 627–650 (2007)
6.
Zurück zum Zitat Bezdek, J.: Pattern Recognition with Fuzzy Objective Function Algorithms. Kluwer Academic/Plenum Publishers, USA (1981)MATH Bezdek, J.: Pattern Recognition with Fuzzy Objective Function Algorithms. Kluwer Academic/Plenum Publishers, USA (1981)MATH
7.
Zurück zum Zitat Cohen, L., Avrahami, G., Last, M.: Incremental info-fuzzy algorithm for real time data mining of non-stationary data streams. In: Proceedings of the TDM Workshop. Brighton, UK (2004) Cohen, L., Avrahami, G., Last, M.: Incremental info-fuzzy algorithm for real time data mining of non-stationary data streams. In: Proceedings of the TDM Workshop. Brighton, UK (2004)
8.
Zurück zum Zitat Cozman, F., Cohen, I., Cirelo, M.: Semi-supervised learning of mixture models. In: Proceedings of the 20th International Conference on Machine Learning (ICML). Washington DC, USA (2003) Cozman, F., Cohen, I., Cirelo, M.: Semi-supervised learning of mixture models. In: Proceedings of the 20th International Conference on Machine Learning (ICML). Washington DC, USA (2003)
9.
Zurück zum Zitat Dubuisson, B.: Diagnostic et reconnaissance des formes. Tech. rep., Trait des Nouvelles Technolo-gies, srie Diagnostic et Maintenance, HERMES (1990) Dubuisson, B.: Diagnostic et reconnaissance des formes. Tech. rep., Trait des Nouvelles Technolo-gies, srie Diagnostic et Maintenance, HERMES (1990)
10.
Zurück zum Zitat Duda, R., Hart, P., Stork, D.: Pattern Classification—Second Edition. Wiley-Interscience (John Wiley & Sons), Southern Gate, Chichester, West Sussex, England (2000) Duda, R., Hart, P., Stork, D.: Pattern Classification—Second Edition. Wiley-Interscience (John Wiley & Sons), Southern Gate, Chichester, West Sussex, England (2000)
11.
Zurück zum Zitat Frigui, H., Krishnapuram, R.: A robust algorithm for automatic extraction of an unknown number of clusters from noisy data. Pattern Recognition Letters 17, 1223–1232 (1996)MATHCrossRef Frigui, H., Krishnapuram, R.: A robust algorithm for automatic extraction of an unknown number of clusters from noisy data. Pattern Recognition Letters 17, 1223–1232 (1996)MATHCrossRef
12.
Zurück zum Zitat Frigui, H., Krishnapuram, R.: Clustering by competitive agglomeration. Pattern Recognition 307, 1109–1119 (1997) Frigui, H., Krishnapuram, R.: Clustering by competitive agglomeration. Pattern Recognition 307, 1109–1119 (1997)
13.
Zurück zum Zitat Gabrys, B., Bargiela, A.: General fuzzy min–max neural network for clustering and classification. IEEE Transactions on Neural Networks 11(3), 769–783 (2000)CrossRef Gabrys, B., Bargiela, A.: General fuzzy min–max neural network for clustering and classification. IEEE Transactions on Neural Networks 11(3), 769–783 (2000)CrossRef
14.
Zurück zum Zitat Garcia, V.: Suivi d’objets d’intrt dans une sequence d’images: des points saillants aux mesures statistiques. Tech. rep., University of Nice (2009) Garcia, V.: Suivi d’objets d’intrt dans une sequence d’images: des points saillants aux mesures statistiques. Tech. rep., University of Nice (2009)
15.
Zurück zum Zitat Gibb, W., Auslander, D., Griffin, J.: Adaptive classification of myocardial electrogram waveforms. IEEE Transactions on Biomedical Engineering 41, 804–808 (1994)CrossRef Gibb, W., Auslander, D., Griffin, J.: Adaptive classification of myocardial electrogram waveforms. IEEE Transactions on Biomedical Engineering 41, 804–808 (1994)CrossRef
16.
Zurück zum Zitat Guedalia, I., London, M., Werman, M.: An on-line agglomerative clustering method for non-stationary data. Neural Computation 11(2), 521–540 (1999)CrossRef Guedalia, I., London, M., Werman, M.: An on-line agglomerative clustering method for non-stationary data. Neural Computation 11(2), 521–540 (1999)CrossRef
17.
Zurück zum Zitat Jain, A., Duin, R., Mao, J.: Statistical pattern recognition: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(1), 4–37 (2000)CrossRef Jain, A., Duin, R., Mao, J.: Statistical pattern recognition: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(1), 4–37 (2000)CrossRef
18.
Zurück zum Zitat Kasabov, N.: Evolving Connectionist Systems: The Knowledge Engineering Approach—Second Edition. Springer Verlag, London (2007) Kasabov, N.: Evolving Connectionist Systems: The Knowledge Engineering Approach—Second Edition. Springer Verlag, London (2007)
19.
Zurück zum Zitat Keller, J., Gray, M., Givens, J.: A fuzzy k-nn neighbor algorithm. IEEE Transactions on Systems, Man and Cybernetics 15(4), 580–585 (1985) Keller, J., Gray, M., Givens, J.: A fuzzy k-nn neighbor algorithm. IEEE Transactions on Systems, Man and Cybernetics 15(4), 580–585 (1985)
20.
Zurück zum Zitat Kybic, J.: Incremental updating of nearest neighbor-based high-dimensional entropy estimation. In: Proceedings of the ICASSP 2006, pp. 804–807 (2006) Kybic, J.: Incremental updating of nearest neighbor-based high-dimensional entropy estimation. In: Proceedings of the ICASSP 2006, pp. 804–807 (2006)
21.
Zurück zum Zitat Law, Y., Zaniolo, C.: An adaptive nearest neighbor classification algorithm for data streams. In: Proceedings of the 9th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD 2005), pp. 108–120. Porto, Portugal (2005) Law, Y., Zaniolo, C.: An adaptive nearest neighbor classification algorithm for data streams. In: Proceedings of the 9th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD 2005), pp. 108–120. Porto, Portugal (2005)
22.
Zurück zum Zitat Lughofer, E.: Evolving Fuzzy Systems—Methodologies, Advanced Concepts and Applications. Springer, Berlin Heidelberg (2011)MATHCrossRef Lughofer, E.: Evolving Fuzzy Systems—Methodologies, Advanced Concepts and Applications. Springer, Berlin Heidelberg (2011)MATHCrossRef
23.
Zurück zum Zitat Lughofer, E., Angelov, P.: Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Applied Soft Computing 11(2), 2057–2068 (2011)CrossRef Lughofer, E., Angelov, P.: Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Applied Soft Computing 11(2), 2057–2068 (2011)CrossRef
24.
Zurück zum Zitat Min, R.: A non-linear dimensionality reduction method for improving nearest neighbour classification. Ph.D. thesis, University of Toronto (2005). Toronto, Canada Min, R.: A non-linear dimensionality reduction method for improving nearest neighbour classification. Ph.D. thesis, University of Toronto (2005). Toronto, Canada
25.
Zurück zum Zitat Nakhaeizadeh, G., Taylor, C., Kunisch, G.: Dynamic supervised learning. Some basic issues and application aspects. classification and knowledge organization, pp. 123–135. Springer Verlag, Berlin Heidelberg (1997) Nakhaeizadeh, G., Taylor, C., Kunisch, G.: Dynamic supervised learning. Some basic issues and application aspects. classification and knowledge organization, pp. 123–135. Springer Verlag, Berlin Heidelberg (1997)
26.
Zurück zum Zitat Roncaglia, A., Elmi, I., Dori, L.: Adaptive K-NN for the detection of air pollutants with a sensor array. IEEE Sensor Journal 4(2), 248–256 (2004)CrossRef Roncaglia, A., Elmi, I., Dori, L.: Adaptive K-NN for the detection of air pollutants with a sensor array. IEEE Sensor Journal 4(2), 248–256 (2004)CrossRef
27.
Zurück zum Zitat Song, Y., Huang, J., Zhou, D.: Ik-NN: Informative k-nearest neighbor pattern classification. In: Proceedings of the PKKD 2007 conference, pp. 248–264 (2007) Song, Y., Huang, J., Zhou, D.: Ik-NN: Informative k-nearest neighbor pattern classification. In: Proceedings of the PKKD 2007 conference, pp. 248–264 (2007)
28.
Zurück zum Zitat Therrien, C.: Decision Estimation and Classification: An Introduction to Pattern Recognition and Related Topics. John Wiley & Sons, New York (1989)MATH Therrien, C.: Decision Estimation and Classification: An Introduction to Pattern Recognition and Related Topics. John Wiley & Sons, New York (1989)MATH
29.
Zurück zum Zitat Vachkov, G.: Online classification of machine operation modes based on information compression and fuzzy similarity analysis. In: Proceedings of the IFSA-EUSFLAT 2009 conference, pp. 1456–1461. Lisbon, Portugal (2009) Vachkov, G.: Online classification of machine operation modes based on information compression and fuzzy similarity analysis. In: Proceedings of the IFSA-EUSFLAT 2009 conference, pp. 1456–1461. Lisbon, Portugal (2009)
30.
Zurück zum Zitat Zhang, B., Srihari, S.: A fast algorithm for finding k-nearest neighbors with non-metric dissimilarity. In: Proceedings of the 8th International Workshop on Frontiers in Handwriting Recognition (IWFHR’02), pp. 13–19 (2002) Zhang, B., Srihari, S.: A fast algorithm for finding k-nearest neighbors with non-metric dissimilarity. In: Proceedings of the 8th International Workshop on Frontiers in Handwriting Recognition (IWFHR’02), pp. 13–19 (2002)
Metadaten
Titel
Semisupervised Dynamic Fuzzy K-Nearest Neighbors
verfasst von
Laurent Hartert
Moamar Sayed-Mouchaweh
Copyright-Jahr
2012
Verlag
Springer New York
DOI
https://doi.org/10.1007/978-1-4419-8020-5_5

Premium Partner