Skip to main content
Top

2012 | OriginalPaper | Chapter

5. Semisupervised Dynamic Fuzzy K-Nearest Neighbors

Authors : Laurent Hartert, Moamar Sayed-Mouchaweh

Published in: Learning in Non-Stationary Environments

Publisher: Springer New York

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

This chapter presents a semi-supervised dynamic classification method to deal with the problem of diagnosis of industrial evolving systems. Indeed, when a functioning mode evolves, the system characteristics change and the observations, i.e. the patterns representing observations in the feature space, obtained on the system change too. Thus, each class membership function must be adapted to take into account these temporal changes and to keep representative patterns only. This requires an adaptive method with a mechanism for adjusting its parameters over time. The developed approach is named Semi-Supervised Dynamic Fuzzy K-Nearest Neighbors (SS-DFKNN) and comprises three phases: a detection phase to detect and confirm classes evolutions, an adaptation phase realized incrementally to update the evolved classes parameters and to create new classes if necessary and a validation phase to keep useful classes only. To illustrate this approach, the diagnosis of a welding system is realized to detect the weldings quality (good or bad), based on acoustic noises issued of weldings operations.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Amadou-Boubacar, H., Lecoeuche, S., Maouche, S.: Self-adaptive kernel machine: Online clustering in RKHS. In: Proceedings of the IEEE IJCNN05. Montreal, Canada (2005) Amadou-Boubacar, H., Lecoeuche, S., Maouche, S.: Self-adaptive kernel machine: Online clustering in RKHS. In: Proceedings of the IEEE IJCNN05. Montreal, Canada (2005)
3.
go back to reference Angelov, P., Filev, D., Kasabov, N.: Evolving Intelligent Systems—Methodology and Applications. John Wiley & Sons, New York (2010)CrossRef Angelov, P., Filev, D., Kasabov, N.: Evolving Intelligent Systems—Methodology and Applications. John Wiley & Sons, New York (2010)CrossRef
4.
go back to reference Angstenberger, L.: Dynamic fuzzy pattern recognition. Ph.D. thesis, Fakultät für Wirtschaftswissenschaften der Rheinisch-Westfälischen Technischen Hochschule (2000). Aachen, Germany Angstenberger, L.: Dynamic fuzzy pattern recognition. Ph.D. thesis, Fakultät für Wirtschaftswissenschaften der Rheinisch-Westfälischen Technischen Hochschule (2000). Aachen, Germany
5.
go back to reference Beringer, J., Hüllermeier, E.: Efficient instance-based learning on data streams. Intelligent Data Analysis 11(6), 627–650 (2007) Beringer, J., Hüllermeier, E.: Efficient instance-based learning on data streams. Intelligent Data Analysis 11(6), 627–650 (2007)
6.
go back to reference Bezdek, J.: Pattern Recognition with Fuzzy Objective Function Algorithms. Kluwer Academic/Plenum Publishers, USA (1981)MATH Bezdek, J.: Pattern Recognition with Fuzzy Objective Function Algorithms. Kluwer Academic/Plenum Publishers, USA (1981)MATH
7.
go back to reference Cohen, L., Avrahami, G., Last, M.: Incremental info-fuzzy algorithm for real time data mining of non-stationary data streams. In: Proceedings of the TDM Workshop. Brighton, UK (2004) Cohen, L., Avrahami, G., Last, M.: Incremental info-fuzzy algorithm for real time data mining of non-stationary data streams. In: Proceedings of the TDM Workshop. Brighton, UK (2004)
8.
go back to reference Cozman, F., Cohen, I., Cirelo, M.: Semi-supervised learning of mixture models. In: Proceedings of the 20th International Conference on Machine Learning (ICML). Washington DC, USA (2003) Cozman, F., Cohen, I., Cirelo, M.: Semi-supervised learning of mixture models. In: Proceedings of the 20th International Conference on Machine Learning (ICML). Washington DC, USA (2003)
9.
go back to reference Dubuisson, B.: Diagnostic et reconnaissance des formes. Tech. rep., Trait des Nouvelles Technolo-gies, srie Diagnostic et Maintenance, HERMES (1990) Dubuisson, B.: Diagnostic et reconnaissance des formes. Tech. rep., Trait des Nouvelles Technolo-gies, srie Diagnostic et Maintenance, HERMES (1990)
10.
go back to reference Duda, R., Hart, P., Stork, D.: Pattern Classification—Second Edition. Wiley-Interscience (John Wiley & Sons), Southern Gate, Chichester, West Sussex, England (2000) Duda, R., Hart, P., Stork, D.: Pattern Classification—Second Edition. Wiley-Interscience (John Wiley & Sons), Southern Gate, Chichester, West Sussex, England (2000)
11.
go back to reference Frigui, H., Krishnapuram, R.: A robust algorithm for automatic extraction of an unknown number of clusters from noisy data. Pattern Recognition Letters 17, 1223–1232 (1996)MATHCrossRef Frigui, H., Krishnapuram, R.: A robust algorithm for automatic extraction of an unknown number of clusters from noisy data. Pattern Recognition Letters 17, 1223–1232 (1996)MATHCrossRef
12.
go back to reference Frigui, H., Krishnapuram, R.: Clustering by competitive agglomeration. Pattern Recognition 307, 1109–1119 (1997) Frigui, H., Krishnapuram, R.: Clustering by competitive agglomeration. Pattern Recognition 307, 1109–1119 (1997)
13.
go back to reference Gabrys, B., Bargiela, A.: General fuzzy min–max neural network for clustering and classification. IEEE Transactions on Neural Networks 11(3), 769–783 (2000)CrossRef Gabrys, B., Bargiela, A.: General fuzzy min–max neural network for clustering and classification. IEEE Transactions on Neural Networks 11(3), 769–783 (2000)CrossRef
14.
go back to reference Garcia, V.: Suivi d’objets d’intrt dans une sequence d’images: des points saillants aux mesures statistiques. Tech. rep., University of Nice (2009) Garcia, V.: Suivi d’objets d’intrt dans une sequence d’images: des points saillants aux mesures statistiques. Tech. rep., University of Nice (2009)
15.
go back to reference Gibb, W., Auslander, D., Griffin, J.: Adaptive classification of myocardial electrogram waveforms. IEEE Transactions on Biomedical Engineering 41, 804–808 (1994)CrossRef Gibb, W., Auslander, D., Griffin, J.: Adaptive classification of myocardial electrogram waveforms. IEEE Transactions on Biomedical Engineering 41, 804–808 (1994)CrossRef
16.
go back to reference Guedalia, I., London, M., Werman, M.: An on-line agglomerative clustering method for non-stationary data. Neural Computation 11(2), 521–540 (1999)CrossRef Guedalia, I., London, M., Werman, M.: An on-line agglomerative clustering method for non-stationary data. Neural Computation 11(2), 521–540 (1999)CrossRef
17.
go back to reference Jain, A., Duin, R., Mao, J.: Statistical pattern recognition: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(1), 4–37 (2000)CrossRef Jain, A., Duin, R., Mao, J.: Statistical pattern recognition: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(1), 4–37 (2000)CrossRef
18.
go back to reference Kasabov, N.: Evolving Connectionist Systems: The Knowledge Engineering Approach—Second Edition. Springer Verlag, London (2007) Kasabov, N.: Evolving Connectionist Systems: The Knowledge Engineering Approach—Second Edition. Springer Verlag, London (2007)
19.
go back to reference Keller, J., Gray, M., Givens, J.: A fuzzy k-nn neighbor algorithm. IEEE Transactions on Systems, Man and Cybernetics 15(4), 580–585 (1985) Keller, J., Gray, M., Givens, J.: A fuzzy k-nn neighbor algorithm. IEEE Transactions on Systems, Man and Cybernetics 15(4), 580–585 (1985)
20.
go back to reference Kybic, J.: Incremental updating of nearest neighbor-based high-dimensional entropy estimation. In: Proceedings of the ICASSP 2006, pp. 804–807 (2006) Kybic, J.: Incremental updating of nearest neighbor-based high-dimensional entropy estimation. In: Proceedings of the ICASSP 2006, pp. 804–807 (2006)
21.
go back to reference Law, Y., Zaniolo, C.: An adaptive nearest neighbor classification algorithm for data streams. In: Proceedings of the 9th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD 2005), pp. 108–120. Porto, Portugal (2005) Law, Y., Zaniolo, C.: An adaptive nearest neighbor classification algorithm for data streams. In: Proceedings of the 9th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD 2005), pp. 108–120. Porto, Portugal (2005)
22.
go back to reference Lughofer, E.: Evolving Fuzzy Systems—Methodologies, Advanced Concepts and Applications. Springer, Berlin Heidelberg (2011)MATHCrossRef Lughofer, E.: Evolving Fuzzy Systems—Methodologies, Advanced Concepts and Applications. Springer, Berlin Heidelberg (2011)MATHCrossRef
23.
go back to reference Lughofer, E., Angelov, P.: Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Applied Soft Computing 11(2), 2057–2068 (2011)CrossRef Lughofer, E., Angelov, P.: Handling drifts and shifts in on-line data streams with evolving fuzzy systems. Applied Soft Computing 11(2), 2057–2068 (2011)CrossRef
24.
go back to reference Min, R.: A non-linear dimensionality reduction method for improving nearest neighbour classification. Ph.D. thesis, University of Toronto (2005). Toronto, Canada Min, R.: A non-linear dimensionality reduction method for improving nearest neighbour classification. Ph.D. thesis, University of Toronto (2005). Toronto, Canada
25.
go back to reference Nakhaeizadeh, G., Taylor, C., Kunisch, G.: Dynamic supervised learning. Some basic issues and application aspects. classification and knowledge organization, pp. 123–135. Springer Verlag, Berlin Heidelberg (1997) Nakhaeizadeh, G., Taylor, C., Kunisch, G.: Dynamic supervised learning. Some basic issues and application aspects. classification and knowledge organization, pp. 123–135. Springer Verlag, Berlin Heidelberg (1997)
26.
go back to reference Roncaglia, A., Elmi, I., Dori, L.: Adaptive K-NN for the detection of air pollutants with a sensor array. IEEE Sensor Journal 4(2), 248–256 (2004)CrossRef Roncaglia, A., Elmi, I., Dori, L.: Adaptive K-NN for the detection of air pollutants with a sensor array. IEEE Sensor Journal 4(2), 248–256 (2004)CrossRef
27.
go back to reference Song, Y., Huang, J., Zhou, D.: Ik-NN: Informative k-nearest neighbor pattern classification. In: Proceedings of the PKKD 2007 conference, pp. 248–264 (2007) Song, Y., Huang, J., Zhou, D.: Ik-NN: Informative k-nearest neighbor pattern classification. In: Proceedings of the PKKD 2007 conference, pp. 248–264 (2007)
28.
go back to reference Therrien, C.: Decision Estimation and Classification: An Introduction to Pattern Recognition and Related Topics. John Wiley & Sons, New York (1989)MATH Therrien, C.: Decision Estimation and Classification: An Introduction to Pattern Recognition and Related Topics. John Wiley & Sons, New York (1989)MATH
29.
go back to reference Vachkov, G.: Online classification of machine operation modes based on information compression and fuzzy similarity analysis. In: Proceedings of the IFSA-EUSFLAT 2009 conference, pp. 1456–1461. Lisbon, Portugal (2009) Vachkov, G.: Online classification of machine operation modes based on information compression and fuzzy similarity analysis. In: Proceedings of the IFSA-EUSFLAT 2009 conference, pp. 1456–1461. Lisbon, Portugal (2009)
30.
go back to reference Zhang, B., Srihari, S.: A fast algorithm for finding k-nearest neighbors with non-metric dissimilarity. In: Proceedings of the 8th International Workshop on Frontiers in Handwriting Recognition (IWFHR’02), pp. 13–19 (2002) Zhang, B., Srihari, S.: A fast algorithm for finding k-nearest neighbors with non-metric dissimilarity. In: Proceedings of the 8th International Workshop on Frontiers in Handwriting Recognition (IWFHR’02), pp. 13–19 (2002)
Metadata
Title
Semisupervised Dynamic Fuzzy K-Nearest Neighbors
Authors
Laurent Hartert
Moamar Sayed-Mouchaweh
Copyright Year
2012
Publisher
Springer New York
DOI
https://doi.org/10.1007/978-1-4419-8020-5_5

Premium Partner