Skip to main content

2012 | OriginalPaper | Buchkapitel

4. Incremental Spectral Clustering

verfasst von : Abdelhamid Bouchachia, Markus Prossegger

Erschienen in: Learning in Non-Stationary Environments

Verlag: Springer New York

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the present contribution, a novel algorithm for off-line spectral clustering algorithm is introduced and an online extension is derived in order to deal with sequential data. The proposed algorithm aims at dealing with nonconvex clusters having different forms. It relies on the notion of communicability that allows to handle the contiguity of data distribution. In the second part of the paper, an incremental extension of the fuzzy c-varieties is proposed to serve as a building block of the incremental spectral clustering algorithm (ISC). Initial simulations are presented towards the end of the contribution to show the performance of the ISC algorithm.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat F. Bach and M. Jordan. Spectral Clustering for Speech Separation, pages 221–250. John Wiley and Sons, Ltd. (2009) F. Bach and M. Jordan. Spectral Clustering for Speech Separation, pages 221–250. John Wiley and Sons, Ltd. (2009)
2.
Zurück zum Zitat J. Bezdek. Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press (1981) J. Bezdek. Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press (1981)
3.
Zurück zum Zitat J. Bezdek and R. Hathaway. Numerical Convergence and Interpretation of the Fuzzy C-shells Clustering Algorithm. IEEE Trans. on Neural Networks, 3, 787–793 (1992)CrossRef J. Bezdek and R. Hathaway. Numerical Convergence and Interpretation of the Fuzzy C-shells Clustering Algorithm. IEEE Trans. on Neural Networks, 3, 787–793 (1992)CrossRef
4.
5.
Zurück zum Zitat A. Bouchachia. An evolving classification cascade with self-learning. Evolving Systems, 1(3), 143–160 (2010)CrossRef A. Bouchachia. An evolving classification cascade with self-learning. Evolving Systems, 1(3), 143–160 (2010)CrossRef
6.
Zurück zum Zitat A. Bouchachia. Fuzzy classification in dynamic environments. Soft Computing—A Fusion of Foundations, Methodologies and Applications, 15, 1009–1022 (2011) A. Bouchachia. Fuzzy classification in dynamic environments. Soft Computing—A Fusion of Foundations, Methodologies and Applications, 15, 1009–1022 (2011)
7.
Zurück zum Zitat A. Bouchachia. Incremental learning with multi-level adaptation. Neurocomputing, 74(11), 1785–1799 (2011)CrossRef A. Bouchachia. Incremental learning with multi-level adaptation. Neurocomputing, 74(11), 1785–1799 (2011)CrossRef
8.
Zurück zum Zitat A. Bouchachia and W. Pedrycz. Enhancement of fuzzy clustering by mechanisms of partial supervision. Fuzzy Sets and Systems, 157(13), 1733–1759 (2006)MathSciNetMATHCrossRef A. Bouchachia and W. Pedrycz. Enhancement of fuzzy clustering by mechanisms of partial supervision. Fuzzy Sets and Systems, 157(13), 1733–1759 (2006)MathSciNetMATHCrossRef
9.
Zurück zum Zitat A. Bouchachia and M. Prossegger. A hybrid ensemble approach for the steiner tree problem in large graphs: a geographical application. Applied Soft Computing 11(8), 5745–5754 (2011) A. Bouchachia and M. Prossegger. A hybrid ensemble approach for the steiner tree problem in large graphs: a geographical application. Applied Soft Computing 11(8), 5745–5754 (2011)
10.
Zurück zum Zitat H. Chang and D. Yeung. Robust path-based spectral clustering. Pattern Recognition, 41, 191–203 (2008)MATHCrossRef H. Chang and D. Yeung. Robust path-based spectral clustering. Pattern Recognition, 41, 191–203 (2008)MATHCrossRef
11.
Zurück zum Zitat R. Dave. Validating fuzzy partitions obtained through c-shells clustering. Pattern Recognition Letters, 17(6), 613–623 (1996)MathSciNetCrossRef R. Dave. Validating fuzzy partitions obtained through c-shells clustering. Pattern Recognition Letters, 17(6), 613–623 (1996)MathSciNetCrossRef
12.
Zurück zum Zitat R. Dave and K. Bhaswan. Adaptive fuzzy c-shells clustering and detection of ellipses. IEEE Transactions on Neural Networks, 3(5), 643–662 (1992)CrossRef R. Dave and K. Bhaswan. Adaptive fuzzy c-shells clustering and detection of ellipses. IEEE Transactions on Neural Networks, 3(5), 643–662 (1992)CrossRef
13.
Zurück zum Zitat E. Estrada and J. Rodríguez-Velázquez. Subgraph centrality in complex networks. Phys. Rev. E, 71(5), 056103 (2005) E. Estrada and J. Rodríguez-Velázquez. Subgraph centrality in complex networks. Phys. Rev. E, 71(5), 056103 (2005)
14.
Zurück zum Zitat I. Fischer and I. Poland. New methods for spectral clustering. Technical Report IDSIA-12-04, IDSIA (2004) I. Fischer and I. Poland. New methods for spectral clustering. Technical Report IDSIA-12-04, IDSIA (2004)
15.
Zurück zum Zitat H. Frigui and R. Krishnapuram. A comparison of fuzzy shell-clustering methods for the detection of ellipses. IEEE Transactions on Fuzzy Systems, 4(2), 193–199 (1996)CrossRef H. Frigui and R. Krishnapuram. A comparison of fuzzy shell-clustering methods for the detection of ellipses. IEEE Transactions on Fuzzy Systems, 4(2), 193–199 (1996)CrossRef
16.
Zurück zum Zitat I. Gath and D. Hoory. Fuzzy Clustering of Elliptic Ring-shaped Clusters. Pattern Recognition Letters, 16(7), 727–741 (1995)CrossRef I. Gath and D. Hoory. Fuzzy Clustering of Elliptic Ring-shaped Clusters. Pattern Recognition Letters, 16(7), 727–741 (1995)CrossRef
17.
Zurück zum Zitat D. Gustafson and W. Kessel. Fuzzy Clustering with a Fuzzy Covariance Matrix. In Proc. of the IEEE Conf. on Decision and Control, pp. 761–766 (1979) D. Gustafson and W. Kessel. Fuzzy Clustering with a Fuzzy Covariance Matrix. In Proc. of the IEEE Conf. on Decision and Control, pp. 761–766 (1979)
18.
Zurück zum Zitat L. Hagen and A. Kahng. New spectral methods for ratio cut partitioning and clustering. IEEE Trans. Computer-Aided Design, 11(9), 1074–1085 (1992)CrossRef L. Hagen and A. Kahng. New spectral methods for ratio cut partitioning and clustering. IEEE Trans. Computer-Aided Design, 11(9), 1074–1085 (1992)CrossRef
19.
Zurück zum Zitat F. Hoeppner. Fuzzy shell clustering algorithms in image processing: fuzzy c-rectangular and 2-rectangular shells. IEEE Transactions on Fuzzy Systems, 5(4), 599–613 (1997)CrossRef F. Hoeppner. Fuzzy shell clustering algorithms in image processing: fuzzy c-rectangular and 2-rectangular shells. IEEE Transactions on Fuzzy Systems, 5(4), 599–613 (1997)CrossRef
20.
Zurück zum Zitat R. Krishnapuram, H. Frigui, and O. Nasraoui. Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation. i. IEEE Transactions on Fuzzy Systems, 3(1), 29–43 (1995) R. Krishnapuram, H. Frigui, and O. Nasraoui. Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation. i. IEEE Transactions on Fuzzy Systems, 3(1), 29–43 (1995)
21.
Zurück zum Zitat R. Krishnapuram, H. Frigui, and O. Nasraoui. Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation. ii. IEEE Transactions on Fuzzy Systems, 3(1), 44–60 (1995) R. Krishnapuram, H. Frigui, and O. Nasraoui. Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation. ii. IEEE Transactions on Fuzzy Systems, 3(1), 44–60 (1995)
22.
Zurück zum Zitat R. Krishnapuram, O. Nasraoui, and H. Frigui. The fuzzy c spherical shells algorithm: a new approach. IEEE Transactions on Neural Networks, 3(5), 663–671 (1992)CrossRef R. Krishnapuram, O. Nasraoui, and H. Frigui. The fuzzy c spherical shells algorithm: a new approach. IEEE Transactions on Neural Networks, 3(5), 663–671 (1992)CrossRef
23.
Zurück zum Zitat J. Leski. Fuzzy c-varieties/elliptotypes clustering in reproducing kernel hilbert space. Fuzzy Sets and Systems, 141(2), 259–280 (2004)MathSciNetMATHCrossRef J. Leski. Fuzzy c-varieties/elliptotypes clustering in reproducing kernel hilbert space. Fuzzy Sets and Systems, 141(2), 259–280 (2004)MathSciNetMATHCrossRef
24.
Zurück zum Zitat C. Lim, S. Bohacek, J. Hespanha, and K. Obraczka. Hierarchical max-flow routing. In IEEE Conference on Global Telecommunications Conference, pp. 550–556 (2005) C. Lim, S. Bohacek, J. Hespanha, and K. Obraczka. Hierarchical max-flow routing. In IEEE Conference on Global Telecommunications Conference, pp. 550–556 (2005)
25.
Zurück zum Zitat M. Meila and J. Shi. Learning segmentation by random walks. In Neural Information Processing Systems, NIPS, 873–879 (2001) M. Meila and J. Shi. Learning segmentation by random walks. In Neural Information Processing Systems, NIPS, 873–879 (2001)
26.
Zurück zum Zitat A. Ng, M. Jordan, and Y. Weiss. On spectral clustering: Analysis and an algorithm. In Advances in Neural Information Processing Systems, 849–856. MIT Press (2001) A. Ng, M. Jordan, and Y. Weiss. On spectral clustering: Analysis and an algorithm. In Advances in Neural Information Processing Systems, 849–856. MIT Press (2001)
27.
Zurück zum Zitat H. Ning, W. Xu, Y. Chi, Y. Gong, and T. Huang. Incremental spectral clustering by efficiently updating the eigen-system. Pattern Recognition, 43(1), 113–127 (2010)MATHCrossRef H. Ning, W. Xu, Y. Chi, Y. Gong, and T. Huang. Incremental spectral clustering by efficiently updating the eigen-system. Pattern Recognition, 43(1), 113–127 (2010)MATHCrossRef
28.
Zurück zum Zitat D. Niu, J. Dy, and M. Jordan. Multiple non-redundant spectral clustering views. In Proceedings of the 27th International Conference on Machine Learning, pp. 831–838 (2010) D. Niu, J. Dy, and M. Jordan. Multiple non-redundant spectral clustering views. In Proceedings of the 27th International Conference on Machine Learning, pp. 831–838 (2010)
29.
Zurück zum Zitat M. Prossegger and A. Bouchachia. Ant colony optimization for steiner tree problems. In Proceedings of the 5th international conference on Soft computing as transdisciplinary science and technology, pp. 331–336. ACM (2008) M. Prossegger and A. Bouchachia. Ant colony optimization for steiner tree problems. In Proceedings of the 5th international conference on Soft computing as transdisciplinary science and technology, pp. 331–336. ACM (2008)
30.
Zurück zum Zitat T. Runkler and R. Palm. Identification of nonlinear systems using regular fuzzy c-elliptotype clustering. In Proceedings of the Fifth IEEE International Conference on Fuzzy Systems, volume 2, pp. 1026–1030 (1996) T. Runkler and R. Palm. Identification of nonlinear systems using regular fuzzy c-elliptotype clustering. In Proceedings of the Fifth IEEE International Conference on Fuzzy Systems, volume 2, pp. 1026–1030 (1996)
31.
Zurück zum Zitat J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 22(8), 888–905 (2000)CrossRef J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 22(8), 888–905 (2000)CrossRef
32.
Zurück zum Zitat F. Tung, A. Wong, and D. Clausi. Enabling scalable spectral clustering for image segmentation. Pattern Recogn., 43, 4069–4076 (2010)MATHCrossRef F. Tung, A. Wong, and D. Clausi. Enabling scalable spectral clustering for image segmentation. Pattern Recogn., 43, 4069–4076 (2010)MATHCrossRef
33.
Zurück zum Zitat C. Valgren, T. Duckett, and L. Lilienthal. Incremental spectral clustering and its application to topological mapping. In Proc. IEEE International Conference on Robotics and Automation, pp. 4283–4288 (2007) C. Valgren, T. Duckett, and L. Lilienthal. Incremental spectral clustering and its application to topological mapping. In Proc. IEEE International Conference on Robotics and Automation, pp. 4283–4288 (2007)
34.
Zurück zum Zitat C. Valgren and A. Lilienthal. Incremental spectral clustering and seasons: Appearance-based localization in outdoor environments. In Robotics and Automation, 2008. ICRA 2008. IEEE International Conference on, pp. 1856 –1861 (2008) C. Valgren and A. Lilienthal. Incremental spectral clustering and seasons: Appearance-based localization in outdoor environments. In Robotics and Automation, 2008. ICRA 2008. IEEE International Conference on, pp. 1856 –1861 (2008)
35.
Zurück zum Zitat L. Wang, C. Leckie, R. Kotagiri, and J. Bezdek. Approximate pairwise clustering for large data sets via sampling plus extension. Pattern Recognition, 44, 222–235 (2011)CrossRef L. Wang, C. Leckie, R. Kotagiri, and J. Bezdek. Approximate pairwise clustering for large data sets via sampling plus extension. Pattern Recognition, 44, 222–235 (2011)CrossRef
36.
Zurück zum Zitat D. Yan, L. Huang, and M. Jordan. Fast approximate spectral clustering. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 907–916. ACM (2009) D. Yan, L. Huang, and M. Jordan. Fast approximate spectral clustering. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 907–916. ACM (2009)
Metadaten
Titel
Incremental Spectral Clustering
verfasst von
Abdelhamid Bouchachia
Markus Prossegger
Copyright-Jahr
2012
Verlag
Springer New York
DOI
https://doi.org/10.1007/978-1-4419-8020-5_4

Premium Partner