Skip to main content
Top

2012 | OriginalPaper | Chapter

4. Incremental Spectral Clustering

Authors : Abdelhamid Bouchachia, Markus Prossegger

Published in: Learning in Non-Stationary Environments

Publisher: Springer New York

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In the present contribution, a novel algorithm for off-line spectral clustering algorithm is introduced and an online extension is derived in order to deal with sequential data. The proposed algorithm aims at dealing with nonconvex clusters having different forms. It relies on the notion of communicability that allows to handle the contiguity of data distribution. In the second part of the paper, an incremental extension of the fuzzy c-varieties is proposed to serve as a building block of the incremental spectral clustering algorithm (ISC). Initial simulations are presented towards the end of the contribution to show the performance of the ISC algorithm.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference F. Bach and M. Jordan. Spectral Clustering for Speech Separation, pages 221–250. John Wiley and Sons, Ltd. (2009) F. Bach and M. Jordan. Spectral Clustering for Speech Separation, pages 221–250. John Wiley and Sons, Ltd. (2009)
2.
go back to reference J. Bezdek. Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press (1981) J. Bezdek. Pattern Recognition with Fuzzy Objective Function Algorithms. Plenum Press (1981)
3.
go back to reference J. Bezdek and R. Hathaway. Numerical Convergence and Interpretation of the Fuzzy C-shells Clustering Algorithm. IEEE Trans. on Neural Networks, 3, 787–793 (1992)CrossRef J. Bezdek and R. Hathaway. Numerical Convergence and Interpretation of the Fuzzy C-shells Clustering Algorithm. IEEE Trans. on Neural Networks, 3, 787–793 (1992)CrossRef
4.
5.
go back to reference A. Bouchachia. An evolving classification cascade with self-learning. Evolving Systems, 1(3), 143–160 (2010)CrossRef A. Bouchachia. An evolving classification cascade with self-learning. Evolving Systems, 1(3), 143–160 (2010)CrossRef
6.
go back to reference A. Bouchachia. Fuzzy classification in dynamic environments. Soft Computing—A Fusion of Foundations, Methodologies and Applications, 15, 1009–1022 (2011) A. Bouchachia. Fuzzy classification in dynamic environments. Soft Computing—A Fusion of Foundations, Methodologies and Applications, 15, 1009–1022 (2011)
7.
go back to reference A. Bouchachia. Incremental learning with multi-level adaptation. Neurocomputing, 74(11), 1785–1799 (2011)CrossRef A. Bouchachia. Incremental learning with multi-level adaptation. Neurocomputing, 74(11), 1785–1799 (2011)CrossRef
8.
go back to reference A. Bouchachia and W. Pedrycz. Enhancement of fuzzy clustering by mechanisms of partial supervision. Fuzzy Sets and Systems, 157(13), 1733–1759 (2006)MathSciNetMATHCrossRef A. Bouchachia and W. Pedrycz. Enhancement of fuzzy clustering by mechanisms of partial supervision. Fuzzy Sets and Systems, 157(13), 1733–1759 (2006)MathSciNetMATHCrossRef
9.
go back to reference A. Bouchachia and M. Prossegger. A hybrid ensemble approach for the steiner tree problem in large graphs: a geographical application. Applied Soft Computing 11(8), 5745–5754 (2011) A. Bouchachia and M. Prossegger. A hybrid ensemble approach for the steiner tree problem in large graphs: a geographical application. Applied Soft Computing 11(8), 5745–5754 (2011)
10.
go back to reference H. Chang and D. Yeung. Robust path-based spectral clustering. Pattern Recognition, 41, 191–203 (2008)MATHCrossRef H. Chang and D. Yeung. Robust path-based spectral clustering. Pattern Recognition, 41, 191–203 (2008)MATHCrossRef
11.
go back to reference R. Dave. Validating fuzzy partitions obtained through c-shells clustering. Pattern Recognition Letters, 17(6), 613–623 (1996)MathSciNetCrossRef R. Dave. Validating fuzzy partitions obtained through c-shells clustering. Pattern Recognition Letters, 17(6), 613–623 (1996)MathSciNetCrossRef
12.
go back to reference R. Dave and K. Bhaswan. Adaptive fuzzy c-shells clustering and detection of ellipses. IEEE Transactions on Neural Networks, 3(5), 643–662 (1992)CrossRef R. Dave and K. Bhaswan. Adaptive fuzzy c-shells clustering and detection of ellipses. IEEE Transactions on Neural Networks, 3(5), 643–662 (1992)CrossRef
13.
go back to reference E. Estrada and J. Rodríguez-Velázquez. Subgraph centrality in complex networks. Phys. Rev. E, 71(5), 056103 (2005) E. Estrada and J. Rodríguez-Velázquez. Subgraph centrality in complex networks. Phys. Rev. E, 71(5), 056103 (2005)
14.
go back to reference I. Fischer and I. Poland. New methods for spectral clustering. Technical Report IDSIA-12-04, IDSIA (2004) I. Fischer and I. Poland. New methods for spectral clustering. Technical Report IDSIA-12-04, IDSIA (2004)
15.
go back to reference H. Frigui and R. Krishnapuram. A comparison of fuzzy shell-clustering methods for the detection of ellipses. IEEE Transactions on Fuzzy Systems, 4(2), 193–199 (1996)CrossRef H. Frigui and R. Krishnapuram. A comparison of fuzzy shell-clustering methods for the detection of ellipses. IEEE Transactions on Fuzzy Systems, 4(2), 193–199 (1996)CrossRef
16.
go back to reference I. Gath and D. Hoory. Fuzzy Clustering of Elliptic Ring-shaped Clusters. Pattern Recognition Letters, 16(7), 727–741 (1995)CrossRef I. Gath and D. Hoory. Fuzzy Clustering of Elliptic Ring-shaped Clusters. Pattern Recognition Letters, 16(7), 727–741 (1995)CrossRef
17.
go back to reference D. Gustafson and W. Kessel. Fuzzy Clustering with a Fuzzy Covariance Matrix. In Proc. of the IEEE Conf. on Decision and Control, pp. 761–766 (1979) D. Gustafson and W. Kessel. Fuzzy Clustering with a Fuzzy Covariance Matrix. In Proc. of the IEEE Conf. on Decision and Control, pp. 761–766 (1979)
18.
go back to reference L. Hagen and A. Kahng. New spectral methods for ratio cut partitioning and clustering. IEEE Trans. Computer-Aided Design, 11(9), 1074–1085 (1992)CrossRef L. Hagen and A. Kahng. New spectral methods for ratio cut partitioning and clustering. IEEE Trans. Computer-Aided Design, 11(9), 1074–1085 (1992)CrossRef
19.
go back to reference F. Hoeppner. Fuzzy shell clustering algorithms in image processing: fuzzy c-rectangular and 2-rectangular shells. IEEE Transactions on Fuzzy Systems, 5(4), 599–613 (1997)CrossRef F. Hoeppner. Fuzzy shell clustering algorithms in image processing: fuzzy c-rectangular and 2-rectangular shells. IEEE Transactions on Fuzzy Systems, 5(4), 599–613 (1997)CrossRef
20.
go back to reference R. Krishnapuram, H. Frigui, and O. Nasraoui. Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation. i. IEEE Transactions on Fuzzy Systems, 3(1), 29–43 (1995) R. Krishnapuram, H. Frigui, and O. Nasraoui. Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation. i. IEEE Transactions on Fuzzy Systems, 3(1), 29–43 (1995)
21.
go back to reference R. Krishnapuram, H. Frigui, and O. Nasraoui. Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation. ii. IEEE Transactions on Fuzzy Systems, 3(1), 44–60 (1995) R. Krishnapuram, H. Frigui, and O. Nasraoui. Fuzzy and possibilistic shell clustering algorithms and their application to boundary detection and surface approximation. ii. IEEE Transactions on Fuzzy Systems, 3(1), 44–60 (1995)
22.
go back to reference R. Krishnapuram, O. Nasraoui, and H. Frigui. The fuzzy c spherical shells algorithm: a new approach. IEEE Transactions on Neural Networks, 3(5), 663–671 (1992)CrossRef R. Krishnapuram, O. Nasraoui, and H. Frigui. The fuzzy c spherical shells algorithm: a new approach. IEEE Transactions on Neural Networks, 3(5), 663–671 (1992)CrossRef
23.
go back to reference J. Leski. Fuzzy c-varieties/elliptotypes clustering in reproducing kernel hilbert space. Fuzzy Sets and Systems, 141(2), 259–280 (2004)MathSciNetMATHCrossRef J. Leski. Fuzzy c-varieties/elliptotypes clustering in reproducing kernel hilbert space. Fuzzy Sets and Systems, 141(2), 259–280 (2004)MathSciNetMATHCrossRef
24.
go back to reference C. Lim, S. Bohacek, J. Hespanha, and K. Obraczka. Hierarchical max-flow routing. In IEEE Conference on Global Telecommunications Conference, pp. 550–556 (2005) C. Lim, S. Bohacek, J. Hespanha, and K. Obraczka. Hierarchical max-flow routing. In IEEE Conference on Global Telecommunications Conference, pp. 550–556 (2005)
25.
go back to reference M. Meila and J. Shi. Learning segmentation by random walks. In Neural Information Processing Systems, NIPS, 873–879 (2001) M. Meila and J. Shi. Learning segmentation by random walks. In Neural Information Processing Systems, NIPS, 873–879 (2001)
26.
go back to reference A. Ng, M. Jordan, and Y. Weiss. On spectral clustering: Analysis and an algorithm. In Advances in Neural Information Processing Systems, 849–856. MIT Press (2001) A. Ng, M. Jordan, and Y. Weiss. On spectral clustering: Analysis and an algorithm. In Advances in Neural Information Processing Systems, 849–856. MIT Press (2001)
27.
go back to reference H. Ning, W. Xu, Y. Chi, Y. Gong, and T. Huang. Incremental spectral clustering by efficiently updating the eigen-system. Pattern Recognition, 43(1), 113–127 (2010)MATHCrossRef H. Ning, W. Xu, Y. Chi, Y. Gong, and T. Huang. Incremental spectral clustering by efficiently updating the eigen-system. Pattern Recognition, 43(1), 113–127 (2010)MATHCrossRef
28.
go back to reference D. Niu, J. Dy, and M. Jordan. Multiple non-redundant spectral clustering views. In Proceedings of the 27th International Conference on Machine Learning, pp. 831–838 (2010) D. Niu, J. Dy, and M. Jordan. Multiple non-redundant spectral clustering views. In Proceedings of the 27th International Conference on Machine Learning, pp. 831–838 (2010)
29.
go back to reference M. Prossegger and A. Bouchachia. Ant colony optimization for steiner tree problems. In Proceedings of the 5th international conference on Soft computing as transdisciplinary science and technology, pp. 331–336. ACM (2008) M. Prossegger and A. Bouchachia. Ant colony optimization for steiner tree problems. In Proceedings of the 5th international conference on Soft computing as transdisciplinary science and technology, pp. 331–336. ACM (2008)
30.
go back to reference T. Runkler and R. Palm. Identification of nonlinear systems using regular fuzzy c-elliptotype clustering. In Proceedings of the Fifth IEEE International Conference on Fuzzy Systems, volume 2, pp. 1026–1030 (1996) T. Runkler and R. Palm. Identification of nonlinear systems using regular fuzzy c-elliptotype clustering. In Proceedings of the Fifth IEEE International Conference on Fuzzy Systems, volume 2, pp. 1026–1030 (1996)
31.
go back to reference J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 22(8), 888–905 (2000)CrossRef J. Shi and J. Malik. Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell., 22(8), 888–905 (2000)CrossRef
32.
go back to reference F. Tung, A. Wong, and D. Clausi. Enabling scalable spectral clustering for image segmentation. Pattern Recogn., 43, 4069–4076 (2010)MATHCrossRef F. Tung, A. Wong, and D. Clausi. Enabling scalable spectral clustering for image segmentation. Pattern Recogn., 43, 4069–4076 (2010)MATHCrossRef
33.
go back to reference C. Valgren, T. Duckett, and L. Lilienthal. Incremental spectral clustering and its application to topological mapping. In Proc. IEEE International Conference on Robotics and Automation, pp. 4283–4288 (2007) C. Valgren, T. Duckett, and L. Lilienthal. Incremental spectral clustering and its application to topological mapping. In Proc. IEEE International Conference on Robotics and Automation, pp. 4283–4288 (2007)
34.
go back to reference C. Valgren and A. Lilienthal. Incremental spectral clustering and seasons: Appearance-based localization in outdoor environments. In Robotics and Automation, 2008. ICRA 2008. IEEE International Conference on, pp. 1856 –1861 (2008) C. Valgren and A. Lilienthal. Incremental spectral clustering and seasons: Appearance-based localization in outdoor environments. In Robotics and Automation, 2008. ICRA 2008. IEEE International Conference on, pp. 1856 –1861 (2008)
35.
go back to reference L. Wang, C. Leckie, R. Kotagiri, and J. Bezdek. Approximate pairwise clustering for large data sets via sampling plus extension. Pattern Recognition, 44, 222–235 (2011)CrossRef L. Wang, C. Leckie, R. Kotagiri, and J. Bezdek. Approximate pairwise clustering for large data sets via sampling plus extension. Pattern Recognition, 44, 222–235 (2011)CrossRef
36.
go back to reference D. Yan, L. Huang, and M. Jordan. Fast approximate spectral clustering. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 907–916. ACM (2009) D. Yan, L. Huang, and M. Jordan. Fast approximate spectral clustering. In Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, pp. 907–916. ACM (2009)
Metadata
Title
Incremental Spectral Clustering
Authors
Abdelhamid Bouchachia
Markus Prossegger
Copyright Year
2012
Publisher
Springer New York
DOI
https://doi.org/10.1007/978-1-4419-8020-5_4

Premium Partner