Skip to main content
Top
Published in: Soft Computing 14/2018

01-07-2018 | Methodologies and Application

Fuzzy weighted c-harmonic regressions clustering algorithm

Authors: Yang Zhao, Pei-hong Wang, Yi-guo Li, Meng-yang Li

Published in: Soft Computing | Issue 14/2018

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

As a well-known regression clustering algorithm, fuzzy c-regressions (FCR) has been widely studied and applied in various areas. However, FCR appears to be rather sensitive to the undesirable initialization and the presence of noise or outliers in data sets. As a modified alternative, possibilistic c-regressions (PCR) can ameliorate the problem of noise and outliers, but it depends more heavily on initial values. Besides, the number of models should be determined a priori in both algorithms. To overcome these issues, this paper proposes a generalized alternative, called fuzzy weighted c-harmonic regressions (FWCHR), in which, a dynamic-like weight term based on the distinguished feature of the harmonic average is first introduced to enhance robustness. Furthermore, FWCHR can encompass FCR and PCR if some conditions are satisfied. And then a generalized mountain method (GMM) is proposed to automatically determine the number of models and estimate the initial values, which makes the proposed FWCHR algorithm totally unsupervised. Some numerical simulations and real applications are conducted to validate the performance of our algorithms.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literature
go back to reference Arminger G, Stein P, Wittenberg J (1999) Mixtures of conditional mean-and covariance-structure models. Psychometrika 64(4):475–494CrossRefMATH Arminger G, Stein P, Wittenberg J (1999) Mixtures of conditional mean-and covariance-structure models. Psychometrika 64(4):475–494CrossRefMATH
go back to reference Barni M, Cappellini V, Mecocci A (1996) Comments on “a possibilistic approach to clustering”. IEEE Trans Fuzzy Syst 4(3):393–396CrossRef Barni M, Cappellini V, Mecocci A (1996) Comments on “a possibilistic approach to clustering”. IEEE Trans Fuzzy Syst 4(3):393–396CrossRef
go back to reference Bezdek JC, Ehrlich R, Full W (1984) FCM: the fuzzy c-means clustering algorithm. Comput Geosci 10(2):191–203CrossRef Bezdek JC, Ehrlich R, Full W (1984) FCM: the fuzzy c-means clustering algorithm. Comput Geosci 10(2):191–203CrossRef
go back to reference Biernacki C, Celeux G, Govaert G (2003) Choosing starting values for the em algorithm for getting the highest likelihood in multivariate gaussian mixture models. Comput Stat Data Anal 41(3):561–575MathSciNetCrossRefMATH Biernacki C, Celeux G, Govaert G (2003) Choosing starting values for the em algorithm for getting the highest likelihood in multivariate gaussian mixture models. Comput Stat Data Anal 41(3):561–575MathSciNetCrossRefMATH
go back to reference Böhning D (2000) Computer-assisted analysis of mixtures and applications. Technometrics 42(4):442–442CrossRefMATH Böhning D (2000) Computer-assisted analysis of mixtures and applications. Technometrics 42(4):442–442CrossRefMATH
go back to reference Brinkman ND (1981) Ethanol fuel—a single-cylinder engine study of efficiency and exhaust emissions. Technical report, SAE Technical Paper Brinkman ND (1981) Ethanol fuel—a single-cylinder engine study of efficiency and exhaust emissions. Technical report, SAE Technical Paper
go back to reference Campbell N, Mahon R (1974) A multivariate study of variation in two species of rock crab of the genus Leptograpsus. Aust J Zool 22(3):417–425CrossRef Campbell N, Mahon R (1974) A multivariate study of variation in two species of rock crab of the genus Leptograpsus. Aust J Zool 22(3):417–425CrossRef
go back to reference Chang S-T, Lu K-P, Yang M-S (2015) Fuzzy change-point algorithms for regression models. IEEE Trans Fuzzy Syst 23(6):2343–2357CrossRef Chang S-T, Lu K-P, Yang M-S (2015) Fuzzy change-point algorithms for regression models. IEEE Trans Fuzzy Syst 23(6):2343–2357CrossRef
go back to reference Chang S-T, Lu K-P, Yang M-S (2016) Stepwise possibilistic c-regressions. Inf Sci 334:307–322CrossRef Chang S-T, Lu K-P, Yang M-S (2016) Stepwise possibilistic c-regressions. Inf Sci 334:307–322CrossRef
go back to reference Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2(3):267–278 Chiu SL (1994) Fuzzy model identification based on cluster estimation. J Intell Fuzzy Syst 2(3):267–278
go back to reference Chuang C-C, Hsiao C-C, Jeng J-T (2003) Adaptive fuzzy regression clustering algorithm for TSK fuzzy modeling. In: 2003 IEEE international symposium on computational intelligence in robotics and automation, 2003, vol 1. Proceedings. IEEE Chuang C-C, Hsiao C-C, Jeng J-T (2003) Adaptive fuzzy regression clustering algorithm for TSK fuzzy modeling. In: 2003 IEEE international symposium on computational intelligence in robotics and automation, 2003, vol 1. Proceedings. IEEE
go back to reference Cohen EA (1984) Some effects of inharmonic partials on interval perception. Music Percept Interdiscip J 1(3):323–349CrossRef Cohen EA (1984) Some effects of inharmonic partials on interval perception. Music Percept Interdiscip J 1(3):323–349CrossRef
go back to reference Frühwirth-Schnatter S (2001) Markov chain monte carlo estimation of classical and dynamic switching and mixture models. J Am Stat Assoc 96(453):194–209MathSciNetCrossRefMATH Frühwirth-Schnatter S (2001) Markov chain monte carlo estimation of classical and dynamic switching and mixture models. J Am Stat Assoc 96(453):194–209MathSciNetCrossRefMATH
go back to reference Frühwirth-Schnatter S (2006) Finite mixture and Markov switching models. Springer, BerlinMATH Frühwirth-Schnatter S (2006) Finite mixture and Markov switching models. Springer, BerlinMATH
go back to reference Hathaway RJ, Bezdek JC (1993) Switching regression models and fuzzy clustering. IEEE Trans Fuzzy Syst 1(3):195–204CrossRef Hathaway RJ, Bezdek JC (1993) Switching regression models and fuzzy clustering. IEEE Trans Fuzzy Syst 1(3):195–204CrossRef
go back to reference Jiang W, Tanner MA (1999) Hierarchical mixtures-of-experts for exponential family regression models: approximation and maximum likelihood estimation. Ann Stat 27:987–1011MathSciNetCrossRefMATH Jiang W, Tanner MA (1999) Hierarchical mixtures-of-experts for exponential family regression models: approximation and maximum likelihood estimation. Ann Stat 27:987–1011MathSciNetCrossRefMATH
go back to reference Kim J, Krishnapuram R, Dave R (1995) On robustifying the c-means algorithms. In: Proceedings of ISUMA-NAFIPS’95 of third international symposium on uncertainty modeling and analysis, 1995, and annual conference of the North American fuzzy information processing society. IEEE Kim J, Krishnapuram R, Dave R (1995) On robustifying the c-means algorithms. In: Proceedings of ISUMA-NAFIPS’95 of third international symposium on uncertainty modeling and analysis, 1995, and annual conference of the North American fuzzy information processing society. IEEE
go back to reference Krishnapuram R, Keller JM (1993) A possibilistic approach to clustering. IEEE Trans Fuzzy Syst 1(2):98–110CrossRef Krishnapuram R, Keller JM (1993) A possibilistic approach to clustering. IEEE Trans Fuzzy Syst 1(2):98–110CrossRef
go back to reference Kung C-C, Chang S-C, Chen T-H (2012) The fuzzy c-regression model for lithium battery. In: 2012 IEEE international conference on systems, man, and cybernetics (SMC). IEEE Kung C-C, Chang S-C, Chen T-H (2012) The fuzzy c-regression model for lithium battery. In: 2012 IEEE international conference on systems, man, and cybernetics (SMC). IEEE
go back to reference Kung C-C, Ku H-C, Su J-Y (2013) Possibilistic c-regression models clustering algorithm. In: 2013 international conference on system science and engineering (ICSSE). IEEE Kung C-C, Ku H-C, Su J-Y (2013) Possibilistic c-regression models clustering algorithm. In: 2013 international conference on system science and engineering (ICSSE). IEEE
go back to reference Leski JM (2004) \(\varepsilon \)-insensitive fuzzy c-regression models: introduction to \(\varepsilon \)-insensitive fuzzy modeling. IEEE Trans Syst Man Cybern Part B (Cybern) 34(1):4–15MathSciNetCrossRef Leski JM (2004) \(\varepsilon \)-insensitive fuzzy c-regression models: introduction to \(\varepsilon \)-insensitive fuzzy modeling. IEEE Trans Syst Man Cybern Part B (Cybern) 34(1):4–15MathSciNetCrossRef
go back to reference Li C, Zhou J, Xiang X, Li Q, An X (2009) T–S fuzzy model identification based on a novel fuzzy c-regression model clustering algorithm. Eng Appl Artif Intell 22(4):646–653CrossRef Li C, Zhou J, Xiang X, Li Q, An X (2009) T–S fuzzy model identification based on a novel fuzzy c-regression model clustering algorithm. Eng Appl Artif Intell 22(4):646–653CrossRef
go back to reference Li C, Zhou J, Li Q, An X, Xiang X (2010) A new T–S fuzzy-modeling approach to identify a boiler–turbine system. Expert Syst Appl 37(3):2214–2221CrossRef Li C, Zhou J, Li Q, An X, Xiang X (2010) A new T–S fuzzy-modeling approach to identify a boiler–turbine system. Expert Syst Appl 37(3):2214–2221CrossRef
go back to reference Ménard M, Dardignac P-A, Courboulay V (2000) Switching regression models using ambiguity and distance rejects: application to ionogram analysis. In: Proceedings of 15th international conference on pattern recognition, 2000, vol 2. IEEE Ménard M, Dardignac P-A, Courboulay V (2000) Switching regression models using ambiguity and distance rejects: application to ionogram analysis. In: Proceedings of 15th international conference on pattern recognition, 2000, vol 2. IEEE
go back to reference Nasraoui O, Krishnapuram R (1995) Crisp interpretations of fuzzy and possibilistic clustering algorithms. In: 3rd European congress on intelligent techniques and soft computing, vol 3. Aachen, pp 1312–1318 Nasraoui O, Krishnapuram R (1995) Crisp interpretations of fuzzy and possibilistic clustering algorithms. In: 3rd European congress on intelligent techniques and soft computing, vol 3. Aachen, pp 1312–1318
go back to reference Papastamoulis P, Martin-Magniette M-L, Maugis-Rabusseau C (2016) On the estimation of mixtures of poisson regression models with large number of components. Comput Stat Data Anal 93:97–106MathSciNetCrossRef Papastamoulis P, Martin-Magniette M-L, Maugis-Rabusseau C (2016) On the estimation of mixtures of poisson regression models with large number of components. Comput Stat Data Anal 93:97–106MathSciNetCrossRef
go back to reference Peters G (2001) A linear forecasting model and its application to economic data. J Forecast 20(5):315–328CrossRef Peters G (2001) A linear forecasting model and its application to economic data. J Forecast 20(5):315–328CrossRef
go back to reference Reddy CK, Chiang H-D, Rajaratnam B (2008) Trust-tech-based expectation maximization for learning finite mixture models. IEEE Trans Pattern Anal Mach Intell 30(7):1146–1157CrossRef Reddy CK, Chiang H-D, Rajaratnam B (2008) Trust-tech-based expectation maximization for learning finite mixture models. IEEE Trans Pattern Anal Mach Intell 30(7):1146–1157CrossRef
go back to reference Skrondal A, Rabe-Hesketh S (2004) Generalized latent variable modeling: multilevel, longitudinal, and structural equation models. CRC Press, Boca RatonCrossRefMATH Skrondal A, Rabe-Hesketh S (2004) Generalized latent variable modeling: multilevel, longitudinal, and structural equation models. CRC Press, Boca RatonCrossRefMATH
go back to reference Soltani M, Chaari A, BenHmida F, Gossa M (2011) A new objective function for fuzzy c-regression model and its application to TS fuzzy model identification. In: 2011 international conference on communications, computing and control applications (CCCA). IEEE Soltani M, Chaari A, BenHmida F, Gossa M (2011) A new objective function for fuzzy c-regression model and its application to TS fuzzy model identification. In: 2011 international conference on communications, computing and control applications (CCCA). IEEE
go back to reference Song W, Yao W, Xing Y (2014) Robust mixture regression model fitting by Laplace distribution. Comput Stat Data Anal 71:128–137MathSciNetCrossRef Song W, Yao W, Xing Y (2014) Robust mixture regression model fitting by Laplace distribution. Comput Stat Data Anal 71:128–137MathSciNetCrossRef
go back to reference Turner TR (2000) Estimating the propagation rate of a viral infection of potato plants via mixtures of regressions. J R Stat Soc Ser C (Appl Stat) 49(3):371–384MathSciNetCrossRefMATH Turner TR (2000) Estimating the propagation rate of a viral infection of potato plants via mixtures of regressions. J R Stat Soc Ser C (Appl Stat) 49(3):371–384MathSciNetCrossRefMATH
go back to reference Wedel M, Kamakura WA (2012) Market segmentation: conceptual and methodological foundations, vol 8. Springer, Berlin Wedel M, Kamakura WA (2012) Market segmentation: conceptual and methodological foundations, vol 8. Springer, Berlin
go back to reference Wu K-L, Yang M-S, Hsieh J-N (2010) Mountain c-regressions method. Pattern Recognit 43(1):86–98CrossRefMATH Wu K-L, Yang M-S, Hsieh J-N (2010) Mountain c-regressions method. Pattern Recognit 43(1):86–98CrossRefMATH
go back to reference Wu X, Wu B, Sun J, Qiu S, Li X (2015) A hybrid fuzzy k-harmonic means clustering algorithm. Appl Math Model 39(12):3398–3409CrossRef Wu X, Wu B, Sun J, Qiu S, Li X (2015) A hybrid fuzzy k-harmonic means clustering algorithm. Appl Math Model 39(12):3398–3409CrossRef
go back to reference Yager RR, Filev DP (1994) Approximate clustering via the mountain method. IEEE Trans Syst Man Cybern 24(8):1279–1284CrossRef Yager RR, Filev DP (1994) Approximate clustering via the mountain method. IEEE Trans Syst Man Cybern 24(8):1279–1284CrossRef
go back to reference Yang M-S, Wu K-L, Hsieh J-N, Yu J (2008) Alpha-cut implemented fuzzy clustering algorithms and switching regressions. IEEE Trans Syst Man Cybern Part B (Cybern) 38(3):588–603CrossRef Yang M-S, Wu K-L, Hsieh J-N, Yu J (2008) Alpha-cut implemented fuzzy clustering algorithms and switching regressions. IEEE Trans Syst Man Cybern Part B (Cybern) 38(3):588–603CrossRef
go back to reference Zhang B, Hsu M, Dayal U (1999) K-harmonic means-a data clustering algorithm. Hewlett-Packard Labs Technical Report HPL-1999-124 Zhang B, Hsu M, Dayal U (1999) K-harmonic means-a data clustering algorithm. Hewlett-Packard Labs Technical Report HPL-1999-124
Metadata
Title
Fuzzy weighted c-harmonic regressions clustering algorithm
Authors
Yang Zhao
Pei-hong Wang
Yi-guo Li
Meng-yang Li
Publication date
01-07-2018
Publisher
Springer Berlin Heidelberg
Published in
Soft Computing / Issue 14/2018
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-017-2642-3

Other articles of this Issue 14/2018

Soft Computing 14/2018 Go to the issue

Premium Partner