Top

Published in:

2018 | OriginalPaper | Chapter

On the Interaction Between Feature Selection and Parameter Determination in Fuzzy Modelling

Authors : Peipei Chen, Caro Fuchs, Anna Wilbik, Tak-Ming Chan, Saskia van Loon, Arjen-Kars Boer, Xudong Lu, Volkher Scharnhorst, Uzay Kaymak

Published in: Information Processing and Management of Uncertainty in Knowledge-Based Systems. Applications

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Nowadays the amount of data that is collected in various settings is growing rapidly. These elaborate data records enable the training of machine learning models that can be used to extract insights and for making better informed decisions. When doing the data mining task, on one hand, feature selection is often used to reduce the dimensionality of the data. On the other hand, we need to decide the structure (parameters) of the model when building the model. However, feature selection and the parameters of the model may interact and affect the performance of the model. Therefore, it is difficult to decide the optimal parameter and the optimal feature subset without an exhaustive search of all the combination of the parameters and the feature subsets which is time-consuming. In this paper, we study how the interaction between feature selection and the parameters of a model affect the performance of the model through experiments on four data sets.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter The Use of Fuzzy Linguistic Information and Fuzzy Delphi Method to Validate by Consensus a Questionnaire in a Blended-Learning Environment

next chapter Fuzzy Association Rules on Data with Undefined Values

Bezdek, J.C.: Models for pattern recognition. In: Pattern Recognition with Fuzzy Objective Function Algorithms. Advanced Applications in Pattern Recognition, pp. 1–13. Springer, Boston (1981). https://doi.org/10.1007/978-1-4757-0450-1_1CrossRef

Bolón-Canedo, V., Sánchez-Maroño, N., Alonso-Betanzos, A.: A review of feature selection methods on synthetic data. Knowl. Inf. Syst. 34(3), 483–519 (2013)CrossRef

Bose, I., Mahapatra, R.K.: Business data mining a machine learning perspective. Inf. Manag. 39(3), 211–225 (2001)CrossRef

Chen, P., Wilbik, A., van Loon, S., Boer, A.-K., Kaymak, U.: Finding the optimal number of features based on mutual information. In: Kacprzyk, J., Szmidt, E., Zadrożny, S., Atanassov, K.T., Krawczak, M. (eds.) IWIFSGN/EUSFLAT -2017. AISC, vol. 641, pp. 477–486. Springer, Cham (2018). https://doi.org/10.1007/978-3-319-66830-7_43CrossRef

Chiu, S.L.: Fuzzy model identification based on cluster estimation. J. Intell. Fuzzy Syst. 2(3), 267–278 (1994)

Cisco Visual Networking Index: The Zettabyte Era-trends and Analysis (2013). https://www.cisco.com/c/en/us/solutions/collateral/service-provider/visual-networking-index-vni/vni-hyperconnectivity-wp.pdf

Claesen, M., Simm, J., Popovic, D., Moreau, Y., De Moor, B.: Easy hyperparameter search using optunity. arXiv preprint arXiv:1412.1114 (2014)

Guyon, I., Elisseeff, A.: An introduction to variable and feature selection. J. Mach. Learn. Res. 3(Mar), 1157–1182 (2003)MATH

Guyon, I., Weston, J., Barnhill, S., Vapnik, V.: Gene selection for cancer classification using support vector machines. Mach. Learn. 46(1), 389–422 (2002)CrossRef

10.

Jang, J.S.R., Sun, C.T., Mizutani, E.: Neuro-fuzzy and Soft Computing, a Computational Approach to Learning and Machine Intelligence. Prentice-Hall Inc., Upper Saddle River (1997)

11.

Kawala, F., Douzal-Chouakria, A., Gaussier, E., Dimert, E.: Prédictions d’activité dans les réseaux sociaux en ligne. In: 4ième Conférence sur les Modèles et l’Analyse des Réseaux: Approches Mathématiques et Informatiques, p. 16 (2013)

12.

Keogh, E., Mueen, A.: Curse of dimensionality. In: Liu L., Özsu, M.T. (eds.) Encyclopedia of Machine Learning, pp. 257–258. Springer, Boston (2011). https://doi.org/10.1007/978-0-387-39940-9

13.

Kohavi, R., John, G.H.: Wrappers for feature subset selection. Artif. Intell. 97(1–2), 273–324 (1997)CrossRef

14.

Lichman, M.: UCI Machine Learning Repository (2013). http://archive.ics.uci.edu/ml

15.

Liu, H., Motoda, H.: Feature Extraction, Construction and Selection: A Data Mining Perspective, vol. 453. Springer, New York (1998). https://doi.org/10.1007/978-1-4615-5725-8CrossRefMATH

16.

Lloyd, S.: Least squares quantization in PCM. IEEE Trans. Inf. Theor. 28(2), 129–137 (1982)MathSciNetCrossRef

17.

Mejía-Lavalle, M., Sucar, E., Arroyo, G.: Feature selection with a perceptron neural net. In: Proceedings of the International Workshop on Feature Selection for Data Mining, pp. 131–135 (2006)

18.

Pehro, D., Stork, D.: Pattern Classification. Wiley, New York (2001)

19.

Takagi, T., Sugeno, M.: Fuzzy identification of systems and its applications to modeling and control. IEEE Trans. Syst. Man Cybern. 1, 116–132 (1985)CrossRef

20.

Vergara, J.R., Estévez, P.A.: A review of feature selection methods based on mutual information. Neural Comput. Appl. 24(1), 175–186 (2014)CrossRef

21.

Young, S.R., Rose, D.C., Karnowski, T.P., Lim, S.H., Patton, R.M.: Optimizing deep learning hyper-parameters through an evolutionary algorithm. In: Proceedings of the Workshop on Machine Learning in High-Performance Computing Environments, p. 4. ACM (2015)

Title: On the Interaction Between Feature Selection and Parameter Determination in Fuzzy Modelling
Authors: Peipei Chen
Caro Fuchs
Anna Wilbik
Tak-Ming Chan
Saskia van Loon
Arjen-Kars Boer
Xudong Lu
Volkher Scharnhorst
Uzay Kaymak
Publisher: Springer International Publishing
Book: Information Processing and Management of Uncertainty in Knowledge-Based Systems. Applications
Print ISBN: 978-3-319-91478-7

Electronic ISBN: 978-3-319-91479-4

Copyright Year: 2018
DOI: https://doi.org/10.1007/978-3-319-91479-4_13

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner