Skip to main content
Top

2019 | OriginalPaper | Chapter

Customer Value Prediction in Direct Marketing Using Hybrid Support Vector Machine Rule Extraction Method

Authors : Suncica Rogic, Ljiljana Kascelan

Published in: New Trends in Databases and Information Systems

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Data mining techniques can aid companies in evaluation of customers that generate highest amount of revenue in a direct marketing campaign. Most commonly, customer value is evaluated by a uniform segmentation of customers (20% for each segment) based on buying behavior using recency, frequency and monetary (RFM) attributes, whereby for direct campaigns the segments with the highest score of these attributes are subjectively selected. In this paper, the method of k-means clustering, according to RFM attributes is proposed, based on which the customer value can be more objectively determined. The most valuable customers, as a rule, are the smallest group compared to other clusters, so the problem of class imbalance occurs. In order to overcome this problem, a hybrid Support Vector Machine Rule Extraction (SVM-RE) method is proposed for predicting which customer belongs to a cluster, based on data on consumer characteristics and offered products. The SVM classifier is known as a good predictor in case of class imbalance, but does not generate an interpretable model. Therefore, the Decision Tree (DT) method generates rules, based on the prediction result of the SVM classifier. The results of the empirical case study showed, that using this hybrid method with good classification performance, customer value level can be predicted, i.e. targeting existing and new buyers for direct marketing campaigns can be efficiently done, regardless of the class imbalance problem. It’s also shown that using the hybrid SVM-RE method, it is possible to obtain significantly better prediction accuracy than using the DT method.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Jonker, J., Piersma, N., Van den Poel, D.: Joint optimization of customer segmentation and marketing policy to maximize long-term profitability. Expert Syst. Appl. 27, 159–168 (2004)CrossRef Jonker, J., Piersma, N., Van den Poel, D.: Joint optimization of customer segmentation and marketing policy to maximize long-term profitability. Expert Syst. Appl. 27, 159–168 (2004)CrossRef
2.
go back to reference Kaymak, U.: Fuzzy target selection using RFM variables. In: Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569) Kaymak, U.: Fuzzy target selection using RFM variables. In: Proceedings Joint 9th IFSA World Congress and 20th NAFIPS International Conference (Cat. No. 01TH8569)
3.
go back to reference Hughes, A.: Strategic Database Marketing. McGraw-Hill, New York (2005) Hughes, A.: Strategic Database Marketing. McGraw-Hill, New York (2005)
4.
go back to reference McCarty, J., Hastak, M.: Segmentation approaches in data-mining: a comparison of RFM, CHAID, and logistic regression. J. Bus. Res. 60, 656–662 (2007)CrossRef McCarty, J., Hastak, M.: Segmentation approaches in data-mining: a comparison of RFM, CHAID, and logistic regression. J. Bus. Res. 60, 656–662 (2007)CrossRef
5.
go back to reference Olson, D., Cao, Q., Gu, C., Lee, D.: Comparison of customer response models. Serv. Bus. 3, 117–130 (2009)CrossRef Olson, D., Cao, Q., Gu, C., Lee, D.: Comparison of customer response models. Serv. Bus. 3, 117–130 (2009)CrossRef
6.
go back to reference Olson, D., Chae, B.: Direct marketing decision support through predictive customer response modeling. Decis. Support Syst. 54, 443–451 (2012)CrossRef Olson, D., Chae, B.: Direct marketing decision support through predictive customer response modeling. Decis. Support Syst. 54, 443–451 (2012)CrossRef
7.
go back to reference Cui, G., Wong, M., Wan, X.: Targeting high value customers while under resource constraint: partial order constrained optimization with genetic algorithm. J. Interact. Market. 29, 27–37 (2015)CrossRef Cui, G., Wong, M., Wan, X.: Targeting high value customers while under resource constraint: partial order constrained optimization with genetic algorithm. J. Interact. Market. 29, 27–37 (2015)CrossRef
8.
go back to reference Kim, D., Lee, H., Cho, S.: Response modeling with support vector regression. Expert Syst. Appl. 34, 1102–1108 (2008)CrossRef Kim, D., Lee, H., Cho, S.: Response modeling with support vector regression. Expert Syst. Appl. 34, 1102–1108 (2008)CrossRef
9.
go back to reference Otter, P.W., Scheer, H.V.D., Wansbeek, T.: Optimal selection of households for direct marketing by joint modeling of the probability and quantity of response. s.n. University of Groningen, CCSO Centre for Economic Research, Working Papers (2006) Otter, P.W., Scheer, H.V.D., Wansbeek, T.: Optimal selection of households for direct marketing by joint modeling of the probability and quantity of response. s.n. University of Groningen, CCSO Centre for Economic Research, Working Papers (2006)
10.
go back to reference Malthouse, E.: Ridge regression and direct marketing scoring models. J. Interact. Market. 13, 10–23 (1999)CrossRef Malthouse, E.: Ridge regression and direct marketing scoring models. J. Interact. Market. 13, 10–23 (1999)CrossRef
11.
go back to reference Wu, J., Lin, Z.: Research on customer segmentation model by clustering. In: Proceedings of the 7th International Conference on Electronic Commerce - ICEC 2005 (2005) Wu, J., Lin, Z.: Research on customer segmentation model by clustering. In: Proceedings of the 7th International Conference on Electronic Commerce - ICEC 2005 (2005)
12.
go back to reference Drozdenki, R., Drake, P.: Optimal Database Marketing. Sage Publications, Thousand Oaks (2002) Drozdenki, R., Drake, P.: Optimal Database Marketing. Sage Publications, Thousand Oaks (2002)
13.
go back to reference Hosseini, S., Maleki, A., Gholamian, M.: Cluster analysis using data mining approach to develop CRM methodology to assess the customer loyalty. Expert Syst. Appl. 37, 5259–5264 (2010)CrossRef Hosseini, S., Maleki, A., Gholamian, M.: Cluster analysis using data mining approach to develop CRM methodology to assess the customer loyalty. Expert Syst. Appl. 37, 5259–5264 (2010)CrossRef
14.
go back to reference Sarvari, P., Ustundag, A., Takci, H.: Performance evaluation of different customer segmentation approaches based on RFM and demographics analysis. Kybernetes 45, 1129–1157 (2016)CrossRef Sarvari, P., Ustundag, A., Takci, H.: Performance evaluation of different customer segmentation approaches based on RFM and demographics analysis. Kybernetes 45, 1129–1157 (2016)CrossRef
15.
go back to reference Khalili-Damghani, K., Abdi, F., Abolmakarem, S.: Hybrid soft computing approach based on clustering, rule mining, and decision tree analysis for customer segmentation problem: real case of customer-centric industries. Appl. Soft Comput. 73, 816–828 (2018)CrossRef Khalili-Damghani, K., Abdi, F., Abolmakarem, S.: Hybrid soft computing approach based on clustering, rule mining, and decision tree analysis for customer segmentation problem: real case of customer-centric industries. Appl. Soft Comput. 73, 816–828 (2018)CrossRef
16.
go back to reference Kim, G., Chae, B., Olson, D.: A support vector machine (SVM) approach to imbalanced datasets of customer responses: comparison with other customer response models. Serv. Bus. 7, 167–182 (2012)CrossRef Kim, G., Chae, B., Olson, D.: A support vector machine (SVM) approach to imbalanced datasets of customer responses: comparison with other customer response models. Serv. Bus. 7, 167–182 (2012)CrossRef
17.
go back to reference Miguéis, V.L., Camanho, A.S., Borges, J.: Predicting direct marketing response in banking: comparison of class imbalance methods. Serv. Bus. 11, 831–849 (2017)CrossRef Miguéis, V.L., Camanho, A.S., Borges, J.: Predicting direct marketing response in banking: comparison of class imbalance methods. Serv. Bus. 11, 831–849 (2017)CrossRef
18.
go back to reference Farquad, M., Bose, I.: Preprocessing unbalanced data using support vector machine. Decis. Support Syst. 53, 226–233 (2012)CrossRef Farquad, M., Bose, I.: Preprocessing unbalanced data using support vector machine. Decis. Support Syst. 53, 226–233 (2012)CrossRef
19.
go back to reference Barakat, N., Bradley, A.P.: Rule extraction from support vector machines: a review. Neurocomputing. 74, 178–190 (2010)CrossRef Barakat, N., Bradley, A.P.: Rule extraction from support vector machines: a review. Neurocomputing. 74, 178–190 (2010)CrossRef
20.
go back to reference Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, New York (2010)MATH Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, New York (2010)MATH
21.
go back to reference Sanderson, M., Manning, C.D., Raghavan, P., Schütze, H.: Introduction to Information Retrieval. Cambridge University Press, Cambridge (2008). Nat. Lang. Eng. 16(1), 100–103 (2010) Sanderson, M., Manning, C.D., Raghavan, P., Schütze, H.: Introduction to Information Retrieval. Cambridge University Press, Cambridge (2008). Nat. Lang. Eng. 16(1), 100–103 (2010)
22.
go back to reference Martens, D., Huysmans, J., Setiono, R., Vanthienen, J., Baesens, B.: Rule extraction from support vector machines: an overview of issues and application in credit scoring. In: Diederich, J. (ed.) Rule Extraction from Support Vector Machines. Studies in Computational Intelligence, vol. 80, pp. 33–63. Springer, Heidelberg (2008). https://doi.org/10.1007/978-3-540-75390-2_2MATHCrossRef Martens, D., Huysmans, J., Setiono, R., Vanthienen, J., Baesens, B.: Rule extraction from support vector machines: an overview of issues and application in credit scoring. In: Diederich, J. (ed.) Rule Extraction from Support Vector Machines. Studies in Computational Intelligence, vol. 80, pp. 33–63. Springer, Heidelberg (2008). https://​doi.​org/​10.​1007/​978-3-540-75390-2_​2MATHCrossRef
24.
go back to reference Martens, D., Baesens, B., Gestel, T.V., Vanthienen, J.: Comprehensible credit scoring models using rule extraction from support vector machines. Eur. J. Oper. Res. 183, 1466–1476 (2007) Martens, D., Baesens, B., Gestel, T.V., Vanthienen, J.: Comprehensible credit scoring models using rule extraction from support vector machines. Eur. J. Oper. Res. 183, 1466–1476 (2007)
25.
go back to reference Quinlan, J.R.: Induction of decision trees. Mach. Learn. 1, 81–106 (1986) Quinlan, J.R.: Induction of decision trees. Mach. Learn. 1, 81–106 (1986)
26.
go back to reference Quinlan, J.R.: C4.5 - Programs for Machine Learning. Kaufmann, San Mateo (1992) Quinlan, J.R.: C4.5 - Programs for Machine Learning. Kaufmann, San Mateo (1992)
27.
go back to reference Breiman, L.: Classification and Regression Trees. Wadsworth International Group, Belmont (1984)MATH Breiman, L.: Classification and Regression Trees. Wadsworth International Group, Belmont (1984)MATH
28.
go back to reference Kašćelan, L., Kašćelan, V., Jovanović, M.: Hybrid support vector machine rule extraction method for discovering the preferences of stock market investors: evidence from Montenegro. Intell. Autom. Soft Comput. 21, 503–522 (2014)CrossRef Kašćelan, L., Kašćelan, V., Jovanović, M.: Hybrid support vector machine rule extraction method for discovering the preferences of stock market investors: evidence from Montenegro. Intell. Autom. Soft Comput. 21, 503–522 (2014)CrossRef
29.
go back to reference Hughes, A.M.: Strategic Database Marketing: The Masterplan for Starting and Managing a Profitable, Customer-Based Marketing Program. Irwin, Chicago (1994) Hughes, A.M.: Strategic Database Marketing: The Masterplan for Starting and Managing a Profitable, Customer-Based Marketing Program. Irwin, Chicago (1994)
30.
go back to reference Wang, C.-H.: Apply robust segmentation to the service industry using kernel induced fuzzy clustering techniques. Expert Syst. Appl. 37, 8395–8400 (2010)CrossRef Wang, C.-H.: Apply robust segmentation to the service industry using kernel induced fuzzy clustering techniques. Expert Syst. Appl. 37, 8395–8400 (2010)CrossRef
32.
go back to reference Hsieh, N.-C.: An integrated data mining and behavioral scoring model for analyzing bank customers. Expert Syst. Appl. 27, 623–633 (2004)CrossRef Hsieh, N.-C.: An integrated data mining and behavioral scoring model for analyzing bank customers. Expert Syst. Appl. 27, 623–633 (2004)CrossRef
33.
go back to reference Tsai, C.-Y., Chiu, C.-C.: A purchase-based market segmentation methodology. Expert Syst. Appl. 27, 265–276 (2004)CrossRef Tsai, C.-Y., Chiu, C.-C.: A purchase-based market segmentation methodology. Expert Syst. Appl. 27, 265–276 (2004)CrossRef
34.
go back to reference Cheng, C.-H., Chen, Y.-S.: Classifying the segmentation of customer value via RFM model and RS theory. Expert Syst. Appl. 36, 4176–4184 (2009)CrossRef Cheng, C.-H., Chen, Y.-S.: Classifying the segmentation of customer value via RFM model and RS theory. Expert Syst. Appl. 36, 4176–4184 (2009)CrossRef
35.
go back to reference MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Conference on Mathematical Statistics and Probability, vol. 1, pp. 281–297 (1967) MacQueen, J.: Some methods for classification and analysis of multivariate observations. In: Proceedings of the Fifth Conference on Mathematical Statistics and Probability, vol. 1, pp. 281–297 (1967)
36.
go back to reference Davies, D.L., Bouldin, D.W.: A cluster separation measure. IEEE Trans. Pattern Anal. Mach. Intell. PAMI 1, 224–227 (1979)CrossRef Davies, D.L., Bouldin, D.W.: A cluster separation measure. IEEE Trans. Pattern Anal. Mach. Intell. PAMI 1, 224–227 (1979)CrossRef
Metadata
Title
Customer Value Prediction in Direct Marketing Using Hybrid Support Vector Machine Rule Extraction Method
Authors
Suncica Rogic
Ljiljana Kascelan
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-30278-8_30

Premium Partner