Skip to main content

2018 | OriginalPaper | Buchkapitel

Deep Learning Architecture for High-Level Feature Generation Using Stacked Auto Encoder for Business Intelligence

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the era of modern world, faster development and wider use of digital technology generates large amount of data in digital space. Handling such large amount of data by conventional machine learning algorithms is difficult because of heterogeneous nature and large size of data. Deep learning strategy, is an advancement in machine learning research to deal with such heterogeneous nature and large size of data and extract high-level representations of data through a hierarchical learning process. This paper proposes novel multi-layer feature selection with conjunction of Stacked Auto-Encoder (SAE) to extract high level features or representations and eliminate the lower level features or representations from data. The proposed approach is validated on the Farm Ads dataset and the result is compared with various conventional machine learning algorithms. The proposed approach has outperformed as compared to conventional machine learning algorithms for the given dataset.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
3.
Zurück zum Zitat Domingos, P.: A few useful things to know about machine learning. Commun. ACM 55(10) (2012) Domingos, P.: A few useful things to know about machine learning. Commun. ACM 55(10) (2012)
4.
Zurück zum Zitat Breiman, L.: Statistical modeling: The two cultures (with comments and a rejoinder by the author). Stat. Sci. 16(3), 199–231 (2001)CrossRefMATH Breiman, L.: Statistical modeling: The two cultures (with comments and a rejoinder by the author). Stat. Sci. 16(3), 199–231 (2001)CrossRefMATH
5.
Zurück zum Zitat Apte, C.: The role of machine learning in business optimization. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 1–2 (2010) Apte, C.: The role of machine learning in business optimization. In: Proceedings of the 27th International Conference on Machine Learning (ICML-10), pp. 1–2 (2010)
6.
Zurück zum Zitat Faris, H., et al.: A genetic programming based framework for churn prediction in telecommunication industry. In: International Conference on Computational Collective Intelligence September 24, pp. 353–362. Springer (2014) Faris, H., et al.: A genetic programming based framework for churn prediction in telecommunication industry. In: International Conference on Computational Collective Intelligence September 24, pp. 353–362. Springer (2014)
7.
Zurück zum Zitat Dean, F., Silvia, F.: Random survival forests models for SME credit risk measurement. Methodol. Comput. Appl. Probab. 11(1), 29–45 (2009)MathSciNetCrossRefMATH Dean, F., Silvia, F.: Random survival forests models for SME credit risk measurement. Methodol. Comput. Appl. Probab. 11(1), 29–45 (2009)MathSciNetCrossRefMATH
8.
Zurück zum Zitat Jian, S., et al.: Credit scoring by feature-weighted support vector machines. J. Zhejiang Univ. Sci. C 14(3), 197–204 (2013)CrossRef Jian, S., et al.: Credit scoring by feature-weighted support vector machines. J. Zhejiang Univ. Sci. C 14(3), 197–204 (2013)CrossRef
9.
Zurück zum Zitat Peng, H., et al.: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27(8), 1226–1238 (2005)MathSciNetCrossRef Peng, H., et al.: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Trans. Pattern Anal. Mach. Intell. 27(8), 1226–1238 (2005)MathSciNetCrossRef
10.
Zurück zum Zitat Taffler, R.J., et al.: Forecasting company failure in the UK using discriminant analysis and financial ratio data. J. R. Stat. Soc. Ser. A (General) 342–358 (1982) Taffler, R.J., et al.: Forecasting company failure in the UK using discriminant analysis and financial ratio data. J. R. Stat. Soc. Ser. A (General) 342–358 (1982)
11.
Zurück zum Zitat Bengio, Y., et al.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013)CrossRef Bengio, Y., et al.: Representation learning: a review and new perspectives. IEEE Trans. Pattern Anal. Mach. Intell. 35(8), 1798–1828 (2013)CrossRef
12.
Zurück zum Zitat Bengio, Y.: Learning Deep Architectures for AI. Now Publishers Inc., Hanover, MA, USA (2009)MATH Bengio, Y.: Learning Deep Architectures for AI. Now Publishers Inc., Hanover, MA, USA (2009)MATH
13.
Zurück zum Zitat Bengio, Y.: Deep learning of representations: looking forward. In: Proceedings of the 1st International Conference on Statistical Language and Speech Processing. SLSP’13, pp. 1–37. Springer, Tarragona, Spain (2013) Bengio, Y.: Deep learning of representations: looking forward. In: Proceedings of the 1st International Conference on Statistical Language and Speech Processing. SLSP’13, pp. 1–37. Springer, Tarragona, Spain (2013)
15.
Zurück zum Zitat Safavian, S.R., Landgrebe, D.: A Survey of Decision Tree Classifier Methodology (1990) Safavian, S.R., Landgrebe, D.: A Survey of Decision Tree Classifier Methodology (1990)
16.
Zurück zum Zitat Corinna, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995) Corinna, C., Vapnik, V.: Support-vector networks. Mach. Learn. 20(3), 273–297 (1995)
17.
Zurück zum Zitat Sevakula, R.K., et al.: Fast data sampling for large scale support vector machines. In: IEEE Workshop on Computational Intelligence: Theories, Applications and Future Directions (IEEE WCI 2015), India (2015) Sevakula, R.K., et al.: Fast data sampling for large scale support vector machines. In: IEEE Workshop on Computational Intelligence: Theories, Applications and Future Directions (IEEE WCI 2015), India (2015)
18.
Zurück zum Zitat Sevakula, R.K., et al.: Data preprocessing methods for sparse auto-encoder based fuzzy rule classifier. In: IEEE Workshop on Computational Intelligence: Theories, Applications and Future Directions (IEEE WCI 2015), India (2015) Sevakula, R.K., et al.: Data preprocessing methods for sparse auto-encoder based fuzzy rule classifier. In: IEEE Workshop on Computational Intelligence: Theories, Applications and Future Directions (IEEE WCI 2015), India (2015)
19.
Zurück zum Zitat Ding, X., et al.: Deep learning for event-driven stock prediction. In: Proceedings of the 24th International Joint Conference on Artificial Intelligence (ICJAI 15), pp. 2327–2333 (2015) Ding, X., et al.: Deep learning for event-driven stock prediction. In: Proceedings of the 24th International Joint Conference on Artificial Intelligence (ICJAI 15), pp. 2327–2333 (2015)
22.
Zurück zum Zitat Ng, A.: Sparse autoencoder. In: CS294A Lecture Notes, vol. 72, pp. 1–19 (2011) Ng, A.: Sparse autoencoder. In: CS294A Lecture Notes, vol. 72, pp. 1–19 (2011)
23.
Zurück zum Zitat Bengio, Y., et al.: Greedy layer-wise training of deep networks. Adv. Neural. Inf. Process. Syst. 19, 153 (2007) Bengio, Y., et al.: Greedy layer-wise training of deep networks. Adv. Neural. Inf. Process. Syst. 19, 153 (2007)
24.
Zurück zum Zitat Poultney, C., et al.: Efficient learning of sparse representations with an energy-based model. In: Advances in Neural Information Processing Systems, pp. 1137–1144 (2006) Poultney, C., et al.: Efficient learning of sparse representations with an energy-based model. In: Advances in Neural Information Processing Systems, pp. 1137–1144 (2006)
25.
Zurück zum Zitat Thirukovalluru, R., et al.: Generating feature sets for fault diagnosis using denoising stacked auto-encoder. In: 2016 IEEE International Conference on Prognostics and Health Management (ICPHM), pp. 1–7. IEEE (2016) Thirukovalluru, R., et al.: Generating feature sets for fault diagnosis using denoising stacked auto-encoder. In: 2016 IEEE International Conference on Prognostics and Health Management (ICPHM), pp. 1–7. IEEE (2016)
26.
Zurück zum Zitat Jolliffe, I.: Principal Component Analysis. Wiley (2002) Jolliffe, I.: Principal Component Analysis. Wiley (2002)
27.
Zurück zum Zitat Chih-Chung, C., Lin, C.-J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. (TIST) 2(3), 27 (2011) Chih-Chung, C., Lin, C.-J.: LIBSVM: a library for support vector machines. ACM Trans. Intell. Syst. Technol. (TIST) 2(3), 27 (2011)
28.
29.
Zurück zum Zitat Yu, L., Liu, H.: Feature selection for high-dimensional data: a fast correlation-based filter solution. In: ICML, vol. 3, pp. 856–863 (2003) Yu, L., Liu, H.: Feature selection for high-dimensional data: a fast correlation-based filter solution. In: ICML, vol. 3, pp. 856–863 (2003)
30.
Zurück zum Zitat Teng, C.M.: Combining noise correction with feature selection. In: International Conference on Data Warehousing and Knowledge Discovery, pp. 340–349. Springer (2003) Teng, C.M.: Combining noise correction with feature selection. In: International Conference on Data Warehousing and Knowledge Discovery, pp. 340–349. Springer (2003)
31.
Zurück zum Zitat Ng, A., et al.: UFLDL Tutorial (2016) Ng, A., et al.: UFLDL Tutorial (2016)
32.
Zurück zum Zitat Izenman, A.J.: Linear discriminant analysis. Modern Multivariate Statistical Techniques, pp. 237–280. Springer, New York (2013)CrossRef Izenman, A.J.: Linear discriminant analysis. Modern Multivariate Statistical Techniques, pp. 237–280. Springer, New York (2013)CrossRef
Metadaten
Titel
Deep Learning Architecture for High-Level Feature Generation Using Stacked Auto Encoder for Business Intelligence
verfasst von
Vikas Singh
Nishchal K. Verma
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-69989-9_16