Skip to main content
Erschienen in: Automatic Control and Computer Sciences 4/2019

01.07.2019

Using Hybrid Discriminative-Generative Models for Binary Classification

verfasst von: N. Abroyan

Erschienen in: Automatic Control and Computer Sciences | Ausgabe 4/2019

Einloggen, um Zugang zu erhalten

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Discriminative and generative machine learning algorithms have been successfully used in different classification tasks during the last several decades. They both have some advantages and disadvantages and depending on a problem, one type of algorithm performs better than the other one. In this paper we contribute to the research of combination of both approaches and propose literature based a hybrid discriminative-generative generic model. Also, we propose hybrid model structure finding and building a new algorithm. We present theoretical and practical advantages of the hybrid model over its consisting algorithms, efficiency of the model structure finding algorithm, then perform experiments and compare results.
Literatur
1.
Zurück zum Zitat Boneh, D. and Ng, A., CS229: Machine learning course materials, Stanford. http://cs229.stanford.edu/syllabus.html. Accessed September 17, 2018. Boneh, D. and Ng, A., CS229: Machine learning course materials, Stanford. http://​cs229.​stanford.​edu/​syllabus.​html.​ Accessed September 17, 2018.
2.
Zurück zum Zitat Jensen, F. and Nielsen, T., Bayesian Networks and Decision Graphs, New York: Springer, 2007.CrossRefMATH Jensen, F. and Nielsen, T., Bayesian Networks and Decision Graphs, New York: Springer, 2007.CrossRefMATH
3.
Zurück zum Zitat Koller, D. and Friedman, N., Probabilistic Graphical Models, Cambridge, MA: The MIT Press, 2009.MATH Koller, D. and Friedman, N., Probabilistic Graphical Models, Cambridge, MA: The MIT Press, 2009.MATH
4.
Zurück zum Zitat Abroyan, N., Convolutional and recurrent neural networks for real-time data classification, Proceedings of the 7th International Conference on Innovative Computing Technology (INTECH 2017), Luton, UK, 2017. Abroyan, N., Convolutional and recurrent neural networks for real-time data classification, Proceedings of the 7th International Conference on Innovative Computing Technology (INTECH 2017), Luton, UK, 2017.
5.
Zurück zum Zitat Rubinstein, Y.D. and Hastie, T., Discriminative vs informative learning, Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining (KDD-97), 1997. Rubinstein, Y.D. and Hastie, T., Discriminative vs informative learning, Proceedings of the 3rd International Conference on Knowledge Discovery and Data Mining (KDD-97), 1997.
6.
Zurück zum Zitat Jaakkola, T. and Haussler, D., Exploiting generative models in discriminative classifiers, Proceedings of the 1998 Conference on Advances in Neural Information Processing Systems II, 1998, pp. 487–493. Jaakkola, T. and Haussler, D., Exploiting generative models in discriminative classifiers, Proceedings of the 1998 Conference on Advances in Neural Information Processing Systems II, 1998, pp. 487–493.
7.
Zurück zum Zitat Raina, R., Shen, S., Ng, A., and McCallum, A., Classification with hybrid generative/discriminative models, NIPS’03 Proceedings of the 16th International Conference on Neural Information Processing Systems, Cambridge, MA, USA, 2003. Raina, R., Shen, S., Ng, A., and McCallum, A., Classification with hybrid generative/discriminative models, NIPS’03 Proceedings of the 16th International Conference on Neural Information Processing Systems, Cambridge, MA, USA, 2003.
8.
Zurück zum Zitat Kang, C. and Tian, J., A hybrid generative/discriminative Bayesian classifier, Proceedings of the 19th International Florida Artificial Intelligence Research Society Conference (FLAIRS-2006), 2006. Kang, C. and Tian, J., A hybrid generative/discriminative Bayesian classifier, Proceedings of the 19th International Florida Artificial Intelligence Research Society Conference (FLAIRS-2006), 2006.
9.
Zurück zum Zitat Xue, J.-H. and Titterington, M., Joint discriminative-generative modelling based on statistical tests for classification, Pattern Recognit. Lett., 2010, vol. 31, no. 9, pp. 1048–1055.CrossRef Xue, J.-H. and Titterington, M., Joint discriminative-generative modelling based on statistical tests for classification, Pattern Recognit. Lett., 2010, vol. 31, no. 9, pp. 1048–1055.CrossRef
10.
Zurück zum Zitat Fujino, A., Ueda, N., and Saito, K., A hybrid generative/discriminative approach to text classification with additional information, Inf. Process. Manage., 2007, vol. 43, no. 2, pp. 379–392.CrossRef Fujino, A., Ueda, N., and Saito, K., A hybrid generative/discriminative approach to text classification with additional information, Inf. Process. Manage., 2007, vol. 43, no. 2, pp. 379–392.CrossRef
11.
Zurück zum Zitat Bishop, C. and Lasserre, J., Generative or discriminative? Getting the best of both worlds, Bayesian Stat., 2007, vol. 8, pp. 3–24.MathSciNetMATH Bishop, C. and Lasserre, J., Generative or discriminative? Getting the best of both worlds, Bayesian Stat., 2007, vol. 8, pp. 3–24.MathSciNetMATH
12.
Zurück zum Zitat Tan, Y., Shenoy, P., Chan, M., and Romberg, P., On construction of hybrid logistic regression-naive Bayes model for classification, JMLR: Workshop and Conference Proceedings, 2016. Tan, Y., Shenoy, P., Chan, M., and Romberg, P., On construction of hybrid logistic regression-naive Bayes model for classification, JMLR: Workshop and Conference Proceedings, 2016.
13.
Zurück zum Zitat Scutari, M., Learning Bayesian networks with the bnlearn R, J. Stat. Software, 2010, vol. 35, pp. 1–22.CrossRef Scutari, M., Learning Bayesian networks with the bnlearn R, J. Stat. Software, 2010, vol. 35, pp. 1–22.CrossRef
14.
Zurück zum Zitat UCI Machine Learning Repository: Statlog (German Credit Data) Data Set. https://archive.ics.uci.edu/ ml/datasets/Statlog+%28German+Credit+Data%29. Accessed September 17, 2018. UCI Machine Learning Repository: Statlog (German Credit Data) Data Set. https://​archive.​ics.​uci.​edu/​ ml/datasets/Statlog+%28German+Credit+Data%29. Accessed September 17, 2018.
15.
Zurück zum Zitat UCI Machine Learning Repository: Credit Approval Data Set. https://archive.ics.uci.edu/ml/datasets/Credit+ Approval. Accessed September 17, 2018. UCI Machine Learning Repository: Credit Approval Data Set. https://​archive.​ics.​uci.​edu/​ml/​datasets/​Credit+ Approval. Accessed September 17, 2018.
16.
Zurück zum Zitat UCI Machine Learning Repository: Breast Cancer Wisconsin (Original) Data Set. https://archive.ics.uci.edu/ ml/datasets/Breast+Cancer+Wisconsin+(Original). Accessed September 17, 2018. UCI Machine Learning Repository: Breast Cancer Wisconsin (Original) Data Set. https://​archive.​ics.​uci.​edu/​ ml/datasets/Breast+Cancer+Wisconsin+(Original). Accessed September 17, 2018.
17.
Zurück zum Zitat UCI Machine Learning Repository: Thoracic Surgery Data Set. https://archive.ics.uci.edu/ml/datasets/Thoracic+ Surgery+Data. Accessed September 17, 2018. UCI Machine Learning Repository: Thoracic Surgery Data Set. https://​archive.​ics.​uci.​edu/​ml/​datasets/​Thoracic+ Surgery+Data. Accessed September 17, 2018.
18.
Zurück zum Zitat UCI Machine Learning Repository: Phishing Websites Data Set. https://archive.ics.uci.edu/ml/datasets/ Phishing+Websites. Accessed September 17, 2018. UCI Machine Learning Repository: Phishing Websites Data Set. https://​archive.​ics.​uci.​edu/​ml/​datasets/​ Phishing+Websites. Accessed September 17, 2018.
19.
Zurück zum Zitat UCI Machine Learning Repository: Extention of Z-Alizadeh sani dataset Data Set. https://archive.ics.uci.edu/ ml/datasets/extention+of+Z-Alizadeh+sani+dataset. Accessed September 17, 2018. UCI Machine Learning Repository: Extention of Z-Alizadeh sani dataset Data Set. https://​archive.​ics.​uci.​edu/​ ml/datasets/extention+of+Z-Alizadeh+sani+dataset. Accessed September 17, 2018.
20.
Zurück zum Zitat UCI Machine Learning Repository: Adult Data Set. https://archive.ics.uci.edu/ml/datasets/Adult. Accessed September 17, 2018. UCI Machine Learning Repository: Adult Data Set. https://​archive.​ics.​uci.​edu/​ml/​datasets/​Adult.​ Accessed September 17, 2018.
21.
Zurück zum Zitat UCI Machine Learning Repository: Banknote authentication Data Set. https://archive.ics.uci.edu/ml/datasets/ banknote+authentication. Accessed September 17, 2018. UCI Machine Learning Repository: Banknote authentication Data Set. https://​archive.​ics.​uci.​edu/​ml/​datasets/​ banknote+authentication. Accessed September 17, 2018.
22.
Zurück zum Zitat UCI Machine Learning Repository: Car Evaluation Data Set. https://archive.ics.uci.edu/ml/datasets/ Car+Evaluation. Accessed September 17, 2018. UCI Machine Learning Repository: Car Evaluation Data Set. https://​archive.​ics.​uci.​edu/​ml/​datasets/​ Car+Evaluation. Accessed September 17, 2018.
23.
Zurück zum Zitat UCI Machine Learning Repository: Seismic-bumps Data Set. https://archive.ics.uci.edu/ml/datasets/seismic-bumps. Accessed September 17, 2018. UCI Machine Learning Repository: Seismic-bumps Data Set. https://​archive.​ics.​uci.​edu/​ml/​datasets/​seismic-bumps.​ Accessed September 17, 2018.
24.
Zurück zum Zitat UCI Machine Learning Repository: Chess (King-Rook vs. King-Pawn) Data Set. https://archive.ics.uci.edu/ ml/datasets/Chess+(King-Rook+vs.+King-Pawn). Accessed September 17, 2018. UCI Machine Learning Repository: Chess (King-Rook vs. King-Pawn) Data Set. https://​archive.​ics.​uci.​edu/​ ml/datasets/Chess+(King-Rook+vs.+King-Pawn). Accessed September 17, 2018.
25.
Zurück zum Zitat UCI Machine Learning Repository: Parkinson Speech Dataset with Multiple Types of Sound Recordings Data Set. https://archive.ics.uci.edu/ml/datasets/Parkinson+Speech+Dataset+with++Multiple+Types+of+Sound+ Recordings. Accessed September 17, 2018. UCI Machine Learning Repository: Parkinson Speech Dataset with Multiple Types of Sound Recordings Data Set. https://​archive.​ics.​uci.​edu/​ml/​datasets/​Parkinson+Speech​+Dataset+with++M​ultiple+Types+of​+Sound+ Recordings. Accessed September 17, 2018.
26.
Zurück zum Zitat UCI Machine Learning Repository: Ionosphere Data Set. https://archive.ics.uci.edu/ml/datasets/Ionosphere. Accessed September 17, 2018. UCI Machine Learning Repository: Ionosphere Data Set. https://​archive.​ics.​uci.​edu/​ml/​datasets/​Ionosphere.​ Accessed September 17, 2018.
27.
Zurück zum Zitat UCI Machine Learning Repository: Automobile Data Set. https://archive.ics.uci.edu/ml/datasets/Automobile. Accessed September 17, 2018. UCI Machine Learning Repository: Automobile Data Set. https://​archive.​ics.​uci.​edu/​ml/​datasets/​Automobile.​ Accessed September 17, 2018.
28.
Zurück zum Zitat UCI Machine Learning Repository: SPECT Heart Data Set. https://archive.ics.uci.edu/ml/datasets/ SPECT+Heart. Accessed September 17, 2018. UCI Machine Learning Repository: SPECT Heart Data Set. https://​archive.​ics.​uci.​edu/​ml/​datasets/​ SPECT+Heart. Accessed September 17, 2018.
29.
Zurück zum Zitat UCI Machine Learning Repository: Congressional Voting Records Data Set. https://archive.ics.uci.edu/ ml/datasets/Congressional+Voting+Records. Accessed September 17, 2018. UCI Machine Learning Repository: Congressional Voting Records Data Set. https://​archive.​ics.​uci.​edu/​ ml/datasets/Congressional+Voting+Records. Accessed September 17, 2018.
30.
Zurück zum Zitat UCI Machine Learning Repository: Drug consumption (quantified) Data Set. https://archive.ics.uci.edu/ ml/datasets/Drug+consumption+(quantified). Accessed September 17, 2018. UCI Machine Learning Repository: Drug consumption (quantified) Data Set. https://​archive.​ics.​uci.​edu/​ ml/datasets/Drug+consumption+(quantified). Accessed September 17, 2018.
31.
Zurück zum Zitat UCI Machine Learning Repository: Statlog (Australian Credit Approval) Data Set. https://archive.ics.uci.edu/ ml/datasets/Statlog+%28Australian+Credit+Approval%29. Accessed September 17, 2018. UCI Machine Learning Repository: Statlog (Australian Credit Approval) Data Set. https://​archive.​ics.​uci.​edu/​ ml/datasets/Statlog+%28Australian+Credit+Approval%29. Accessed September 17, 2018.
Metadaten
Titel
Using Hybrid Discriminative-Generative Models for Binary Classification
verfasst von
N. Abroyan
Publikationsdatum
01.07.2019
Verlag
Pleiades Publishing
Erschienen in
Automatic Control and Computer Sciences / Ausgabe 4/2019
Print ISSN: 0146-4116
Elektronische ISSN: 1558-108X
DOI
https://doi.org/10.3103/S0146411619040023

Weitere Artikel der Ausgabe 4/2019

Automatic Control and Computer Sciences 4/2019 Zur Ausgabe

Neuer Inhalt