Abstract
The ideas underlying a series of the authors’ studies dealing with the design of classification algorithms based on full decision trees are further developed. It is shown that the decision tree construction under consideration takes into account all the features satisfying a branching criterion. Full decision trees with an entropy branching criterion are studied as applied to precedent-based pattern recognition problems with real-valued data. Recognition procedures are constructed for solving problems with incomplete data (gaps in the feature descriptions of the objects) in the case when the learning objects are nonuniformly distributed over the classes. The authors’ basic results previously obtained in this area are overviewed.
Similar content being viewed by others
References
Yu. I. Zhuravlev, “On the Algebraic Approach to Recognition and Classification Problems,” in Problems in Cybernetics (Nauka, Moscow, 1978), Vol. 33, pp. 5–68 [in Russian].
E. V. Djukova and N. V. Peskov, “A Classification Algorithm Based on the Complete Decision Tree,” J. Pattern Recogn. Image Anal. 17, 363–367 (2007).
V. I. Donskoi and A. I. Bashta, Discrete Models of Decision Making with Incomplete Data (Tavriya, Simferopol’, 1992), pp. 33–74.
I. E. Genrikhov, “Construction of a Full Decision Tree on the Basis of the Algorithm C4.5,” in Reports on Applied Mathematics (Vychisl. Tsentr Ross. Akad. Nauk, Moscow, 2009) [in Russian].
I. E. Genrikhov and E. V. Djukova, “Improvement of the Algorithm C4.5 on the Basis of Full Decision Trees,” Proceedings of the 14th All-Russia Conference on Mathematical Methods for Pattern Recognition (MAKS, Moscow, 2009), pp. 104–107.
J. R. Quinlan, C4.5: Programs for Machine Learning (Morgan Kaufmann, San Mateo, CA, 1993).
I. E. Genrikhov and E. V. Djukova, “Construction and Analysis of Recognition Procedures Based on Full Decision Trees,” Proceedings of the 8th International Conference on Intelligent Data Processing (MAKS, Moscow, 2010), pp. 117–120.
I. E. Genrikhov, “Synthesis and Analysis of Recognition procedures on the Basis of Full Decision Trees,” J. Pattern Recogn. Image Anal. 21(1), 45–51 (2011).
J. R. Quinlan, http://www.rulequest.com/see5-info.html.
Yu. I. Zhuravlev, V. V. Ryazanov, and O. V. Sen’ko, Pattern Recognition: Mathematical Methods. Software System, and Applications (Fazis, Moscow, 2006) [in Russian].
L. Peng and L. Lei, “A Review of Missing Data Treatment Methods,” Int. Intelligent Inf. Manag. Syst. Technol. 1, 412–419 (2005).
E. V. Djukova, et al., “Real-Value Data Processing by Logical Recognition Procedures,” Iskusstv. Intellekt, No. 2, 80–85 (2004).
T. Fawcett, “An Introduction to ROC Analysis,” Pattern Recogn. Lett. 27, 861–874 (2006).
Author information
Authors and Affiliations
Corresponding author
Additional information
Original Russian Text © I.E. Genrikhov, E.V. Djukova, 2012, published in Zhurnal Vychislitel’noi Matematiki i Matematicheskoi Fiziki, 2012, Vol. 52, No. 4, pp. 750–761.
Rights and permissions
About this article
Cite this article
Genrikhov, I.E., Djukova, E.V. Classification based on full decision trees. Comput. Math. and Math. Phys. 52, 653–663 (2012). https://doi.org/10.1134/S0965542512040082
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1134/S0965542512040082