Skip to main content
Log in

Classification based on full decision trees

  • Published:
Computational Mathematics and Mathematical Physics Aims and scope Submit manuscript

Abstract

The ideas underlying a series of the authors’ studies dealing with the design of classification algorithms based on full decision trees are further developed. It is shown that the decision tree construction under consideration takes into account all the features satisfying a branching criterion. Full decision trees with an entropy branching criterion are studied as applied to precedent-based pattern recognition problems with real-valued data. Recognition procedures are constructed for solving problems with incomplete data (gaps in the feature descriptions of the objects) in the case when the learning objects are nonuniformly distributed over the classes. The authors’ basic results previously obtained in this area are overviewed.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Yu. I. Zhuravlev, “On the Algebraic Approach to Recognition and Classification Problems,” in Problems in Cybernetics (Nauka, Moscow, 1978), Vol. 33, pp. 5–68 [in Russian].

    Google Scholar 

  2. E. V. Djukova and N. V. Peskov, “A Classification Algorithm Based on the Complete Decision Tree,” J. Pattern Recogn. Image Anal. 17, 363–367 (2007).

    Article  Google Scholar 

  3. V. I. Donskoi and A. I. Bashta, Discrete Models of Decision Making with Incomplete Data (Tavriya, Simferopol’, 1992), pp. 33–74.

    Google Scholar 

  4. I. E. Genrikhov, “Construction of a Full Decision Tree on the Basis of the Algorithm C4.5,” in Reports on Applied Mathematics (Vychisl. Tsentr Ross. Akad. Nauk, Moscow, 2009) [in Russian].

    Google Scholar 

  5. I. E. Genrikhov and E. V. Djukova, “Improvement of the Algorithm C4.5 on the Basis of Full Decision Trees,” Proceedings of the 14th All-Russia Conference on Mathematical Methods for Pattern Recognition (MAKS, Moscow, 2009), pp. 104–107.

    Google Scholar 

  6. J. R. Quinlan, C4.5: Programs for Machine Learning (Morgan Kaufmann, San Mateo, CA, 1993).

    Google Scholar 

  7. I. E. Genrikhov and E. V. Djukova, “Construction and Analysis of Recognition Procedures Based on Full Decision Trees,” Proceedings of the 8th International Conference on Intelligent Data Processing (MAKS, Moscow, 2010), pp. 117–120.

    Google Scholar 

  8. I. E. Genrikhov, “Synthesis and Analysis of Recognition procedures on the Basis of Full Decision Trees,” J. Pattern Recogn. Image Anal. 21(1), 45–51 (2011).

    Article  Google Scholar 

  9. J. R. Quinlan, http://www.rulequest.com/see5-info.html.

  10. Yu. I. Zhuravlev, V. V. Ryazanov, and O. V. Sen’ko, Pattern Recognition: Mathematical Methods. Software System, and Applications (Fazis, Moscow, 2006) [in Russian].

    Google Scholar 

  11. L. Peng and L. Lei, “A Review of Missing Data Treatment Methods,” Int. Intelligent Inf. Manag. Syst. Technol. 1, 412–419 (2005).

    Google Scholar 

  12. E. V. Djukova, et al., “Real-Value Data Processing by Logical Recognition Procedures,” Iskusstv. Intellekt, No. 2, 80–85 (2004).

  13. T. Fawcett, “An Introduction to ROC Analysis,” Pattern Recogn. Lett. 27, 861–874 (2006).

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to I. E. Genrikhov.

Additional information

Original Russian Text © I.E. Genrikhov, E.V. Djukova, 2012, published in Zhurnal Vychislitel’noi Matematiki i Matematicheskoi Fiziki, 2012, Vol. 52, No. 4, pp. 750–761.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Genrikhov, I.E., Djukova, E.V. Classification based on full decision trees. Comput. Math. and Math. Phys. 52, 653–663 (2012). https://doi.org/10.1134/S0965542512040082

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0965542512040082

Keywords

Navigation