Skip to main content
Erschienen in: Pattern Recognition and Image Analysis 4/2023

01.12.2023 | SCIENTIFIC SCHOOLS OF THE KRASOVSKII INSTITUTE OF MATHEMATICS AND MECHANICS OF THE URAL BRANCH OF THE RUSSIAN ACADEMY OF SCIENCES, YEKATERINBURG, THE RUSSIAN FEDERATION

Ural School of Pattern Recognition: Majoritarian Approach to Ensemble Learning

verfasst von: Vl. D. Mazurov, M. I. Poberii, M. Yu. Khachai

Erschienen in: Pattern Recognition and Image Analysis | Ausgabe 4/2023

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This article provides an overview of the significant achievements of the Ural School of Pattern Recognition. The focus is on majoritarian generalized solutions for algebraic equations and inequalities that may not always adhere to standard properties. The paper also delves into the broader applications of these findings in collective machine learning techniques. In the literature, these generalized solutions are frequently referred to as committee generalized solutions or simply committees, leading to the derived learning methods being called committee machines. Our discussion primarily centers on the foundational theorems confirming the existence of such solutions, the intricacies of combinatorial optimization during their exploration, and the subsequent emergence of collective machine learning algorithms.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Fußnoten
1
Hereinafter, we use the standard notation for the binomial coefficient \(\left( {\begin{array}{*{20}{c}} q \\ k \end{array}} \right) = \frac{{q!}}{{k!\left( {q - k} \right)!}}\).
 
2
We believe that the number 0 is coprime with any natural number.
 
3
In which matching feature descriptions of objects xi = xj implies matching labels yi = yj, indicating their class affiliation.
 
4
It belongs to the class of combinatorial optimization tasks, having polynomial-time approximation algorithms with constant approximation factors.
 
Literatur
3.
Zurück zum Zitat C. M. Bishop, Pattern Recognition and Machine Learning, 2nd ed. (Springer, New York, 2011). C. M. Bishop, Pattern Recognition and Machine Learning, 2nd ed. (Springer, New York, 2011).
7.
Zurück zum Zitat S. N. Chernikov, Linear Inequalities (Nauka. Glavnaya Redaktsiya Fiziko-Matematicheskoi Literatury, Moscow, 1968). S. N. Chernikov, Linear Inequalities (Nauka. Glavnaya Redaktsiya Fiziko-Matematicheskoi Literatury, Moscow, 1968).
9.
Zurück zum Zitat E. V. Dyukova, Yu. I. Zhuravlev, and K. V. Rudakov, “On the algebra-logical synthesis of correct recognition procedures based on elementary algorithms,” Comput. Math. Math. Phys. 36, 1161–1167 (1997). E. V. Dyukova, Yu. I. Zhuravlev, and K. V. Rudakov, “On the algebra-logical synthesis of correct recognition procedures based on elementary algorithms,” Comput. Math. Math. Phys. 36, 1161–1167 (1997).
10.
Zurück zum Zitat I. I. Eremin, V. D. Mazurov, and N. N. Astaf ’ev, Improper Problem of Linear and Convex Programming (Nauka, Moscow, 1983). I. I. Eremin, V. D. Mazurov, and N. N. Astaf ’ev, Improper Problem of Linear and Convex Programming (Nauka, Moscow, 1983).
11.
Zurück zum Zitat I. I. Eremin, Theory of Linear Optimization (De Gruyter, 2001). I. I. Eremin, Theory of Linear Optimization (De Gruyter, 2001).
13.
Zurück zum Zitat D. N. Gainanov, “Graphs of maximal consistent subsystems of inconsistent systems of linear equations,” Preprint VINITI No. 229-81 (Inst. of Mechanics and Mathematics, Ural Branch, USSR Academy of Sciences, 1981). D. N. Gainanov, “Graphs of maximal consistent subsystems of inconsistent systems of linear equations,” Preprint VINITI No. 229-81 (Inst. of Mechanics and Mathematics, Ural Branch, USSR Academy of Sciences, 1981).
14.
15.
Zurück zum Zitat M. Hachai, “Classification of committee solutions of majority,” Pattern Recognit. Image Anal. 7, 260–265 (1997). M. Hachai, “Classification of committee solutions of majority,” Pattern Recognit. Image Anal. 7, 260–265 (1997).
18.
Zurück zum Zitat M. Yu. Khachai and A. I. Rybin, “A new estimate of the number of members in a minimum committee of a system of linear inequalities,” Pattern Recognit. Image Anal. 8, 491–496 (1998). M. Yu. Khachai and A. I. Rybin, “A new estimate of the number of members in a minimum committee of a system of linear inequalities,” Pattern Recognit. Image Anal. 8, 491–496 (1998).
20.
Zurück zum Zitat M. Yu. Khachai, “Estimate of the number of members in the minimal committee of a system of linear inequalities,” Comput. Math. Math. Phys. 37, 1356–1361 (1997).MathSciNet M. Yu. Khachai, “Estimate of the number of members in the minimal committee of a system of linear inequalities,” Comput. Math. Math. Phys. 37, 1356–1361 (1997).MathSciNet
21.
Zurück zum Zitat M. Yu. Khachai, “A relation connected with a decision making procedure based on majority vote,” Dokl. Math. 64, 456–459 (2001). M. Yu. Khachai, “A relation connected with a decision making procedure based on majority vote,” Dokl. Math. 64, 456–459 (2001).
22.
Zurück zum Zitat M. Yu. Khachai, “A game against nature related to majority vote decision making,” Comput. Math. Math. Phys. 42, 1547–1555 (2002).MathSciNet M. Yu. Khachai, “A game against nature related to majority vote decision making,” Comput. Math. Math. Phys. 42, 1547–1555 (2002).MathSciNet
23.
Zurück zum Zitat M. Yu. Khachai, “On approximate algorithm for minimal committee of a system of linear inequalities,” Pattern Recognit. Image Anal. 13, 259–464 (2003). M. Yu. Khachai, “On approximate algorithm for minimal committee of a system of linear inequalities,” Pattern Recognit. Image Anal. 13, 259–464 (2003).
29.
Zurück zum Zitat M. Khachay, M. Pobery, and D. Khachay, “Integer partition problem: Theoretical approach to improving accuracy of classifier ensembles,” Int. J. Artif. Intell. 13, 135–146 (2015). M. Khachay, M. Pobery, and D. Khachay, “Integer partition problem: Theoretical approach to improving accuracy of classifier ensembles,” Int. J. Artif. Intell. 13, 135–146 (2015).
37.
Zurück zum Zitat Vl. D. Mazurov, M. Yu. Khachai, and M. I. Poberii, “Committee constructions for solving problems of selection, diagnostics, and prediction,” Proc. Steklov Inst. Math. 8, S67–S101 (2002). Vl. D. Mazurov, M. Yu. Khachai, and M. I. Poberii, “Committee constructions for solving problems of selection, diagnostics, and prediction,” Proc. Steklov Inst. Math. 8, S67–S101 (2002).
40.
Zurück zum Zitat Vl. D. Mazurov, “Committees of systems of inequalities and pattern recognition problem,” Kibernetika, No. 3, 140–146 (1971). Vl. D. Mazurov, “Committees of systems of inequalities and pattern recognition problem,” Kibernetika, No. 3, 140–146 (1971).
41.
Zurück zum Zitat Vl. D. Mazurov, Committee Method in Optimization and Classification Problems (Nauka, Moscow, 1990). Vl. D. Mazurov, Committee Method in Optimization and Classification Problems (Nauka, Moscow, 1990).
42.
Zurück zum Zitat N. Nillson, Learning Machines: Foundations of Trainable Pattern Classfying Systems (McGraw-Hill, New York, 1965). N. Nillson, Learning Machines: Foundations of Trainable Pattern Classfying Systems (McGraw-Hill, New York, 1965).
46.
Zurück zum Zitat A. I. Rybin, “On some sufficient conditions of existence of a majority committee,” Pattern Recognit. Image Anal. 10, 297–302 (2000). A. I. Rybin, “On some sufficient conditions of existence of a majority committee,” Pattern Recognit. Image Anal. 10, 297–302 (2000).
51.
Zurück zum Zitat L. I. Tyagunov, “On the extraction of a sequence of maximal consistent subsystems of improper system of linear inequalities,” in Mathematical Methods of Planning and Management in Large Systems (Ural. Nauchnyi Tsentr Akad. Nauk SSSR, Sverdlovsk, 1973), pp. 152–162. L. I. Tyagunov, “On the extraction of a sequence of maximal consistent subsystems of improper system of linear inequalities,” in Mathematical Methods of Planning and Management in Large Systems (Ural. Nauchnyi Tsentr Akad. Nauk SSSR, Sverdlovsk, 1973), pp. 152–162.
52.
Zurück zum Zitat V. N. Vapnik and A. Ya. Chervonenkis, Theory of Pattern Recognition (Nauka, Moscow, 1974). V. N. Vapnik and A. Ya. Chervonenkis, Theory of Pattern Recognition (Nauka, Moscow, 1974).
53.
Zurück zum Zitat V. N. Vapnik, Statistical Learning Theory (Wiley-Interscience, 1998). V. N. Vapnik, Statistical Learning Theory (Wiley-Interscience, 1998).
54.
Zurück zum Zitat K. V. Vorontsov, “Optimization methods for linear and monotone correction in an algebraic approach to the recognition problem,” Comput. Math. Math. Phys. 40, 159–168 (2000).MathSciNet K. V. Vorontsov, “Optimization methods for linear and monotone correction in an algebraic approach to the recognition problem,” Comput. Math. Math. Phys. 40, 159–168 (2000).MathSciNet
Metadaten
Titel
Ural School of Pattern Recognition: Majoritarian Approach to Ensemble Learning
verfasst von
Vl. D. Mazurov
M. I. Poberii
M. Yu. Khachai
Publikationsdatum
01.12.2023
Verlag
Pleiades Publishing
Erschienen in
Pattern Recognition and Image Analysis / Ausgabe 4/2023
Print ISSN: 1054-6618
Elektronische ISSN: 1555-6212
DOI
https://doi.org/10.1134/S1054661823040314

Weitere Artikel der Ausgabe 4/2023

Pattern Recognition and Image Analysis 4/2023 Zur Ausgabe

SCIENTIFIC SCHOOLS OF THE FEDERAL RESEARCH CENTER “COMPUTER SCIENCE AND CONTROL” OF THE RUSSIAN ACADEMY OF SCIENCES, MOSCOW, THE RUSSIAN FEDERATION

Developing the Theory of Stochastic Canonic Expansions and Its Applications

SCIENTIFIC SCHOOL OF THE KOTELNIKOV INSTITUTE OF RADIO ENGINEERING AND ELECTRONICS OF THE RUSSIAN ACADEMY OF SCIENCES, MOSCOW, THE RUSSIAN FEDERATION

The Physical Principles of the Construction of Systems for Safe Monitoring of the State of a Human Operator

SCIENTIFIC SCHOOL OF THE KOTELNIKOV INSTITUTE OF RADIO ENGINEERING AND ELECTRONICS OF THE RUSSIAN ACADEMY OF SCIENCES, MOSCOW, THE RUSSIAN FEDERATION

Radiophysical Research Methods in the Development of New Medical Equipment and Information Technologies

SCIENTIFIC SCHOOLS OF THE FEDERAL RESEARCH CENTER “COMPUTER SCIENCE AND CONTROL” OF THE RUSSIAN ACADEMY OF SCIENCES, MOSCOW, THE RUSSIAN FEDERATION

Application of Cascade Methods as a Universal Object Detection Tool

SCIENTIFIC SCHOOL OF THE IMAGE PROCESSING SYSTEMS INSTITUTE OF THE RUSSIAN ACADEMY OF SCIENCES–BRANCH OF THE FEDERAL SCIENTIFIC RESEARCH CENTER “CRYSTALLOGRAPHY AND PHOTONICS” OF THE RUSSIAN ACADEMY OF SCIENCES, SAMARA, THE RUSSIAN FEDERATION

Systems for Recognition and Intelligent Analysis of Biomedical Images

SCIENTIFIC SCHOOLS OF THE FEDERAL RESEARCH CENTER “COMPUTER SCIENCE AND CONTROL” OF THE RUSSIAN ACADEMY OF SCIENCES, MOSCOW, THE RUSSIAN FEDERATION

Recognition Methods in Academician Yu.I. Zhuravlev’s Scientific School

Premium Partner