Skip to main content

2017 | OriginalPaper | Buchkapitel

ENIGMA: Efficient Learning-Based Inference Guiding Machine

verfasst von : Jan Jakubův, Josef Urban

Erschienen in: Intelligent Computer Mathematics

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

ENIGMA is a learning-based method for guiding given clause selection in saturation-based theorem provers. Clauses from many previous proof searches are classified as positive and negative based on their participation in the proofs. An efficient classification model is trained on this data, classifying a clause as useful or un-useful for the proof search. This learned classification is used to guide next proof searches prioritizing useful clauses among other generated clauses. The approach is evaluated on the E prover and the CASC 2016 AIM benchmark, showing a large increase of E’s performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
We use E Prover 1.9.1 (http://​www.​eprover.​org/​).
 
2
We use https://static-content.springer.com/image/chp%3A10.1007%2F978-3-319-62075-6_20/454024_1_En_20_IEq95_HTML.gif .
 
3
AIM is a long-term and large-scale project [15] in applied automated deduction concerned with proving open algebraic conjectures by Kinyon and Veroff.
 
4
Different proof search settings (term orderings, rewriting settings, etc.) may largely change the proof search and make training examples incompatible. That is to say, a classifier trained on proofs produced with some proof search settings should be used only with the same settings. In our case, the proof search settings used to produce competition proofs are not known. Thus we resort to a single E prover strategy and generate compatible training data ourselves.
 
5
All the experiments were performed at Intel Xeon 2.3 GHz workstation.
 
6
We use Vampire 4.0 in CASC mode.
 
7
In an initial experiment, a simple nearest-neighbor selection of training problems for the learning further decreases the solving times and proves one more AIM problem unsolved by Prover9.
 
Literatur
1.
Zurück zum Zitat Blanchette, J.C., Greenaway, D., Kaliszyk, C., Kühlwein, D., Urban, J.: A learning-based fact selector for Isabelle/HOL. J. Autom. Reasoning 57(3), 219–244 (2016)MathSciNetCrossRefMATH Blanchette, J.C., Greenaway, D., Kaliszyk, C., Kühlwein, D., Urban, J.: A learning-based fact selector for Isabelle/HOL. J. Autom. Reasoning 57(3), 219–244 (2016)MathSciNetCrossRefMATH
2.
Zurück zum Zitat Blanchette, J.C., Kaliszyk, C., Paulson, L.C., Urban, J.: Hammering towards QED. J. Formalized Reasoning 9(1), 101–148 (2016)MathSciNet Blanchette, J.C., Kaliszyk, C., Paulson, L.C., Urban, J.: Hammering towards QED. J. Formalized Reasoning 9(1), 101–148 (2016)MathSciNet
3.
Zurück zum Zitat Boser, B.E., Guyon, I., Vapnik, V.: A training algorithm for optimal margin classifiers. In: COLT, pp. 144–152. ACM (1992) Boser, B.E., Guyon, I., Vapnik, V.: A training algorithm for optimal margin classifiers. In: COLT, pp. 144–152. ACM (1992)
4.
Zurück zum Zitat Fan, R., Chang, K., Hsieh, C., Wang, X., Lin, C.: LIBLINEAR: A library for large linear classification. J. Mach. Learn. Res. 9, 1871–1874 (2008)MATH Fan, R., Chang, K., Hsieh, C., Wang, X., Lin, C.: LIBLINEAR: A library for large linear classification. J. Mach. Learn. Res. 9, 1871–1874 (2008)MATH
5.
Zurück zum Zitat Färber, M., Kaliszyk, C., Urban, J.: Monte Carlo connection prover. CoRR, abs/1611.05990 (2016) Färber, M., Kaliszyk, C., Urban, J.: Monte Carlo connection prover. CoRR, abs/1611.05990 (2016)
6.
Zurück zum Zitat Gottlob, G., Sutcliffe, G., Voronkov, A. (eds.) Global Conference on Artificial Intelligence (GCAI 2015), Tbilisi, Georgia. EPiC Series in Computing, EasyChair, vol. 36, 16–19 October 2015 Gottlob, G., Sutcliffe, G., Voronkov, A. (eds.) Global Conference on Artificial Intelligence (GCAI 2015), Tbilisi, Georgia. EPiC Series in Computing, EasyChair, vol. 36, 16–19 October 2015
7.
Zurück zum Zitat Gransden, T., Walkinshaw, N., Raman, R.: SEPIA: search for proofs using inferred automata. In: Felty, A.P., Middeldorp, A. (eds.) CADE 2015. LNCS, vol. 9195, pp. 246–255. Springer, Cham (2015). doi:10.1007/978-3-319-21401-6_16 CrossRef Gransden, T., Walkinshaw, N., Raman, R.: SEPIA: search for proofs using inferred automata. In: Felty, A.P., Middeldorp, A. (eds.) CADE 2015. LNCS, vol. 9195, pp. 246–255. Springer, Cham (2015). doi:10.​1007/​978-3-319-21401-6_​16 CrossRef
8.
Zurück zum Zitat Hsieh, C., Chang, K., Lin, C., Keerthi, S.S., Sundararajan, S.: A dual coordinate descent method for large-scale linear SVM. In: ICML, ACM International Conference Proceeding Series, vol. 307, pp. 408–415. ACM (2008) Hsieh, C., Chang, K., Lin, C., Keerthi, S.S., Sundararajan, S.: A dual coordinate descent method for large-scale linear SVM. In: ICML, ACM International Conference Proceeding Series, vol. 307, pp. 408–415. ACM (2008)
9.
Zurück zum Zitat Jakubuv, J., Urban, J.: BliStrTune: hierarchical invention of theorem proving strategies. In: Bertot, Y., Vafeiadis, V. (eds.) Proceedings of the 6th ACM SIGPLAN Conference on Certified Programs and Proofs (CPP 2017), Paris, France. pp. 43–52. ACM. 16–17 January 2017(2017) Jakubuv, J., Urban, J.: BliStrTune: hierarchical invention of theorem proving strategies. In: Bertot, Y., Vafeiadis, V. (eds.) Proceedings of the 6th ACM SIGPLAN Conference on Certified Programs and Proofs (CPP 2017), Paris, France. pp. 43–52. ACM. 16–17 January 2017(2017)
10.
11.
Zurück zum Zitat Kaliszyk, C., Urban, J.: FEMaLeCoP: Fairly efficient machine learning connection prover. In: Davis, M., Fehnker, A., McIver, A., Voronkov, A. (eds.) LPAR 2015. LNCS, vol. 9450, pp. 88–96. Springer, Heidelberg (2015). doi:10.1007/978-3-662-48899-7_7 CrossRef Kaliszyk, C., Urban, J.: FEMaLeCoP: Fairly efficient machine learning connection prover. In: Davis, M., Fehnker, A., McIver, A., Voronkov, A. (eds.) LPAR 2015. LNCS, vol. 9450, pp. 88–96. Springer, Heidelberg (2015). doi:10.​1007/​978-3-662-48899-7_​7 CrossRef
13.
Zurück zum Zitat Kaliszyk, C., Urban, J., Vyskočil, J.: Machine learner for automated reasoning 0.4 and 0.5. CoRR, abs/1402.2359, 2014, Accepted to (PAAR 2014) Kaliszyk, C., Urban, J., Vyskočil, J.: Machine learner for automated reasoning 0.4 and 0.5. CoRR, abs/1402.2359, 2014, Accepted to (PAAR 2014)
14.
Zurück zum Zitat Kaliszyk, C., Urban, J., Vyskočil, J.: Efficient semantic features for automated reasoning over large theories. In: Yang, Q., Wooldridge, M. (eds.) IJCAI 2015, pp. 3084–3090. AAAI Press (2015) Kaliszyk, C., Urban, J., Vyskočil, J.: Efficient semantic features for automated reasoning over large theories. In: Yang, Q., Wooldridge, M. (eds.) IJCAI 2015, pp. 3084–3090. AAAI Press (2015)
15.
Zurück zum Zitat Kinyon, M., Veroff, R., Vojtěchovský, P.: Loops with Abelian inner mapping groups: an application of automated deduction. In: Bonacina, M.P., Stickel, M.E. (eds.) Automated Reasoning and Mathematics. LNCS, vol. 7788, pp. 151–164. Springer, Heidelberg (2013). doi:10.1007/978-3-642-36675-8_8 CrossRef Kinyon, M., Veroff, R., Vojtěchovský, P.: Loops with Abelian inner mapping groups: an application of automated deduction. In: Bonacina, M.P., Stickel, M.E. (eds.) Automated Reasoning and Mathematics. LNCS, vol. 7788, pp. 151–164. Springer, Heidelberg (2013). doi:10.​1007/​978-3-642-36675-8_​8 CrossRef
17.
Zurück zum Zitat Kühlwein, D., Urban, J.: MaLeS: A framework for automatic tuning of automated theorem provers. J. Autom. Reasoning 55(2), 91–116 (2015)MathSciNetCrossRefMATH Kühlwein, D., Urban, J.: MaLeS: A framework for automatic tuning of automated theorem provers. J. Autom. Reasoning 55(2), 91–116 (2015)MathSciNetCrossRefMATH
18.
Zurück zum Zitat Lin, C., Weng, R.C., Keerthi, S.S.: Trust region newton method for logistic regression. J. Mach. Learn. Res. 9, 627–650 (2008)MathSciNetMATH Lin, C., Weng, R.C., Keerthi, S.S.: Trust region newton method for logistic regression. J. Mach. Learn. Res. 9, 627–650 (2008)MathSciNetMATH
19.
20.
Zurück zum Zitat Schäfer, S., Schulz, S.: Breeding theorem proving heuristics with genetic algorithms. In: Gottlob et al. [6], pp. 263–274 Schäfer, S., Schulz, S.: Breeding theorem proving heuristics with genetic algorithms. In: Gottlob et al. [6], pp. 263–274
21.
Zurück zum Zitat Schulz, S.: E - A Brainiac Theorem Prover. AI Commun. 15(2–3), 111–126 (2002)MATH Schulz, S.: E - A Brainiac Theorem Prover. AI Commun. 15(2–3), 111–126 (2002)MATH
22.
Zurück zum Zitat Sutcliffe, G.: The 8th IJCAR automated theorem proving system competition - CASC-J8. AI Commun. 29(5), 607–619 (2016)MathSciNetCrossRef Sutcliffe, G.: The 8th IJCAR automated theorem proving system competition - CASC-J8. AI Commun. 29(5), 607–619 (2016)MathSciNetCrossRef
23.
Zurück zum Zitat Urban, J.: BliStr: The Blind Strategymaker. In: Gottlob et al. [6], pp. 312–319 Urban, J.: BliStr: The Blind Strategymaker. In: Gottlob et al. [6], pp. 312–319
24.
Zurück zum Zitat Urban, J., Sutcliffe, G., Pudlák, P., Vyskočil, J.: MaLARea SG1 - Machine learner for automated reasoning with semantic guidance. In: Armando, A., Baumgartner, P., Dowek, G. (eds.) IJCAR 2008. LNCS, vol. 5195, pp. 441–456. Springer, Heidelberg (2008). doi:10.1007/978-3-540-71070-7_37 CrossRef Urban, J., Sutcliffe, G., Pudlák, P., Vyskočil, J.: MaLARea SG1 - Machine learner for automated reasoning with semantic guidance. In: Armando, A., Baumgartner, P., Dowek, G. (eds.) IJCAR 2008. LNCS, vol. 5195, pp. 441–456. Springer, Heidelberg (2008). doi:10.​1007/​978-3-540-71070-7_​37 CrossRef
25.
Zurück zum Zitat Urban, J., Vyskočil, J., Štěpánek, P.: MaLeCoP machine learning connection prover. In: Brünnler, K., Metcalfe, G. (eds.) TABLEAUX 2011. LNCS, vol. 6793, pp. 263–277. Springer, Heidelberg (2011). doi:10.1007/978-3-642-22119-4_21 CrossRef Urban, J., Vyskočil, J., Štěpánek, P.: MaLeCoP machine learning connection prover. In: Brünnler, K., Metcalfe, G. (eds.) TABLEAUX 2011. LNCS, vol. 6793, pp. 263–277. Springer, Heidelberg (2011). doi:10.​1007/​978-3-642-22119-4_​21 CrossRef
Metadaten
Titel
ENIGMA: Efficient Learning-Based Inference Guiding Machine
verfasst von
Jan Jakubův
Josef Urban
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-62075-6_20