Skip to main content

2016 | OriginalPaper | Buchkapitel

Learning and Reasoning with Logic Tensor Networks

verfasst von : Luciano Serafini, Artur S. d’Avila Garcez

Erschienen in: AI*IA 2016 Advances in Artificial Intelligence

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The paper introduces real logic: a framework that seamlessly integrates logical deductive reasoning with efficient, data-driven relational learning. Real logic is based on full first order language. Terms are interpreted in n-dimensional feature vectors, while predicates are interpreted in fuzzy sets. In real logic it is possible to formally define the following two tasks: (i) learning from data in presence of logical constraints, and (ii) reasoning on formulas exploiting concrete data. We implement real logic in an deep learning architecture, called logic tensor networks, based on Google’s \(\textsc {TensorFlow}^{\tiny {\text {TM}}}\) primitives. The paper concludes with experiments on a simple but representative example of knowledge completion.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
In logic, the term “grounding” indicates the operation of replacing the variables of a term/formula with constants, or terms that do not contains other variables. To avoid confusion, we use the synonym “instantiation” for this sense.
 
3
Normally, a probabilistic approach is taken to solve this problem, and one that requires instantiating all clauses to remove variables, essentially turning the problem into a propositional one; ltn takes a different approach.
 
4
Notice how no grounding is provided about the signature of the knowledge-base.
 
5
A smoth factor \(\lambda ||\mathbf {\Omega }||^2_2\) is added to the loss to limit the size of parameters.
 
6
\(\mu (a,b) = \min (1,a+b)\).
 
Literatur
1.
Zurück zum Zitat Bengio, Y.: Learning deep architectures for AI. Found. Trends Mach. Learn. 2, 1–127 (2009)CrossRefMATH Bengio, Y.: Learning deep architectures for AI. Found. Trends Mach. Learn. 2, 1–127 (2009)CrossRefMATH
2.
Zurück zum Zitat Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., Dieleman, S., Grewe, D., Nham, J., Kalchbrenner, N., Sutskever, I., Lillicrap, T., Leach, M., Kavukcuoglu, K., Graepel, T., Hassabis, D.: Mastering the game of go with deep neural networks and tree search. Nature 529, 484–503 (2016)CrossRef Silver, D., Huang, A., Maddison, C.J., Guez, A., Sifre, L., van den Driessche, G., Schrittwieser, J., Antonoglou, I., Panneershelvam, V., Lanctot, M., Dieleman, S., Grewe, D., Nham, J., Kalchbrenner, N., Sutskever, I., Lillicrap, T., Leach, M., Kavukcuoglu, K., Graepel, T., Hassabis, D.: Mastering the game of go with deep neural networks and tree search. Nature 529, 484–503 (2016)CrossRef
3.
Zurück zum Zitat Kephart, J.O., Chess, D.M.: The vision of autonomic computing. Computer 36, 41–50 (2003)CrossRef Kephart, J.O., Chess, D.M.: The vision of autonomic computing. Computer 36, 41–50 (2003)CrossRef
4.
Zurück zum Zitat Kiela, D., Bottou, L.: Learning image embeddings using convolutional neural networks for improved multi-modal semantics. In: Proceedings of EMNLP 2014 (2014) Kiela, D., Bottou, L.: Learning image embeddings using convolutional neural networks for improved multi-modal semantics. In: Proceedings of EMNLP 2014 (2014)
5.
Zurück zum Zitat Socher, R., Chen, D., Manning, C.D., Ng, A.: Reasoning with neural tensor networks for knowledge base completion. In: Advances in Neural Information Processing Systems, pp. 926–934 (2013) Socher, R., Chen, D., Manning, C.D., Ng, A.: Reasoning with neural tensor networks for knowledge base completion. In: Advances in Neural Information Processing Systems, pp. 926–934 (2013)
6.
Zurück zum Zitat Guha, R.: Towards a model theory for distributed representations. In: 2015 AAAI Spring Symposium Series (2015) Guha, R.: Towards a model theory for distributed representations. In: 2015 AAAI Spring Symposium Series (2015)
8.
Zurück zum Zitat d’Avila Garcez, A.S., Lamb, L.C., Gabbay, D.M.: Neural-Symbolic Cognitive Reasoning. Cognitive Technologies. Springer, Heidelberg (2009)MATH d’Avila Garcez, A.S., Lamb, L.C., Gabbay, D.M.: Neural-Symbolic Cognitive Reasoning. Cognitive Technologies. Springer, Heidelberg (2009)MATH
9.
10.
Zurück zum Zitat Barrett, L., Feldman, J., MacDermed, L.: A (somewhat) new solution to the variable binding problem. Neural Comput. 20, 2361–2378 (2008)CrossRefMATH Barrett, L., Feldman, J., MacDermed, L.: A (somewhat) new solution to the variable binding problem. Neural Comput. 20, 2361–2378 (2008)CrossRefMATH
11.
Zurück zum Zitat Bergmann, M.: An Introduction to Many-Valued and Fuzzy Logic: Semantics, Algebras, and Derivation Systems. Cambridge University Press, New York (2008)CrossRefMATH Bergmann, M.: An Introduction to Many-Valued and Fuzzy Logic: Semantics, Algebras, and Derivation Systems. Cambridge University Press, New York (2008)CrossRefMATH
13.
Zurück zum Zitat d’Avila Garcez, A.S., Gori, M., Hitzler, P., Lamb, L.C.: Neural-symbolic learning and reasoning (dagstuhl seminar 14381). Dagstuhl Rep. 4, 50–84 (2014) d’Avila Garcez, A.S., Gori, M., Hitzler, P., Lamb, L.C.: Neural-symbolic learning and reasoning (dagstuhl seminar 14381). Dagstuhl Rep. 4, 50–84 (2014)
14.
Zurück zum Zitat McCallum, A., Gabrilovich, E., Guha, R., Murphy, K. (eds.): Knowledge representation and reasoning: integrating symbolic and neural approaches. In: AAAI Spring Symposium, Stanford University, CA, USA (2015) McCallum, A., Gabrilovich, E., Guha, R., Murphy, K. (eds.): Knowledge representation and reasoning: integrating symbolic and neural approaches. In: AAAI Spring Symposium, Stanford University, CA, USA (2015)
15.
Zurück zum Zitat Besold, T.R., d’Avila Garcez, A., Marcus, G.F., Miikulainen, R. (eds.): Cognitive computation: integrating neural and symbolic approaches. In: Workshop at NIPS 2015, Montreal, Canada, CEUR-WS 1583, April 2016 Besold, T.R., d’Avila Garcez, A., Marcus, G.F., Miikulainen, R. (eds.): Cognitive computation: integrating neural and symbolic approaches. In: Workshop at NIPS 2015, Montreal, Canada, CEUR-WS 1583, April 2016
16.
Zurück zum Zitat Huth, M., Ryan, M.: Logic in Computer Science: Modelling and Reasoning About Systems. Cambridge University Press, New York (2004)CrossRefMATH Huth, M., Ryan, M.: Logic in Computer Science: Modelling and Reasoning About Systems. Cambridge University Press, New York (2004)CrossRefMATH
17.
Zurück zum Zitat Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)MATH Blei, D.M., Ng, A.Y., Jordan, M.I.: Latent Dirichlet allocation. J. Mach. Learn. Res. 3, 993–1022 (2003)MATH
18.
Zurück zum Zitat Brys, T., Drugan, M.M., Bosman, P.A., De Cock, M., Nowé, A.: Solving satisfiability in fuzzy logics by mixing CMA-ES. In: Proceedings of the 15th Annual Conference on Genetic and Evolutionary Computation, GECCO 2013, pp. 1125–1132. ACM, New York (2013) Brys, T., Drugan, M.M., Bosman, P.A., De Cock, M., Nowé, A.: Solving satisfiability in fuzzy logics by mixing CMA-ES. In: Proceedings of the 15th Annual Conference on Genetic and Evolutionary Computation, GECCO 2013, pp. 1125–1132. ACM, New York (2013)
19.
Zurück zum Zitat Richardson, M., Domingos, P.: Markov logic networks. Mach. Learn. 62, 107–136 (2006)CrossRef Richardson, M., Domingos, P.: Markov logic networks. Mach. Learn. 62, 107–136 (2006)CrossRef
20.
Zurück zum Zitat Tieleman, T., Hinton, G.: Lecture 6.5 - RMSProp, COURSERA: Neural networks for machine learning. Technical report (2012) Tieleman, T., Hinton, G.: Lecture 6.5 - RMSProp, COURSERA: Neural networks for machine learning. Technical report (2012)
21.
Zurück zum Zitat Wang, J., Domingos, P.M.: Hybrid markov logic networks. In: AAAI, pp. 1106–1111 (2008) Wang, J., Domingos, P.M.: Hybrid markov logic networks. In: AAAI, pp. 1106–1111 (2008)
22.
Zurück zum Zitat Nath, A., Domingos, P.M.: Learning relational sum-product networks. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, January 25–30, 2015, Austin, Texas, USA, pp. 2878–2886 (2015) Nath, A., Domingos, P.M.: Learning relational sum-product networks. In: Proceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence, January 25–30, 2015, Austin, Texas, USA, pp. 2878–2886 (2015)
23.
Zurück zum Zitat Kosko, B.: Neural Networks and Fuzzy Systems: A Dynamical Systems Approach to Machine Intelligence. Prentice-Hall Inc., Upper Saddle River (1992)MATH Kosko, B.: Neural Networks and Fuzzy Systems: A Dynamical Systems Approach to Machine Intelligence. Prentice-Hall Inc., Upper Saddle River (1992)MATH
24.
Zurück zum Zitat Milch, B., Marthi, B., Russell, S.J., Sontag, D., Ong, D.L., Kolobov, A.: BLOG: probabilistic models with unknown objects. In: IJCAI 2005, pp. 1352–1359 (2005) Milch, B., Marthi, B., Russell, S.J., Sontag, D., Ong, D.L., Kolobov, A.: BLOG: probabilistic models with unknown objects. In: IJCAI 2005, pp. 1352–1359 (2005)
25.
Zurück zum Zitat Raedt, L.D., Kersting, K., Natarajan, S., Poole, D.: Statistical Relational Artificial Intelligence: Logic, Probability, and Computation. Synthesis Lectures on Artificial Intelligence and Machine Learning. Morgan & Claypool, San Rafael (2016)MATH Raedt, L.D., Kersting, K., Natarajan, S., Poole, D.: Statistical Relational Artificial Intelligence: Logic, Probability, and Computation. Synthesis Lectures on Artificial Intelligence and Machine Learning. Morgan & Claypool, San Rafael (2016)MATH
26.
Zurück zum Zitat Muggleton, S.H., Lin, D., Tamaddoni-Nezhad, A.: Meta-interpretive learning of higher-order dyadic datalog: predicate invention revisited. Mach. Learn. 100, 49–73 (2015)MathSciNetCrossRefMATH Muggleton, S.H., Lin, D., Tamaddoni-Nezhad, A.: Meta-interpretive learning of higher-order dyadic datalog: predicate invention revisited. Mach. Learn. 100, 49–73 (2015)MathSciNetCrossRefMATH
27.
Zurück zum Zitat França, M.V.M., Zaverucha, G., d’Avila Garcez, A.S.: Fast relational learning using bottom clause propositionalization with artificial neural networks. Mach. Learn. 94, 81–104 (2014)MathSciNetCrossRef França, M.V.M., Zaverucha, G., d’Avila Garcez, A.S.: Fast relational learning using bottom clause propositionalization with artificial neural networks. Mach. Learn. 94, 81–104 (2014)MathSciNetCrossRef
Metadaten
Titel
Learning and Reasoning with Logic Tensor Networks
verfasst von
Luciano Serafini
Artur S. d’Avila Garcez
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-49130-1_25