Skip to main content

2017 | OriginalPaper | Buchkapitel

10. Semantic Vector Spaces for Broadening Consideration of Consequences

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Reasoning systems with too simple a model of the world and human intent are unable to consider potential negative side effects of their actions and modify their plans to avoid them (e.g., avoiding potential errors). However, hand-encoding the enormous and subtle body of facts that constitutes common sense into a knowledge base has proved too difficult despite decades of work. Distributed semantic vector spaces learned from large text corpora, on the other hand, can learn representations that capture shades of meaning of common-sense concepts and perform analogical and associational reasoning in ways that knowledge bases are too rigid to perform, by encoding concepts and the relations between them as geometric structures. These have, however, the disadvantage of being unreliable, poorly understood, and biased in their view of the world by the source material. This chapter will discuss how these approaches may be brought together in a way that combines the best properties of each for understanding the world and human intentions in a richer way.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., and Mané, D. (2016). Concrete problems in AI safety. arXiv preprint arXiv:1606.06565. Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., and Mané, D. (2016). Concrete problems in AI safety. arXiv preprint arXiv:1606.06565.
Zurück zum Zitat Ba, J. L., Kiros, J. R., and Hinton, G. E. (2016). Layer normalization. arXiv preprint arXiv:1607.06450. Ba, J. L., Kiros, J. R., and Hinton, G. E. (2016). Layer normalization. arXiv preprint arXiv:1607.06450.
Zurück zum Zitat Blouw, P and Eliasmith, C. (2005) A neurally plausible encoding of word order information into a semantic vector space. 35th Annual conference of the cognitive science society Vol. 1910. Blouw, P and Eliasmith, C. (2005) A neurally plausible encoding of word order information into a semantic vector space. 35th Annual conference of the cognitive science society Vol. 1910.
Zurück zum Zitat Dash, D., Voortman, M., and De Jongh, M. (2013, August). Sequences of Mechanisms for Causal Reasoning in Artificial Intelligence. In IJCAI Dash, D., Voortman, M., and De Jongh, M. (2013, August). Sequences of Mechanisms for Causal Reasoning in Artificial Intelligence. In IJCAI
Zurück zum Zitat Deerwester, S., et al, Improving Information Retrieval with Latent Semantic Indexing, Proceedings of the 51st Annual Meeting of the American Society for Information Science 25, 1988, pp. 36–40. Deerwester, S., et al, Improving Information Retrieval with Latent Semantic Indexing, Proceedings of the 51st Annual Meeting of the American Society for Information Science 25, 1988, pp. 36–40.
Zurück zum Zitat Dietterich, T. G., and Horvitz, E. J. (2015). Rise of concerns about AI: reflections and directions. Communications of the ACM, 58(10), 38-40. Dietterich, T. G., and Horvitz, E. J. (2015). Rise of concerns about AI: reflections and directions. Communications of the ACM, 58(10), 38-40.
Zurück zum Zitat Faruqui, M., Dodge, J., Jauhar, S. K., Dyer, C., Hovy, E., and Smith, N. A. (2014). Retrofitting word vectors to semantic lexicons. arXiv preprint arXiv:1411.4166. Faruqui, M., Dodge, J., Jauhar, S. K., Dyer, C., Hovy, E., and Smith, N. A. (2014). Retrofitting word vectors to semantic lexicons. arXiv preprint arXiv:1411.4166.
Zurück zum Zitat Hawkins, J., and Blakeslee, S. (2007). On intelligence. Macmillan. Hawkins, J., and Blakeslee, S. (2007). On intelligence. Macmillan.
Zurück zum Zitat Hayes, P. J. (1978). The naive physics manifesto. Institut pour les études sémantiques et cognitives/Université de Genève. Hayes, P. J. (1978). The naive physics manifesto. Institut pour les études sémantiques et cognitives/Université de Genève.
Zurück zum Zitat Hinton, G. E. (1984). Distributed representations. Hinton, G. E. (1984). Distributed representations.
Zurück zum Zitat Hofstadter, D. (1985). Metamagical themas: Questing for the essence of mind and pattern. Basic books. Hofstadter, D. (1985). Metamagical themas: Questing for the essence of mind and pattern. Basic books.
Zurück zum Zitat Hofstadter, D, and Sander, E. Surfaces and Essences. Basic Books, 2013. Hofstadter, D, and Sander, E. Surfaces and Essences. Basic Books, 2013.
Zurück zum Zitat Huth, A. G., Nishimoto, S., Vu, A. T., and Gallant, J. L. (2012). A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron, 76(6), 1210-1224. Huth, A. G., Nishimoto, S., Vu, A. T., and Gallant, J. L. (2012). A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron, 76(6), 1210-1224.
Zurück zum Zitat Kanerva, P. (1988). Sparse distributed memory. MIT press. Kanerva, P. (1988). Sparse distributed memory. MIT press.
Zurück zum Zitat Kiros, R., Zhu, Y., Salakhutdinov, R. R., Zemel, R., Urtasun, R., Torralba, A., and Fidler, S. (2015). Skip-thought vectors. In Advances in neural information processing systems (pp. 3294-3302). Kiros, R., Zhu, Y., Salakhutdinov, R. R., Zemel, R., Urtasun, R., Torralba, A., and Fidler, S. (2015). Skip-thought vectors. In Advances in neural information processing systems (pp. 3294-3302).
Zurück zum Zitat Leech, R., Mareschal, D., and Cooper, R. P. (2008). Analogy as relational priming: A developmental and computational perspective on the origins of a complex cognitive skill. Behavioral and Brain Sciences, 31(04), 357-378. Leech, R., Mareschal, D., and Cooper, R. P. (2008). Analogy as relational priming: A developmental and computational perspective on the origins of a complex cognitive skill. Behavioral and Brain Sciences, 31(04), 357-378.
Zurück zum Zitat Lenat, D. B., Prakash, M., & Shepherd, M. (1985). CYC: Using common sense knowledge to overcome brittleness and knowledge acquisition bottlenecks. AI magazine, 6(4), 65. Lenat, D. B., Prakash, M., & Shepherd, M. (1985). CYC: Using common sense knowledge to overcome brittleness and knowledge acquisition bottlenecks. AI magazine, 6(4), 65.
Zurück zum Zitat Levy, O., and Goldberg, Y. (2014). Dependency-Based Word Embeddings. In ACL (2) (pp. 302-308). Levy, O., and Goldberg, Y. (2014). Dependency-Based Word Embeddings. In ACL (2) (pp. 302-308).
Zurück zum Zitat Lin, Y., Liu, Z., Luan, H., Sun, M., Rao, S., and Liu, S. (2015). Modeling relation paths for representation learning of knowledge bases. arXiv preprint arXiv:1506.00379. Lin, Y., Liu, Z., Luan, H., Sun, M., Rao, S., and Liu, S. (2015). Modeling relation paths for representation learning of knowledge bases. arXiv preprint arXiv:1506.00379.
Zurück zum Zitat Neelakantan, A., Roth, B., and Mc-Callum, A. (2015, March). Compositional vector space models for knowledge base inference. In 2015 AAAI Spring Symposium Series. Neelakantan, A., Roth, B., and Mc-Callum, A. (2015, March). Compositional vector space models for knowledge base inference. In 2015 AAAI Spring Symposium Series.
Zurück zum Zitat Reed, S. E., Zhang, Y., Zhang, Y., and Lee, H. (2015). Deep visual analogy-making. In Advances in Neural Information Processing Systems (pp. 1252-1260). Reed, S. E., Zhang, Y., Zhang, Y., and Lee, H. (2015). Deep visual analogy-making. In Advances in Neural Information Processing Systems (pp. 1252-1260).
Zurück zum Zitat Rei, M., and Briscoe, T. (2014, June). Looking for Hyponyms in Vector Space. In CoNLL (pp. 68-77). Rei, M., and Briscoe, T. (2014, June). Looking for Hyponyms in Vector Space. In CoNLL (pp. 68-77).
Zurück zum Zitat Rissman, J., and Wagner, A. D. (2012). Distributed representations in memory: insights from functional brain imaging. Annual review of psychology, 63, 101. Rissman, J., and Wagner, A. D. (2012). Distributed representations in memory: insights from functional brain imaging. Annual review of psychology, 63, 101.
Zurück zum Zitat Rothe, S., and Schütze, H. (2015). Autoextend: Extending word embeddings to embeddings for synsets and lexemes. arXiv preprint arXiv:1507.01127. Rothe, S., and Schütze, H. (2015). Autoextend: Extending word embeddings to embeddings for synsets and lexemes. arXiv preprint arXiv:1507.01127.
Zurück zum Zitat Sadeghi, F., Zitnick, C. L., and Farhadi, A. (2015). Visalogy: Answering visual analogy questions. In Advances in Neural Information Processing Systems (pp. 1882-1890). Sadeghi, F., Zitnick, C. L., and Farhadi, A. (2015). Visalogy: Answering visual analogy questions. In Advances in Neural Information Processing Systems (pp. 1882-1890).
Zurück zum Zitat Speer, R., Havasi, C., and Lieberman, H. (2008, July). AnalogySpace: Reducing the Dimensionality of Common Sense Knowledge. In AAAI (Vol. 8, pp. 548-553). Speer, R., Havasi, C., and Lieberman, H. (2008, July). AnalogySpace: Reducing the Dimensionality of Common Sense Knowledge. In AAAI (Vol. 8, pp. 548-553).
Zurück zum Zitat Turney, P. D. (2006). Similarity of semantic relations. Computational Linguistics, 32(3), 379-416. Turney, P. D. (2006). Similarity of semantic relations. Computational Linguistics, 32(3), 379-416.
Zurück zum Zitat Upchurch, P., Snavely, N., and Bala, K. (2016). From A to Z: Supervised Transfer of Style and Content Using Deep Neural Network Generators. arXiv preprint arXiv:1603.02003. Upchurch, P., Snavely, N., and Bala, K. (2016). From A to Z: Supervised Transfer of Style and Content Using Deep Neural Network Generators. arXiv preprint arXiv:1603.02003.
Zurück zum Zitat Vosniadou, S., and Ortony, A. (1989). Similarity and analogical reasoning. Cambridge University Press. Vosniadou, S., and Ortony, A. (1989). Similarity and analogical reasoning. Cambridge University Press.
Zurück zum Zitat Wang, Z., Zhang, J., Feng, J., and Chen, Z. (2014, October). Knowledge Graph and Text Jointly Embedding. In EMNLP (pp. 1591-1601). Wang, Z., Zhang, J., Feng, J., and Chen, Z. (2014, October). Knowledge Graph and Text Jointly Embedding. In EMNLP (pp. 1591-1601).
Metadaten
Titel
Semantic Vector Spaces for Broadening Consideration of Consequences
verfasst von
Douglas Summers-Stay
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-59719-5_10