Skip to main content
Top

2017 | OriginalPaper | Chapter

10. Semantic Vector Spaces for Broadening Consideration of Consequences

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Reasoning systems with too simple a model of the world and human intent are unable to consider potential negative side effects of their actions and modify their plans to avoid them (e.g., avoiding potential errors). However, hand-encoding the enormous and subtle body of facts that constitutes common sense into a knowledge base has proved too difficult despite decades of work. Distributed semantic vector spaces learned from large text corpora, on the other hand, can learn representations that capture shades of meaning of common-sense concepts and perform analogical and associational reasoning in ways that knowledge bases are too rigid to perform, by encoding concepts and the relations between them as geometric structures. These have, however, the disadvantage of being unreliable, poorly understood, and biased in their view of the world by the source material. This chapter will discuss how these approaches may be brought together in a way that combines the best properties of each for understanding the world and human intentions in a richer way.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
go back to reference Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., and Mané, D. (2016). Concrete problems in AI safety. arXiv preprint arXiv:1606.06565. Amodei, D., Olah, C., Steinhardt, J., Christiano, P., Schulman, J., and Mané, D. (2016). Concrete problems in AI safety. arXiv preprint arXiv:1606.06565.
go back to reference Ba, J. L., Kiros, J. R., and Hinton, G. E. (2016). Layer normalization. arXiv preprint arXiv:1607.06450. Ba, J. L., Kiros, J. R., and Hinton, G. E. (2016). Layer normalization. arXiv preprint arXiv:1607.06450.
go back to reference Blouw, P and Eliasmith, C. (2005) A neurally plausible encoding of word order information into a semantic vector space. 35th Annual conference of the cognitive science society Vol. 1910. Blouw, P and Eliasmith, C. (2005) A neurally plausible encoding of word order information into a semantic vector space. 35th Annual conference of the cognitive science society Vol. 1910.
go back to reference Dash, D., Voortman, M., and De Jongh, M. (2013, August). Sequences of Mechanisms for Causal Reasoning in Artificial Intelligence. In IJCAI Dash, D., Voortman, M., and De Jongh, M. (2013, August). Sequences of Mechanisms for Causal Reasoning in Artificial Intelligence. In IJCAI
go back to reference Deerwester, S., et al, Improving Information Retrieval with Latent Semantic Indexing, Proceedings of the 51st Annual Meeting of the American Society for Information Science 25, 1988, pp. 36–40. Deerwester, S., et al, Improving Information Retrieval with Latent Semantic Indexing, Proceedings of the 51st Annual Meeting of the American Society for Information Science 25, 1988, pp. 36–40.
go back to reference Dietterich, T. G., and Horvitz, E. J. (2015). Rise of concerns about AI: reflections and directions. Communications of the ACM, 58(10), 38-40. Dietterich, T. G., and Horvitz, E. J. (2015). Rise of concerns about AI: reflections and directions. Communications of the ACM, 58(10), 38-40.
go back to reference Faruqui, M., Dodge, J., Jauhar, S. K., Dyer, C., Hovy, E., and Smith, N. A. (2014). Retrofitting word vectors to semantic lexicons. arXiv preprint arXiv:1411.4166. Faruqui, M., Dodge, J., Jauhar, S. K., Dyer, C., Hovy, E., and Smith, N. A. (2014). Retrofitting word vectors to semantic lexicons. arXiv preprint arXiv:1411.4166.
go back to reference Hawkins, J., and Blakeslee, S. (2007). On intelligence. Macmillan. Hawkins, J., and Blakeslee, S. (2007). On intelligence. Macmillan.
go back to reference Hayes, P. J. (1978). The naive physics manifesto. Institut pour les études sémantiques et cognitives/Université de Genève. Hayes, P. J. (1978). The naive physics manifesto. Institut pour les études sémantiques et cognitives/Université de Genève.
go back to reference Hinton, G. E. (1984). Distributed representations. Hinton, G. E. (1984). Distributed representations.
go back to reference Hofstadter, D. (1985). Metamagical themas: Questing for the essence of mind and pattern. Basic books. Hofstadter, D. (1985). Metamagical themas: Questing for the essence of mind and pattern. Basic books.
go back to reference Hofstadter, D, and Sander, E. Surfaces and Essences. Basic Books, 2013. Hofstadter, D, and Sander, E. Surfaces and Essences. Basic Books, 2013.
go back to reference Huth, A. G., Nishimoto, S., Vu, A. T., and Gallant, J. L. (2012). A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron, 76(6), 1210-1224. Huth, A. G., Nishimoto, S., Vu, A. T., and Gallant, J. L. (2012). A continuous semantic space describes the representation of thousands of object and action categories across the human brain. Neuron, 76(6), 1210-1224.
go back to reference Kanerva, P. (1988). Sparse distributed memory. MIT press. Kanerva, P. (1988). Sparse distributed memory. MIT press.
go back to reference Kiros, R., Zhu, Y., Salakhutdinov, R. R., Zemel, R., Urtasun, R., Torralba, A., and Fidler, S. (2015). Skip-thought vectors. In Advances in neural information processing systems (pp. 3294-3302). Kiros, R., Zhu, Y., Salakhutdinov, R. R., Zemel, R., Urtasun, R., Torralba, A., and Fidler, S. (2015). Skip-thought vectors. In Advances in neural information processing systems (pp. 3294-3302).
go back to reference Leech, R., Mareschal, D., and Cooper, R. P. (2008). Analogy as relational priming: A developmental and computational perspective on the origins of a complex cognitive skill. Behavioral and Brain Sciences, 31(04), 357-378. Leech, R., Mareschal, D., and Cooper, R. P. (2008). Analogy as relational priming: A developmental and computational perspective on the origins of a complex cognitive skill. Behavioral and Brain Sciences, 31(04), 357-378.
go back to reference Lenat, D. B., Prakash, M., & Shepherd, M. (1985). CYC: Using common sense knowledge to overcome brittleness and knowledge acquisition bottlenecks. AI magazine, 6(4), 65. Lenat, D. B., Prakash, M., & Shepherd, M. (1985). CYC: Using common sense knowledge to overcome brittleness and knowledge acquisition bottlenecks. AI magazine, 6(4), 65.
go back to reference Levy, O., and Goldberg, Y. (2014). Dependency-Based Word Embeddings. In ACL (2) (pp. 302-308). Levy, O., and Goldberg, Y. (2014). Dependency-Based Word Embeddings. In ACL (2) (pp. 302-308).
go back to reference Lin, Y., Liu, Z., Luan, H., Sun, M., Rao, S., and Liu, S. (2015). Modeling relation paths for representation learning of knowledge bases. arXiv preprint arXiv:1506.00379. Lin, Y., Liu, Z., Luan, H., Sun, M., Rao, S., and Liu, S. (2015). Modeling relation paths for representation learning of knowledge bases. arXiv preprint arXiv:1506.00379.
go back to reference Neelakantan, A., Roth, B., and Mc-Callum, A. (2015, March). Compositional vector space models for knowledge base inference. In 2015 AAAI Spring Symposium Series. Neelakantan, A., Roth, B., and Mc-Callum, A. (2015, March). Compositional vector space models for knowledge base inference. In 2015 AAAI Spring Symposium Series.
go back to reference Reed, S. E., Zhang, Y., Zhang, Y., and Lee, H. (2015). Deep visual analogy-making. In Advances in Neural Information Processing Systems (pp. 1252-1260). Reed, S. E., Zhang, Y., Zhang, Y., and Lee, H. (2015). Deep visual analogy-making. In Advances in Neural Information Processing Systems (pp. 1252-1260).
go back to reference Rei, M., and Briscoe, T. (2014, June). Looking for Hyponyms in Vector Space. In CoNLL (pp. 68-77). Rei, M., and Briscoe, T. (2014, June). Looking for Hyponyms in Vector Space. In CoNLL (pp. 68-77).
go back to reference Rissman, J., and Wagner, A. D. (2012). Distributed representations in memory: insights from functional brain imaging. Annual review of psychology, 63, 101. Rissman, J., and Wagner, A. D. (2012). Distributed representations in memory: insights from functional brain imaging. Annual review of psychology, 63, 101.
go back to reference Rothe, S., and Schütze, H. (2015). Autoextend: Extending word embeddings to embeddings for synsets and lexemes. arXiv preprint arXiv:1507.01127. Rothe, S., and Schütze, H. (2015). Autoextend: Extending word embeddings to embeddings for synsets and lexemes. arXiv preprint arXiv:1507.01127.
go back to reference Sadeghi, F., Zitnick, C. L., and Farhadi, A. (2015). Visalogy: Answering visual analogy questions. In Advances in Neural Information Processing Systems (pp. 1882-1890). Sadeghi, F., Zitnick, C. L., and Farhadi, A. (2015). Visalogy: Answering visual analogy questions. In Advances in Neural Information Processing Systems (pp. 1882-1890).
go back to reference Speer, R., Havasi, C., and Lieberman, H. (2008, July). AnalogySpace: Reducing the Dimensionality of Common Sense Knowledge. In AAAI (Vol. 8, pp. 548-553). Speer, R., Havasi, C., and Lieberman, H. (2008, July). AnalogySpace: Reducing the Dimensionality of Common Sense Knowledge. In AAAI (Vol. 8, pp. 548-553).
go back to reference Turney, P. D. (2006). Similarity of semantic relations. Computational Linguistics, 32(3), 379-416. Turney, P. D. (2006). Similarity of semantic relations. Computational Linguistics, 32(3), 379-416.
go back to reference Upchurch, P., Snavely, N., and Bala, K. (2016). From A to Z: Supervised Transfer of Style and Content Using Deep Neural Network Generators. arXiv preprint arXiv:1603.02003. Upchurch, P., Snavely, N., and Bala, K. (2016). From A to Z: Supervised Transfer of Style and Content Using Deep Neural Network Generators. arXiv preprint arXiv:1603.02003.
go back to reference Vosniadou, S., and Ortony, A. (1989). Similarity and analogical reasoning. Cambridge University Press. Vosniadou, S., and Ortony, A. (1989). Similarity and analogical reasoning. Cambridge University Press.
go back to reference Wang, Z., Zhang, J., Feng, J., and Chen, Z. (2014, October). Knowledge Graph and Text Jointly Embedding. In EMNLP (pp. 1591-1601). Wang, Z., Zhang, J., Feng, J., and Chen, Z. (2014, October). Knowledge Graph and Text Jointly Embedding. In EMNLP (pp. 1591-1601).
Metadata
Title
Semantic Vector Spaces for Broadening Consideration of Consequences
Author
Douglas Summers-Stay
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-59719-5_10

Premium Partner