Skip to main content

2016 | OriginalPaper | Buchkapitel

Representation of Relations by Planes in Neural Network Language Model

verfasst von : Takuma Ebisu, Ryutaro Ichise

Erschienen in: Neural Information Processing

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Whole brain architecture (WBA) which uses neural networks to imitate a human brain is attracting increased attention as a promising way to achieve artificial general intelligence, and distributed vector representations of words is becoming recognized as the best way to connect neural networks and knowledge. Distributed representations of words have played a wide range of roles in natural language processing, and they have become increasingly important because of their ability to capture a large amount of syntactic and lexical meanings or relationships. Relation vectors are used to represent relations between words, but this approach has some problems; some relations cannot be easily defined, for example, sibling relations, parent-child relations, and many-to-one relations. To deal with these problems, we have created a novel way of representing relations: we represent relations by planes instead of by vectors, and this increases by more than 10 % the accuracy of predicting the relation.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
2.
Zurück zum Zitat Bengio, Y., Ducharme, R., Vincent, P., Jauvin, C.: A neural probabilistic language model. J. Mach. Learn. Res. 3, 1137–1155 (2003)MATH Bengio, Y., Ducharme, R., Vincent, P., Jauvin, C.: A neural probabilistic language model. J. Mach. Learn. Res. 3, 1137–1155 (2003)MATH
3.
Zurück zum Zitat Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. In: Proceedings of Workshop at International Conference on Learning Representations (2013) Mikolov, T., Chen, K., Corrado, G., Dean, J.: Efficient estimation of word representations in vector space. In: Proceedings of Workshop at International Conference on Learning Representations (2013)
4.
Zurück zum Zitat Jauhar, S.K., Dyer, C., Hovy, E.: Ontologically Grounded multi-sense representation learning for semantic vector space models. In: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics, pp. 683–693, Association for Computational Linguistics (2015) Jauhar, S.K., Dyer, C., Hovy, E.: Ontologically Grounded multi-sense representation learning for semantic vector space models. In: Proceedings of the 2015 Conference of the North American Chapter of the Association for Computational Linguistics, pp. 683–693, Association for Computational Linguistics (2015)
5.
Zurück zum Zitat Neelakantan, A., Shankar, J., Passos, A., and McCallum, A.: Efficient Non-Parametric Estimation of Multiple Embeddings per Word in Vector Space, arXiv preprint arXiv:1504.06662 (2015) Neelakantan, A., Shankar, J., Passos, A., and McCallum, A.: Efficient Non-Parametric Estimation of Multiple Embeddings per Word in Vector Space, arXiv preprint arXiv:​1504.​06662 (2015)
7.
Zurück zum Zitat Ichise, R., Arakawa, N.: Relationships Between Distributed Representation and Ontology. In: The 29th Annual Conference of the Japanese Society for Artificial Intelligence, 2I4-OS-17a-5 (2015) Ichise, R., Arakawa, N.: Relationships Between Distributed Representation and Ontology. In: The 29th Annual Conference of the Japanese Society for Artificial Intelligence, 2I4-OS-17a-5 (2015)
Metadaten
Titel
Representation of Relations by Planes in Neural Network Language Model
verfasst von
Takuma Ebisu
Ryutaro Ichise
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-46687-3_33