Skip to main content
Top

2019 | OriginalPaper | Chapter

Programmatic Link Grammar Induction for Unsupervised Language Learning

Authors : Alex Glushchenko, Andres Suarez, Anton Kolonin, Ben Goertzel, Oleg Baskov

Published in: Artificial General Intelligence

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Although natural (i.e. human) languages do not seem to follow a strictly formal grammar, their structure analysis and generation can be approximated by one. Having such a grammar is an important tool for programmatic language understanding. Due to the huge number of natural languages and their variations, processing tools that rely on human intervention are available only for the most popular ones. We explore the problem of unsupervisedly inducing a formal grammar for any language, using the Link Grammar paradigm, from unannotated parses also obtained without supervision from an input corpus. The details of our state-of-the-art grammar induction technology and its evaluation techniques are described, as well as preliminary results of its application on both synthetic and real world text-corpora.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
3.
go back to reference Sleator, D., Temperley, D.: Parsing English with a link grammar. In: Third International Workshop on Parsing Technologies (1993) Sleator, D., Temperley, D.: Parsing English with a link grammar. In: Third International Workshop on Parsing Technologies (1993)
5.
go back to reference Wrenn, J., Stetson, P., Johnson, S.: An unsupervised machine learning approach to segmentation of clinician-entered free text. In: AMIA Annual Symposium Proceedings 2007, vol. 2007, pp. 811–815 (2007) Wrenn, J., Stetson, P., Johnson, S.: An unsupervised machine learning approach to segmentation of clinician-entered free text. In: AMIA Annual Symposium Proceedings 2007, vol. 2007, pp. 811–815 (2007)
7.
go back to reference Dupoux E: Cognitive science in the era of artificial intelligence: a roadmap for reverse-engineering the infant language-learner. arXiv:1607.08723 [cs.CL] (2018) Dupoux E: Cognitive science in the era of artificial intelligence: a roadmap for reverse-engineering the infant language-learner. arXiv:​1607.​08723 [cs.CL] (2018)
8.
go back to reference Goertzel, B., Pennachin, C., Geisweiller, N: Engineering General Intelligence, Part 2: The CogPrime Architecture for Integrative, Embodied AGI. Atlantis Press (2014) Goertzel, B., Pennachin, C., Geisweiller, N: Engineering General Intelligence, Part 2: The CogPrime Architecture for Integrative, Embodied AGI. Atlantis Press (2014)
9.
go back to reference Harwath, D., Torralba, A., Glass, J.: Unsupervised learning of spoken language with visual context. In: 30th Conference on Neural Information Processing Systems (NIPS 2016), Barcelona, Spain (2016) Harwath, D., Torralba, A., Glass, J.: Unsupervised learning of spoken language with visual context. In: 30th Conference on Neural Information Processing Systems (NIPS 2016), Barcelona, Spain (2016)
10.
go back to reference Došilović, F., Brčić, M., Hlupić, N.: Explainable artificial intelligence: a survey. In: 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) (2018) Došilović, F., Brčić, M., Hlupić, N.: Explainable artificial intelligence: a survey. In: 2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO) (2018)
11.
go back to reference Levy, O., Goldberg, Y.: Neural word embedding as implicit matrix factorization. In: NIPS 20114 Proceedings of the 27th International Conference on Neural Information Processing Systems, vol. 2, pp. 2177–2185 (2014) Levy, O., Goldberg, Y.: Neural word embedding as implicit matrix factorization. In: NIPS 20114 Proceedings of the 27th International Conference on Neural Information Processing Systems, vol. 2, pp. 2177–2185 (2014)
12.
go back to reference Church, K., Hank, P.: Word association norms, mutual information, and lexicography. Comput. Linguist. Arch. 16(1), 22–29 (1990) Church, K., Hank, P.: Word association norms, mutual information, and lexicography. Comput. Linguist. Arch. 16(1), 22–29 (1990)
15.
go back to reference Sculley, D.: Web-scale k-means clustering. In: WWW 2010 Proceedings of the 19th International Conference on World-Wide-Web, Raleigh, NC, USA, pp. 1177–1178 (2010) Sculley, D.: Web-scale k-means clustering. In: WWW 2010 Proceedings of the 19th International Conference on World-Wide-Web, Raleigh, NC, USA, pp. 1177–1178 (2010)
16.
go back to reference Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)CrossRef Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)CrossRef
17.
go back to reference Bernstein-Ratner, N.: The phonology of parent child speech. Children’s Lang. 6(3), 159–174 (1987) Bernstein-Ratner, N.: The phonology of parent child speech. Children’s Lang. 6(3), 159–174 (1987)
18.
go back to reference Brent, M., Cartwright, T.: Distributional regularity and phonotactic constraints are useful for segmentation. Cognition 61, 93–125 (1996)CrossRef Brent, M., Cartwright, T.: Distributional regularity and phonotactic constraints are useful for segmentation. Cognition 61, 93–125 (1996)CrossRef
19.
go back to reference Brent, M., Siskind, J.: The role of exposure to isolated words in early vocabulary development. Cognition 81(2), B33–B44 (2001)CrossRef Brent, M., Siskind, J.: The role of exposure to isolated words in early vocabulary development. Cognition 81(2), B33–B44 (2001)CrossRef
Metadata
Title
Programmatic Link Grammar Induction for Unsupervised Language Learning
Authors
Alex Glushchenko
Andres Suarez
Anton Kolonin
Ben Goertzel
Oleg Baskov
Copyright Year
2019
DOI
https://doi.org/10.1007/978-3-030-27005-6_11

Premium Partner