Anzeige
Erschienen in:
2015 | OriginalPaper | Buchkapitel
Learning Distributed Representations of Uyghur Words and Morphemes
verfasst von : Halidanmu Abudukelimu, Yang Liu, Xinxiong Chen, Maosong Sun, Abudoukelimu Abulizi
Erschienen in: Chinese Computational Linguistics and Natural Language Processing Based on Naturally Annotated Big Data
Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.
Wählen Sie Textabschnitte aus um mit Künstlicher Intelligenz passenden Patente zu finden. powered by
Markieren Sie Textabschnitte, um KI-gestützt weitere passende Inhalte zu finden. powered by
Abstract
While distributed representations have proven to be very successful in a variety of NLP tasks, learning distributed representations for agglutinative languages such as Uyghur still faces a major challenge: most words are composed of many morphemes and occur only once on the training data. To address the data sparsity problem, we propose an approach to learn distributed representations of Uyghur words and morphemes from unlabeled data. The central idea is to treat morphemes rather than words as the basic unit of representation learning. We annotate a Uyghur word similarity dataset and show that our approach achieves significant improvements over CBOW, a state-of-the-art model for computing vector representations of words.