Top

Published in:

2018 | OriginalPaper | Chapter

Lexical Analysis of Serbian with Conditional Random Fields and Large-Coverage Finite-State Resources

Authors : Mathieu Constant, Cvetana Krstev, Duško Vitas

Published in: Human Language Technology. Challenges for Computer Science and Linguistics

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

This article describes a joint approach to lexical tagging in Serbian, combining three fundamental natural language processing tasks: part-of-speech tagging, compound and named entity recognition. The proposed system relies on conditional random fields that are trained from a newly released annotated corpus and finite-state lexical resources used in an existing symbolic Serbian tagging system. Experimental results show that a joint strategy is more robust than pipeline ones and that the use of lexical resources has a significant positive impact on tagging, in particular on out-of-domain texts.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

previous chapter Exploiting Wikipedia-Based Information-Rich Taxonomy for Extracting Location, Creator and Membership Related Information for ConceptNet Expansion

next chapter Improving Chunker Performance Using a Web-Based Semi-automatic Training Data Analysis Tool

For the purpose of this article, we define a compound as a contiguous sequence of tokens that has a non-compositional meaning. Compounds form a subclass of multiword expressions. We exclude multiword named entities from it.

Note that these tasks can also be jointly combined with parsing: e.g. CR [6, 10, 18] or NER [9].

The Unitex software system: http://unitexgramlab.org/.

The disambiguation was done by a special tool integrated into Unitex system that facilitates manual disambiguation http://tln.li.univ-tours.fr/Tln_Colloques/Tln_JUnitex2014/Communications/Vitas.pdf.

Note that it does not correspond to a strict combination of the three types of annotations, as we do not tag the internal elements of the multiword lexical units.

Agić, v., Ljubešić, N., Merkler, D.: Lemmatization and Morphosyntactic Tagging of Croatian and Serbian. In: Proceedings of the 4th Biennial International Workshop on Balto-Slavic Natural Language Processing, pp. 48–57. Association for Computational Linguistics, Sofia, Bulgaria, August 2013

Blunsom, P., Baldwin, T.: Multilingual Deep Lexical Acquisition for HPSGs via Supertagging. In: Proceedings of EMNLP 2006, Sydney, pp. 164–171 (2006)

Collobert, R., Weston, J., Bottou, L., Karlen, M., Kavukcuoglu, K., Kuksa, P.: Natural language processing (Almost) from Scratch. J. Mach. Learn. Res. 12, 2493–2537 (2011)MATH

Constant, M., Sigogne, A.: MWU-aware part-of-speech tagging with a CRF model and lexical resources. In: Proceedings of the Workshop on Multiword Expressions: from Parsing and Generation to the Real World (MWE 2011), pp. 49–56 (2011)

Constant, M., Sigogne, A., Watrin, P.: Discriminative strategies to integrate multiword expression recognition and parsing. In: Proceedings of the 50th Annual Meeting of the Association for Computational Linguistics (ACL 2012), pp. 204–212 (2012)

Constant, M., Tellier, I.: Evaluating the impact of external lexical resources into a CRF-based multiword segmenter and part-of-speech tagger. In: Proceedings of LREC 2012, Istanbul, Turkey (2012)

Courtois, B., Silberztein, M.: Dictionnaires électroniques du français. Larousse, Paris (1990)

Denis, P., Sagot, B.: Coupling an annotated corpus and a morphosyntactic lexicon for state-of-the-art POS tagging with less human effort. In: Proceedings of the 23rd Pacific Asia Conference on Language, Information and Computation (PACLIC 2009), Hong Kong (2009)

Finkel, J.R., Manning, C.D.: Joint parsing and named entity recognition. In: Proceedings of the conference of the North American Chapter of the Association for Computational Linguistics (NAACL 2009) (2009)

10.

Green, S., de Marneffe, M.C., Bauer, J., Manning, C.D.: Multiword expression identification with tree substitution grammars: a parsing tour de force with French. In: Proceedings of the conference on Empirical Method for Natural Language Processing (EMNLP 2011) (2011)

11.

Gross, M.: The use of finite automata in the lexical representation of natural language. In: Gross, M., Perrin, D. (eds.) LITP 1987. LNCS, vol. 377, pp. 34–50. Springer, Heidelberg (1989). https://doi.org/10.1007/3-540-51465-1_3CrossRef

12.

Krstev, C., Obradović, I., Utvić, M., Vitas, D.: A system for named entity recognition based on local grammars. J. Log. Comput. 24(2), 473–489 (2014)CrossRef

13.

Krstev, C., Vitas, D.: Finate state transducers for recognition and generation of compound words. In: Erjavec, T., Žganec Gros, J. (eds.) Proceedings of the 5th Slovenian and 1st International Conference Language Technologies. pp. 192–197. Institut “Jožef Stefan” (2006)

14.

Lafferty, J., McCallum, A., Pereira, F.: Conditional random Fields: probabilistic models for segmenting and labeling sequence data. In: Proceedings of the Eighteenth International Conference on Machine Learning (ICML 2001), pp. 282–289 (2001)

15.

Legrand, J., Collobert, R.: Phrase representations for multiword expressions. In: Proceedings of the 12th Workshop on Multiword Expressions, pp. 67–71. Association for Computational Linguistics, Berlin, Germany, August 2016

16.

Maurel, D., Friburger, N., Antoine, J.Y., Eshkol, I., Nouvel, D., et al.: Cascades de transducteurs autour de la reconnaissance des entités nommées. Traitement Automatique des Langues 52(1), 69–96 (2011)

17.

McCallum, A., Li, W.: Early results for named entity recognition with conditional random fields, feature induction and web-enhanced lexicons. In: Proceedings of the Seventh Conference on Natural Language Learning, CoNLL 2003, Held in cooperation with HLT-NAACL 2003, Edmonton, Canada, May 31 - June 1, 2003, pp. 188–191 (2003)

18.

Nivre, J., Nilsson, J.: Multiword units in syntactic parsing. In: Proceedings of Methodologies and Evaluation of Multiword Units in Real-World Applications (MEMURA) (2004)

19.

Savary, A., Ramisch, C., Cordeiro, S., Sangati, F., Vincze, V., QasemiZadeh, B., Candito, M., Cap, F., Giouli, V., Stoyanova, I., Doucet, A.: The PARSEME shared task on automatic identification of verbal multiword expressions. In: Proceedings of EACL 2017 Workshop on MWEs, Valencia, pp. 31–47, April 2017

20.

Sečujski, M., Delić, V.: A software tool for semi-automatic part-of-speech tagging and sentence accentuation in Serbian language. In: Proceedings of IS-LTC (2006)

21.

Shigeto, Y., Azuma, A., Hisamoto, S., Kondo, S., Kouse, T., Sakaguchi, K., Yoshimoto, A., Yung, F., Matsumoto, Y.: Construction of English MWE dictionary and its application to POS tagging. In: Proceedings of the NAACL/HLT Workshop on MWEs, Atlanta, GA, pp. 139–144 (2013)

22.

Tjong Kim Sang, E.F., De Meulder, F.: Introduction to the CoNLL-2003 shared task: language-independent named entity recognition. In: Daelemans, W., Osborne, M. (eds.) Proceedings of CoNLL-2003, Edmonton, Canada, pp. 142–147 (2003)

23.

Tufiş, D., Koeva, S., Erjavec, T., Gavrilidou, M., Krstev, C.: Building language resources and translation models for machine translation focused on south slavic and balkan languages. In: Proceedings of the 6th International Conference Formal Approaches to South Slavic and Balkan Languages (FASSBL 2008), Dubrovnik, Croatia, pp. 145–152, September 2008

24.

Utvić, M.: Annotating the corpus of contemporary Serbian. INFOtheca 12(2), 36a–47a (2011)

25.

Vincze, V., Nagy, I., Berend, G.: Multiword expressions and named entities in the Wiki50 corpus. In: Proceedings of the Conference on Recent Advances in Natural Language Processing (RANLP 2011), pp. 289–295 (2011)

26.

Vitas, D., Krstev, C.: Processing of Corpora of Serbian Using Electronic Dictionaries. Prace Filologiczne LXIII, 279–292 (2012)

Title: Lexical Analysis of Serbian with Conditional Random Fields and Large-Coverage Finite-State Resources
Authors: Mathieu Constant
Cvetana Krstev
Duško Vitas
Publisher: Springer International Publishing
Book: Human Language Technology. Challenges for Computer Science and Linguistics
Print ISBN: 978-3-319-93781-6

Electronic ISBN: 978-3-319-93782-3

Copyright Year: 2018
DOI: https://doi.org/10.1007/978-3-319-93782-3_20

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Premium Partner