nach oben

International Journal of Speech Technology

Erschienen in:

08.10.2015

Bidirectional HMM-based Arabic POS tagging

verfasst von: Ayoub Kadim, Azzeddine Lazrek

Erschienen in: International Journal of Speech Technology | Ausgabe 2/2016

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

In this work, we will present a new concept of POS tagging that will be implemented for the Arabic language. Indeed, we will see that in Arabic there are a numerous cases where the determination of the morpho-syntactic state of a word depends on the states of the subsequent words, which represents the theoretical foundation of the approach: how to consider, in addition of the past elements, the future ones. We will then demonstrate how the POS tagging in its statistical application: the HMM, is based mainly on the past elements, and how to combine both direct and reverse taggers to tag the same sequence of words in both senses. Thus, we will propose a hypothesis for the result selecting. In the practical part, we will present, in general, the used resource and the changes made on it. Then we will explain the experiment steps and the parameters collected and presented on graphics, that we will discuss later to lead to the final conclusion.

Vorheriger Artikel A hybrid Arabic POS tagging for simple and compound morphosyntactic tags

Nächster Artikel Parsing Arabic using induced probabilistic context free grammar

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

We can say for this function of lA:لا رجلٌ قائمٌ بل رجلان lA rajulN qA}mN bal rajulAni (It is not one man who is standing but two) contrary to the first function (Ibn 'Aqil 2002).

Al Shamsi, F., & Guessoum, A. (2006, April). A hidden Markov model-based POS tagger for Arabic. Proceeding of the 8th International Conference on the Statistical Analysis of Textual Data. France, pp. 31–42. Available: http://lexicometrica.univ-paris3.fr/jadt/jadt2006/PDF/004.pdf

Albared, M., Omar, N., & Ab Aziz, M. J. (2009). Classifiers combination to Arabic morphosyntactic disambiguation. International Conference on Electrical Engineering and Informatics, 1, 163–171.

Alkhalil, I. A. (1985). Aljomal fi annahw (Sentences in the Arabic grammar) (1st ed., p. 208). Beirut: Moeassasat Arrisala.

https://static-content.springer.com/image/art%3A10.1007%2Fs10772-015-9303-7/MediaObjects/10772_2015_9303_Figf_HTML.gif

Bar-Haim, R., Sima’an, K., & Winter, Y. (2005, June). Choosing an optimal architecture for segmentation and POS-tagging of Modern Hebrew. Proceedings of the ACL workshop on computational approaches to Semitic languages. Association for Computational Linguistics, pp. 39–46. Available: http://dl.acm.org/ft_gateway.cfm?id=1621796&type=pdf&CFID=451781378&CFTOKEN=21655173

Brill, E. (2000). Part-of-speech tagging. In R. Dale, H. Moisl, & H. Somers (Eds.), Handbook of natural language processing (pp. 403–414). CRC Press: Boca Raton.

Diab, M., Hacioglu, K., & Jurafsky, D. (2007). Automated methods for processing Arabic text: From tokenization to base phrase chunking. Arabic Computational Morphology: Knowledge-based and Empirical Methods. Dordrecht: Kluwer/Springer.

Elhadj, Y. O. (2009). Statistical part-of-speech tagger for traditional Arabic texts. Journal of Computer Science, 5(11): 794–800. Available: http://thescipub.com/PDF/jcssp.2009.794.800.pdf

El-Jihad, A., Yousfi, A., & Si-Lhoussain, A. (2011). Morpho-syntactic tagging system based on the patterns words for Arabic texts. The International Arab Journal of Information Technology, 8(4): 350–354. Available: http://iajit.org/PDF/vol.8,no.4/2-763.pdf

Greene, B. B., & Rubin, G. M. (1971).Automated grammatical tagging of English.

Habash, N., Rambow, O., & Roth, R. (2009, April). MADA + TOKAN: A toolkit for Arabic tokenization, diacritization, morphological disambiguation, POS tagging, stemming and lemmatization. In Proceedings of the 2nd international conference on Arabic Language Resources and Tools (MEDAR), Cairo (pp. 102–109).

Ibn ‘Aqil. (2002). Charh Ibn Aqile eala alfiat Ben Malik (explanation of Alfiat Ibn Malik). Tahqiq Mohyi Adin AbdAlhamid, almaktaba aleasria, vol. 1, Beirut, Lebanon.

https://static-content.springer.com/image/art%3A10.1007%2Fs10772-015-9303-7/MediaObjects/10772_2015_9303_Figh_HTML.gif

Ibn Hicham, A. (2013). Moghni allabib ean kotobi al aearib (what suffices the thinker from the books of arabic traditional grammar). Almaktaba alassrya, vol. 1, Sidon, Lebanon, ISBN: 9953-400-37-7, pp.102–108.

https://static-content.springer.com/image/art%3A10.1007%2Fs10772-015-9303-7/MediaObjects/10772_2015_9303_Figg_HTML.gif

Jurafsky, D., & James, H. (2000). Speech and language processing an introduction to natural language processing, Computational Linguistics and Natural Language Processing. Prentice Hall, ISBN: 10: 0131873210, pp. 1024

Kim, J. H. (1993). Korean Part-of-Speech Tagging by Using a Fuzzy net. Proceedings of the 5th national conference on Korean Information Processing.

Klein, S., & Simmons, R. F. (1963). A computational approach to grammatical coding of English words. Journal of the ACM (JACM), 10(3), 334–347.CrossRefMATH

Kübler, S., & Mohamed, E. (2012). Part of speech tagging for Arabic. Natural Language Engineering, 18(04), 521–548.CrossRef

Maegaard, B., Choukri, K., Mokbel, C., & Yaseen, M. (2005). Language Technology for Arabic.ISBN 87-90708-15-6,© NEMLAR, Center for Sprogteknologi, University of Copenhagen, Denmark. Available: http://medar.info/The_Nemlar_Project/Publications/Arabic_LT.pdf

Mohamed, E., & Kübler, S. (2010). Arabic Part of Speech Tagging.LREC, Valetta, Malta. Available: http://cl.indiana.edu/~skuebler/papers/arab.pdf

Pasha, A., Al-Badrashiny, M., Diab, M., El Kholy, A., Eskander, R., Habash, N., Pooleery, M., Rambow, O., & Roth, R. M. (2014). Madamira: A fast, comprehensive tool for morphological analysis and disambiguation of Arabic. In Proceedings of the Language Resources and Evaluation Conference (LREC), Reykjavik, Iceland. Available: http://www.lrec-conf.org/proceedings/lrec2014/pdf/593_Paper.pdf

Raja, F., Tasharofi, S., & Oroumchian, F. (2007). Statistical POS tagging experiments on Persian text. Proceedings of the Second Workshop on Computational Approaches to Arabic Script-based Languages. California, pp. 21–22. Available: http://ro.uow.edu.au/cgi/viewcontent.cgi?article=1005&context=dubaipapers

Valli, A., & Véronis, J. (1999). Etiquetage grammatical des corpus de parole: problèmes et perspectives. Revue française de linguistique appliquée, 4(2), 113–133. Available: http://sites.univ-provence.fr/~veronis/pdf/1999rfla.pdf

Voutilainen, A. (2003). Part-of-speech tagging. In R. Mitkov (Ed.), The Oxford handbook of computational linguistics (pp. 219–232). New York: Oxford University Press.

Yaseen, M., Attia, M., Maegaard, B., Choukri, K., Paulsson, N., Haamid, S., Krauwer, S., Bendahman, C., Fersøe, H., Rashwan, M., Haddad, B., Mukbel, C., Mouradi, A., Al-Kufaishi, A., Shahin, M., Chenfour, N., & Ragheb, A. (2006). Building annotated written and spoken Arabic LR’s in NEMLAR project. Proceedings of LREC. pp. 533–538. Available: https://uop.edu.jo/download/research/members/202_1544_Yase.pdf

Titel: Bidirectional HMM-based Arabic POS tagging
verfasst von: Ayoub Kadim
Azzeddine Lazrek
Publikationsdatum: 08.10.2015
Verlag: Springer US
Erschienen in: International Journal of Speech Technology / Ausgabe 2/2016
Print ISSN: 1381-2416
Elektronische ISSN: 1572-8110
DOI: https://doi.org/10.1007/s10772-015-9303-7

Neuer Inhalt

Bildnachweise

VDI-Icon, Profil Icon, inhalt2, Springer Professional Modul/© Springer Fachmedien Wiesbaden GmbH, Nachhaltigkeitsaward Key Visual/© Cometis AG/Global ESG Monitor | Daniel Rupp | Generiert mit KI, Search Icon, Banner Hanser, Beijing Auto Show 2024: Deutsche Hersteller wollen angreifen./© EKH-Pictures / Generated with AI / Stock.adobe.com, Buchstaben, die aus einem Megaphon kommen/© MicroStockHub/Getty Images/iStock, Digitale Lieferkette/© zapp2photo / stock.adobe.com, Zeitschrift Wissensmanagement Cover, PatentFit-Logo/© Springer Fachmedien Wiesbaden GmbH, Sustainibility Finance/© Robert Kneschke / stock.adobe.com / Springer Fachmedien Wiesbaden GmbH, Zukunftswerkstatt Sales Excellence 2024/© AndreyPopov / Getty Images / iStock, 2023_Antrieb/© supervisuell

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Weitere Artikel der Ausgabe 2/2016

A new Quranic Corpus rich in morphosyntactical information

Improving Arabic morphological analyzers benchmark

Towards an open platform based on HPSG formalism for the standard Arabic language

Comparative evaluation of tools for Arabic corpora search and analysis

Towards an automatic extraction of synonyms for Quranic Arabic WordNet

Parsing Arabic using induced probabilistic context free grammar

Neuer Inhalt

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.