Top

Arabian Journal for Science and Engineering

Published in:

03-01-2021 | Research Article-Computer Engineering and Computer Science

Index Term Selection Heuristics for Arabic Text Retrieval

Author: Yaser A. Al-Lahham

Published in: Arabian Journal for Science and Engineering | Issue 4/2021

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The Arabic index term selection is a challenging process due to the complex morphological nature of the Arabic language. Index term selection is a significant factor that affects the efficiency of any information retrieval system. Many methods of index term selection were proposed in the literature. The majority of them were based on root extraction and stemming. Other proposals apply complex linguistic rules and machine learning tools. This paper proposes a simple index term selection method using some heuristics such that a representative subset of terms is selected to form the index. The proposed heuristics essentially select index terms from Arabic words having the prefix ‘AL’ (definite words) as a basis. Besides, the proposed method selects new words according to any of the following heuristics: the words preceding or words succeeding definite terms, choosing words that follow some linking words and words following propositions in semi-sentences, and selecting words that represent named entities. The proposed heuristics were tested using the TREC-2001/2002 Arabic test collection. The results show the effectiveness of the proposed method since it outperforms selecting all terms stemmed by two well-known stemmers. For example, choosing definite words and words that represent named entities outperforms selecting all terms stemmed by the LIGHT10 stemmer according to the mean average precision by 8.4% and at the same time decreases the index size by 27.8%.

previous article A Novel Area Coverage Technique for Maximizing the Wireless Sensor Network Lifetime

next article Optimal Multi-robot Path Planning Using Particle Swarm Optimization Algorithm Improved by Sine and Cosine Algorithms

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Freynik, S.; Gor, K.; O’Rourke, P.: L2 processing of Arabic derivational morphology. Mental Lexicon 12(1), 21–50 (2017). https://doi.org/10.1075/ml.12.1.02freCrossRef

Duari, S.; Bhatnagar, V.: sCAKE: semantic connectivity aware keyword extraction. Inf. Sci. 477, 100–117 (2019). https://doi.org/10.1016/J.INS.2018.10.034CrossRef

Mustafa, M.; et al.: Developing two different novel techniques for Arabic text stemming. Intell. Inf. Manag. 11(01), 1–23 (2019). https://doi.org/10.4236/iim.2019.111001CrossRef

Chiu, C.-Y.; Markchit, S.: Effective and efficient indexing in cross-modal hashing-based datasets. Sig. Process. Image Commun. 80, 115650 (2020). https://doi.org/10.1016/J.IMAGE.2019.115650CrossRef

Azman, B.: Root identification tool for Arabic verbs. IEEE Access 7, 45866–45871 (2019). https://doi.org/10.1109/ACCESS.2019.2908177CrossRef

Boudchiche, M.; et al.: AlKhalil Morpho Sys 2: a robust Arabic morpho-syntactic analyzer. J. King Saud Univ. Comput. Inf. Sci. 29(2), 141–146 (2017). https://doi.org/10.1016/j.jksuci.2016.05.002CrossRef

Taji, D.; et al.: An Arabic morphological analyzer and generator with copious features. In: Proceedings of the 15th SIGMORPHON Workshop on Computational Research in Phonetics, Phonology, and Morphology, pp. 140–150 (2019). https://doi.org/10.18653/v1/w18-5816

Darwish, K.; Oard, D.W.: Adapting morphology for Arabic information retrieval. In: Soudi, A., Bosch, A., Neumann, G. (eds.) Arabic Computational Morphology. Text, Speech and Language Technology, vol. 38, pp. 245–262. Springer, Berlin (2007). https://doi.org/10.1007/978-1-4020-6046-5_13CrossRef

Davis, S.; Tsujimura, N.: Arabic nonconcatenative morphology in construction morphology, in the construction of words. Stud. Morphol. 4, 315–339 (2018). https://doi.org/10.1007/978-3-319-74394-3_12CrossRef

10.

Larkey, L.S.; Ballesteros, L.; Connell, M.E.: Light stemming for Arabic information retrieval. In: Soudi, A., Bosch, A., Neumann, G. (eds.) Arabic Computational Morphology. Text, Speech and Language Technology, vol. 38, pp. 221–243. Springer, Berlin (2007). https://doi.org/10.1007/978-1-4020-6046-5_12CrossRef

11.

Abdelali, A., Darwish, K., Durrani, N., Mubarak, H.: Farasa: a fast and furious segmenter for Arabic. In: Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Demonstrations, pp. 11–16 (2016). https://doi.org/10.18653/v1/n16-3003

12.

Darwish, K.: Arabic information retrieval. Found. Trends^® Inf. Retrieval, 7(4), 239–342 (2014). https://doi.org/10.1561/1500000031

13.

Atwan, J.; Masnizah, M.; Kanaan, G.; Bsoul, Q.: Impact of stemmer on Arabic text retrieval. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 8870, 314–326 (2014). https://doi.org/10.1007/978-3-319-12844-3_27CrossRef

14.

Al-Lahham, Y.A.M.: Arabic document indexing for improved text retrieval. In: 2019 2nd International Conference on New Trends in Computing Sciences, ICTCS 2019—Proceedings. IEEE, pp. 1–5 (2019). https://doi.org/10.1109/ictcs.2019.8923096

15.

Siddiqi, S.; Sharan, A.: Keyword and keyphrase extraction techniques: a literature review. Int. J. Comput. Appl. 109(2), 17–23 (2015). https://doi.org/10.5120/19161-0607CrossRef

16.

Rose, S.; Engel, D.; Cramer, N.; Cowley, W.: Automatic keyword extraction from individual documents. Text Min. Appl. Theory (2010). https://doi.org/10.1002/9780470689646.ch1CrossRef

17.

Chouigui, A.; Khiroun, O.B.; Elayeb, B.: A TF-IDF and co-occurrence based approach for events extraction from Arabic news corpus. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 10859, 272–280 (2018). https://doi.org/10.1007/978-3-319-91947-8_27CrossRef

18.

El Mahdaouy, A.; Gaussier, E.; El Alaoui, S.O.: Should one use term proximity or multi-word terms for Arabic information retrieval? Comput. Speech Lang. 58, 76–97 (2019). https://doi.org/10.1016/j.csl.2019.04.002CrossRef

19.

Dahab, M.Y.; Kamel, M.; Alnofaie, S.: An empirical study of documents information retrieval using DWT. Stud. Comput. Intell. 740, 251–264 (2018). https://doi.org/10.1007/978-3-319-67056-0_13CrossRef

20.

Larabi Marie-Sainte, S.; et al.: Arabic natural language processing and machine learning-based systems. IEEE Access 7, 7011–7020 (2019). https://doi.org/10.1109/access.2018.2890076CrossRef

21.

Armouty, B.; Tedmori, S.: Automated keyword extraction using support vector machine from Arabic news documents. In: 2019 IEEE Jordan International Joint Conference on Electrical Engineering and Information Technology, JEEIT 2019—Proceedings. IEEE, pp. 342–346 (2019). https://doi.org/10.1109/jeeit.2019.8717420.

22.

Liu, Z.; Li, P.; Zheng Y.; Sun, M.: Clustering to find exemplar terms for keyphrase extraction. In: EMNLP ‘09: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, vol. 1, pp. 257–266 (2009).

23.

Al-Kabi, M.; Al-Belaili, H.; Abul-Huda, B.; Wahbeh, A.: Keyword extraction based on word co-occurrence statistical information for Arabic text, ABHATH AL-YARMOUK. Basic Sci Eng 22(1), 75–95 (2013)

24.

Liu, F.; Pennell, D.; Liu, F.; Liu, Y.: Unsupervised approaches for automatic keyword extraction using meeting transcripts. In: NAACL HLT 2009—Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics, Proceedings of the Conference, pp. 620–628 (2009). https://doi.org/10.3115/1620754.1620845

25.

Beliga, S.; Meštrović, A.; Martinčić-Ipšić, S.: An overview of graph-based keyword extraction methods and approaches. J. Inf. Organ. Sci. 39(1), 1–20 (2015)

26.

Awajan, A.: Unsupervised approach for automatic keyword extraction from Arabic documents. In: The 2014 Conference on Computational Linguistics and Speech Processing, pp. 175–184 (2014).

27.

Hu, X.; Wu, B.: Automatic keyword extraction using linguistic features. In: Proceedings—IEEE International Conference on Data Mining, ICDM, pp. 19–23 (2006). https://doi.org/10.1109/icdmw.2006.36.

28.

El-Shishtawy, T.; Al-sammak, A.: Arabic keyphrase extraction using linguistic knowledge and machine learning techniques. https://arxiv.org/abs/1203.4605 (2012)

29.

Alnaied, A.; Elbendak, M.; Bulbul, A.: An intelligent use of stemmer and morphology analysis for Arabic information retrieval. Egypt. Inform. J. (2020). https://doi.org/10.1016/j.eij.2020.02.004CrossRef

30.

Ababneh, A.H., Lu, J., Xu, Q.: Arabic information retrieval: a relevancy assessment survey. In: 25th International Conference on Information Systems Development, ISD, pp. 345–357 (2016)

31.

Mulki, H.; Haddad, H.; Gridach, M.; Babaoglu, I.: Empirical evaluation of leveraging named entities for Arabic sentiment analysis. Int. Arab. J. Inf. Technol. 17(2), 233–240 (2019). https://doi.org/10.34028/iajit/17/2/11CrossRef

32.

Guo, J.; Xu, G.; Cheng, X.; Li, H.: Named entity recognition in query. In: Proceedings—32nd Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, SIGIR 2009, pp. 267–274 (2009). https://doi.org/10.1145/1571941.1571989.

33.

El Mahdaouy, A.; El Alaoui, S.O.; Gaussier, E.: Improving Arabic information retrieval using word embedding similarities. Int. J. Speech Technol. 21(1), 121–136 (2018). https://doi.org/10.1007/s10772-018-9492-yCrossRef

34.

Strzelecki, A.; Rutecka, P.: Featured Snippets results in Google web search: an exploratory study. Smart Innov. Syst. Technol. 167, 9–18 (2020). https://doi.org/10.1007/978-981-15-1564-4_2CrossRef

35.

Al-Dayel, A.; Ykhlef, M.: Enhanced Arabic document retrieval using optimized query paraphrasing. Arab. J. Sci. Eng. 40(11), 3211–3232 (2015). https://doi.org/10.1007/s13369-015-1797-4CrossRef

36.

Guirat, S.B.; Bounhas, I.; Slimani, Y.: Pre-indexing techniques in Arabic information retrieval. In: ICAART 2019—Proceedings of the 11th International Conference on Agents and Artificial Intelligence, vol. 1, pp. 237–246 (2019). https://doi.org/10.5220/0007393402370246.

37.

Bounhas, I.; Soudani, N.; Slimani, Y.: Building a morpho-semantic knowledge graph for Arabic information retrieval. Inf. Process. Manag. (2019). https://doi.org/10.1016/j.ipm.2019.102124CrossRef

Title: Index Term Selection Heuristics for Arabic Text Retrieval
Author: Yaser A. Al-Lahham
Publication date: 03-01-2021
Publisher: Springer Berlin Heidelberg
Published in: Arabian Journal for Science and Engineering / Issue 4/2021
Print ISSN: 2193-567X
Electronic ISSN: 2191-4281
DOI: https://doi.org/10.1007/s13369-020-05022-3

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Other articles of this Issue 4/2021

Model of Open Source Software Reliability with Fault Introduction Obeying the Generalized Pareto Distribution

A Framework for Classification of Gabor Based Frequency Selective Bone Radiographs Using CNN

Discrete Island-Based Cuckoo Search with Highly Disruptive Polynomial Mutation and Opposition-Based Learning Strategy for Scheduling of Workflow Applications in Cloud Environments

Detection and Defense of PUEA in Cognitive Radio Network

Two-Phase Group Decision-Aiding System using ELECTRE III Method in Pythagorean Fuzzy Environment

Performance Evaluation of Lightweight Encryption Algorithms for IoT-Based Applications

Premium Partners