A New Enhanced Arabic Light Stemmer for IR in Medical Documents

Ra’ed M.Al-Khatib,Taha Zerrouki,Mohammed M.Abu Shquier,Amar Balla and Asef Al-Khateeb

1Department of Computer Sciences,Yarmouk University,Irbid,21163,Jordan

2Faculty of Sciences and Applied Sciences,Bouira University,Bouira,Algeria

3Faculty of Computer Science and Information Technology,Jerash University,Jordan

4Ecole Nationale Supérieure d’Informatique(ESI),Algiers,Algeria

5Department of Computer Science,College of Shari’a and Islamic Studies in Al Ahsaa,Imam Mohammad Ibn Saud Islamic University(IMSIU),Saudi Arabia

Abstract:This paper introduces a new enhanced Arabic stemming algorithm for solving the informationretrieval problem,especially in medical documents.Our proposed algorithm is a light stemming algorithm for extracting stems and roots from the input data.One of the main challenges facing the light stemming algorithm is cutting off the input word, to extract the initial segments.When initiating the light stemmer with strong initial segments,the final extracting stems and roots will be more accurate.Therefore,a new enhanced segmentation based on deploying the Direct Acyclic Graph (DAG) model is utilized.In addition to extracting the powerful initial segments, the main two procedures (i.e., stems and roots extraction), should be also reinforced with more efficient operators to improve the final outputs.To validate the proposed enhanced stemmer,four data sets are used.The achieved stems and roots resulted from our proposed light stemmer are compared with the results obtained from five other well-known Arabic light stemmers using the same data sets.This evaluation process proved that the proposed enhanced stemmer outperformed other comparative stemmers.

Keywords: Machine learning; information retrieval systems; medical documents; stemming algorithms; arabic light stemmer; natural language processing

1 Introduction

Stemming text is important in Natural Language Processing (NLP) domain since it is used in Information Retrieval (IR), spell checking, morphology analysis, text classification and clustering [1–3].Arabic is a non-agglutinative language in derivational morphology level, which makes root extraction from a word more difficult.The main problem here is the ambiguity to find exact stem, or extract the exact root from derived word.For example:the input wordwhen it’s not vocalized can lead into two different stemming extraction as(means the two parents), or(means with the religion).Further, in some cases, the original stem is not extracted properly, for exampleis extracted to bewith wrong stemwhile the correct lemma/stem must beTherefore, the main attention of computational studies in the Arabic NLP and morphological IR domain is to develop a proper and more efficient light stemming algorithm [4].This is to tackle these difficulties in extracting the best and most accurate stem/root from the input Arabic words.

In this paper, we proposed a new enhanced stemming algorithm, which is interacting as light stemmer and segmentor algorithm at the same time.This proposed enhanced algorithm primarily supports light stemming (removing prefixes and suffixes) and extracts all possible segmentations from the input word.This stemmer is a new enhanced based on Directed Acyclic Graph (DAG)model adapted from [5], which empowered the proposed algorithm to generate all segmentations.Therefore, the enhanced algorithm offers stemming extraction and root extraction at the same time, unlike other existing Arabic light stemmers in literature; Khoja [6], ISRI [7], FARASA [8],and Assem [9].This enhanced stemmer is also provided with default lists of prefixes and suffixes that can be customized and updated separately.

Consequently, the main contributions of our proposed enhanced stemmer are summarized as follows.(i) Accepting the use of customized prefixes and suffixes lists, which allow the end-user to handle and update these lists, and make customized stemmers without any changing to the main source code.(ii) The algorithm of this enhanced stemmer can be added to the Python library, and will also be available as a demo and as open-source code on Github.(iii) The proposed stemming algorithm model can be combined for building new IR and NLP systems.

The remaining parts of this paper are organized as follows.The morphological structures and word types are defined and overviewed in the next Section.In Section 3, we presented the main state-of-the-art Arabic stemmers existing in the literature.Our proposed enhanced light stemming algorithm is fully discussed in Section 4.The comprehensive experiments and comparative evaluations are introduced in Section 4, and finally, we conclude this work with future directions in the last section.

2 Research Background

In order to make this research paper a self-exploratory, the various structures of the Arabic word and the parts of speech in Arabic language will be defined and distinguished in this section.In Arabic language, morphology or the word structure domain is primarily considered the consonant root to obtain the final forms of many derived words [10,11].IR systems mostly used stem, pattern, and lemma in addition to the root.Thus, the main differences among root,stem, pattern, and lemma are obtained from the way that they work.Therefore, the results and definitions of these structural categories can be returned as follows:

Root:In Arabic language, the root is an invariable discontinuous bound morpheme that can be represented by two to five phonemes.Basically, three consonant letters in certain order interlocks with the pattern to form a stem, where the root has lexical meaning [10].Aronoff defines the root in more vivid terms:“A root is what is left where all morphological structure has been wrung out of a form.This is the sense of the term in Semitic grammar” [12].

Stem or word stem:Stem is the base or bare form of the word without inflectional affixes.Therefore, the lexeme may have more than one stem [13].

Pattern:The pattern is a discontinuous morpheme consisting of one or more vowels and slots for root-phonemes (means radicals).The pattern comes either alone or in combination with one to three derivational affixes, which interlocks with a root to format a stem.So, the stem has grammatical meaning in general [13].

Stemming:Stemming process in Arabic is performed by cutting off the end and/or the beginning of the word, taking into account a list of common prefixes and suffixes that can be found in an inflected word.This indiscriminate cutting can be successful on some occasions, but not always at all.

Lemmatization:On the other hand, lemmatizing process takes into consideration the morphological analysis of the words.To do so, it is necessary to have detailed dictionaries that the algorithm can look through, to link and match the form back to its lemma.

3 Literature Review

Several stemming algorithms have been introduced in the literature to extract root, stem, and lemma from the input Arabic words.In [6], the researchers presented a light stemming algorithm named Khoja stemmer, which is the most popular Arabic light stemmer.Khoja stemmer removes prefixes and suffixes from the input word, often after performing a normalization process.Then,it matches the resulting word/segment to a pattern, to extracts the initial root.This initial root is validated against a list of correct Arabic roots to ensure linguistic correctness, and then to extract the final root.Khoja stemmer resolves the ambiguity by defining a set of linguistic rules based on some features such as the word’s first character, prefixes, or suffixes length.Additionally, decisions are implicitly ordered whereas the final result will be the first correct root.Khoja stemmer also handles roots with duplicate letters first [15].

Taghva et al.[7] introduced the Information Science Research Institute’s that well-known ISRI-stemmer.ISRI Arabic stemmer shared many features with the Khoja stemmer without using the root dictionary.Besides, if a root is not found, the ISRI stemmer returned normalized form,rather than returning the original unmodified word.Additional adjustments were made to improve the final results of the ISRI algorithm by adding new more 60 stop words and adding the patternto the pattern set.ISRI light stemmer is available as part of the NLTK framework [16].

Abdelali et al.[8] developed FARASA stemmer, which is considered as text processing toolkit for Arabic text.FARASA consists of the segmentation/tokenization module, POS tagger, Arabic text diacritizer, and dependency parser.FARASA segmentation/tokenization module is based on SVM-rank with linear kernels, which uses a variety of features and lexicons to rank all possible segmentations of the word.These features include:(i) likelihoods of stems, prefixes, suffixes,their combinations; (ii) presence in lexicons containing valid stems or named entities; (iii) and underlying stem templates [8].FARASA is also available for a demo with source code on GitHub.

Chelli [9] presented Assem stemmer as a light stemming algorithm, which is made based on the Snowball framework language [17].Assem stemmer is fast and can be generated in many programming languages (through Snowball) [9].Snowball is a small string processing language designed for creating stemming algorithms to be used in IR systems.Assem stemmer offers light stemming and text normalization.It can be configured to run as root extractor or stemmer, but in two separate packages, because the Snowball framework does not support stemming and rooting at the same time.The source code of Assem stemmer is also available on GitHub.

We discussed those Arabic stemmers listed in this section, in order to be used in the comparative and evaluation process as benchmarks against our proposed enhanced stemmer.However,more several algorithms have been presented in the literature as Arabic light stemmers, which are categorized and illustrated in [18,19].Nevertheless, we cannot compare with them due to the lack of their source code, which is not available.

4 Proposed Stemming Algorithm

In this section, the proposed enhanced Arabic light stemming algorithm is discussed in detail.The key focus of this research paper is on the way of extracting all possible segmentations from the input Arabic word.Primarily, this segmentation process is performed based on deploying a directed acyclic graph (DAG) model that is discussed in the following subsection.The essential idea behind deploying DAG model is to provide strong initial segments for the main operator of our proposed enhanced stemming algorithm.This is to reinforce the final efficiency of the new enhanced stemming algorithm for extracting the best final roots and stems from the input data.The flowchart and general framework of the proposed stemming algorithm are illustrated in Fig.1.

Figure 1:Flowchart of proposed enhanced Arabic light stemming algorithm

The proposed enhanced stemmer is initiated by a set of segments that are produced by operating the adapted DAG model [20], which can be run on-line in linear time with a strong correct sense.These segments as initial stem-hits are extracted after removing prefixes and suffixes via using the DAG model.The stem extraction operator is firstly used to extract final stems from these initial segments by running an indexing model, which is efficiently performed by translating numerical information to string.Secondly, there is a root extraction procedure that removes infixes from the input stems, to extract final roots.Finally, the proposed enhanced stemming algorithm is terminated after choosing the shortest stem, to extract the best final root.In a nutshell, our proposed enhanced light stemmer achieved the best outcomes of final stems and roots with reasonable complexity.The subsequent sections will thoroughly discuss each step of our proposed Arabic light stemming algorithm.

4.1 Extracting Initial Segments by DAG Model

For language stemming problem, the input Arabic word in the proposed algorithm can be represented asw=(l1,l2,...,lN)ofNletters.Then, the value range of each input Arabic word can be indexed bywi, wherewiis the word labeledwi∈(1,2,...,N).The focal point is how to extract the initial segments from the input wordwi.The initial segments are primarily extracted based on the DAG model using nested tree-inspired and customized from [21].As conventionally known,the adapted directed acyclic graph extracts affixes (prefixes and suffixes), using predefined affixes lists.Therefore, the DAG model extracts all possible affixation from the input Arabic word and provides all possible segmentations.The main feature of the proposed enhanced stemmer is dataindependent, which does not perform a specific treatment according to a word list.This feature makes the enhanced proposed stemming algorithm fast to reduce data entry and validation.Consequently, our enhanced stemmer has a direct impact to be easily used in information retrieval systems, fast text analysis, and classification.

4.2 Prefix Extraction

Figure 2:Prefixes extraction example based on the DAG model using nested tree

4.3 Suffix Extraction

Figure 3:Suffixes extraction example based on the DAG model in an inverse way

4.4 Stem Extraction

Initially, the algorith m of stems extraction in our proposed enhanced stemmer will segment and cut off the input word into all possible segments.To get one stem, the longest prefix and longest suffix are removed, where the remaining part of the segment is the final shortest stem.In other words, the default stem will be the shortest segment from all possibilities of extracted segments.

4.5 Root Extraction

Figure 4:Root extraction based on removing any of as a predefnied infixes

Consequently, the final termination process of root-extraction for choosing the best final root will firstly ignore any root less than three letters.Then, it will choose the most frequent root among the rest extracted roots.

4.6 Customizing Proposed Stemmer

One of the important features of adapting this proposed enhanced stemming algorithm is the ability to customize this enhanced stemmer to build new ones without changing its original source code.The enhanced stemming algorithm can accept to handle any new affixes lists, and rebuild the automaton nested tree of DAG model in any new future stemmer or in any other IR system.This feature is the most important one for our enhanced stemmer, which allows the developers and researchers to customize affixes and make a specific domain or new light stemmer.Further,you can change the aim of the stemmer to extract roots by giving new derivational affixes, or extract stem [22,23].This is through the ability to build rules for removing syntactic affixes by giving a new syntactic affixes list [24].

This can be handled using new affixes lists.In the following section, we exhibit the used lists of prefixes and suffixes:

This feature will allow researchers to easily adapt our enhanced stemming algorithm with this step of customization in the Arabic NLP domain, and to use our proposed stemming algorithm in many information retrieval systems.In a nutshell, our proposed enhanced stemmer can be used in multiple contexts without changing the original source code of the main algorithm.

5 Evaluation Results and Discussion

In this section, a comprehensive discussion is presented for the experimental evaluation of outputs resulted from our enhanced Arabic light stemmer.Further, a comparison process is performed to show the prominence of our proposed enhanced stemmer that proved its superiority against the obtained results from other existing stemming algorithms in the literature.Basically,the used various Arabic data-sets are fully explained in the subsequent section, before discussing and analyzing the experimental evaluation results.To describe and validate the evaluation of the proposed stemmer, the outputs obtained from our proposed enhanced light stemmer are compared against the best outputs resulted from other five well-known light stemmers, which are Khoja [6],ISRI [7], FARASA [8], Assem [9], and Tashaphyne base stemmer [25].Meanwhile, the main multiple variants of our proposed enhanced Arabic stemmer are:(i) using customized prefixes and suffixes lists.(ii) removing stop words.(iii) using a preprocessing word tagging.

5.1 Used Data Sets

The used data sets for testing and evaluation of our enhanced stemmer, are carefully selected and revised from four different well-known Arabic benchmarks.These used four data sets are called:Gold Arabic corpus [26], NAFIS [27], Quranic Arabic corpus [28], and Quran index corpus [29].Meanwhile, these used data sets are different in terms of word count, lemma/stem counts, and root counts.Tab.1 summarizes the statistics of all these data sets.

In order to clarify the main features of each data set, a comprehensive description of the used four data sets can be explained as follows:

1.Gold Arabic Corpus:is initially built for testing Assem stemmer, and other Arabic stemmers [26].The gold corpus can be freely downloaded.

Miss White was a smiling, young, beautiful redhead, and Steve was in love! For the first time in his young life, he couldn’t take his eyes off his teacher; yet, still he failed. He never did his homework, and he was always in trouble with Miss White. His heart would break under her sharp words, and when he was punished for failing to turn in his homework, he felt just miserable3! Still, he did not study.

2.NAFIS Arabic Corpus:Normalized Arabic Fragments for Inestimable Stemming (NAFIS)is an Arabic stemming standard corpus, which is composed of a collection of texts [27].NAFIS is selected to be representative of Arabic stemming tasks, and they are manually annotated and processed.

3.Quranic Arabic corpus:is annotated linguistic corpus [28], which is a resource of the Arabic grammar, syntax, and morphology for each word in the Holy Quran [30].This Quranic corpus provides three levels of analysis:the morphological annotation, the syntactic treebank, and the semantic ontology.This Quranic Arabic corpus differs from other Arabic banks of data in the following three important ways:

? The source text is an indifferent form of Arabic since the language of the Holy Quran is considered to be classical Arabic.This Quranic corpus differs from the modern standard Arabic used today, in terms of word-forms and language structures [31].

? The text of the Quranic corpus contains diacritics that are essential in the way of word vocalization.

? The traditional grammar ofis also used in this Quranic corpus.

4.Quran index corpus:This Quran index corpus is a dataset that is manually annotated and processed [29].It is basically built to be used in Alfanous Quranic search engine [32].

As borne out by the statistics of used data sets reported in Tab.1, almost all notes will be discussed as follows.NAFIS corpus contains few words [27].It only has 173 Arabic words, which are not well-chosen in a way to cover different cases and aspects of our daily life.The Arabic Golden corpus is cited as ‘Gold’corpus, and it has more words than the NAFIS corpus.However,the Gold corpus has a poor number of unrepeated roots and lemmas (59 lemmas and 36 roots).This will lead to an increase in average of frequency of the words by roots to be 32.36 over other datasets (in NAFIS 1.27, Quranic 8.21, and in Quran index corpus 6.72).The frequency of word by lemma in the Gold corpus is also in high average equal 19.75, while the average of lemmas in Quranic corpus is 3.51, in Quran index corpus is 3.08, and in NAFIS corpus is 1.28.

Table 1:Statistics and main features of used data sets

In the summary, NAFIS corpus is a relatively small dataset.Gold corpus has more number of words, but with a higher frequency of words by lemma and root.The quranic corpus has classical Arabic language words.All the mentioned limitations will influence the final quality of the testing results.Consequently, full explanation and discussion is presented with deep analysis in the next subsection, after performing wide evaluation experiments and comparative tests.

5.2 Comparative Evaluation Tests

In this section, the effect of developing our proposed enhanced stemming algorithm is thoroughly explained with a wide range of experimental tested results.The proposed enhanced stemmer provides extraction of stem and root at the same time, while other Arabic light stemmers provide only one extraction at the same time.Khoja-stemmer and ISRI-stemmer primarily act as rooters, while FARASA operates as a stemming algorithm.However, Assem-stemmer was developed based on the SnowBall algorithm, which allows one extraction at a time.Thus, Assem stemmer is developed in two separate packages, to be configured as stemmer or as rooter.For this reason, the results of our enhanced stemmer is compare with obtained results from other stemmers in two different tasks, which are stem extraction and root extraction as follows.

5.2.1 Stem Extraction Tests

To evaluate the proposed enhanced algorithm as a stemmer, the same four datasets containing the roots, stems, and lemmas columns are used.The columns of stems and lemmas will be used to compare the results of stems that are obtained from our proposed enhanced stemmer against the obtained results from other existing stemmers (Khoja stemmer [6], ISRI stemmer [7], Assem SnowBall-based stemmer [9], FARASA stemmer [8], and Tashaphyne base stemmer [25]).All obtained results are calculated based on the measurements of accuracy metrics that are adapted from [2,33].The experimental results proved that ISRI and Khoja are mostly acting as rooters than as stemmers.Nevertheless, we use them here in the stem extraction tests, due to that both ISRI and Khoja present stem by extracting the minimal part of the input word.Therefore, many researchers in the literature cited ISRI and Khoja as stemmers.

The stem evaluation results in terms of linguistic accuracy are reported in Tab.2.Our proposed enhanced light stemmer got the best stems accuracy results for NAFIS and Quran index datasets, with accuracy rates of 74.71% and 59.34%, respectively.For Gold corpus, Assem-stemmer obtained the best score with a 71.07% accuracy rate, while the proposed enhanced stemmer got the second score with a 63.95% accuracy rate.Further, FARASA-stemmer obtained the best accuracy rate 53.96%, respect to the Quranic corpus.Meanwhile, our enhanced stemmer also obtained the third score of 48.01% accuracy rate for this Quranic corpus, after Assem stemmer.

Table 2:Accuracy rate for stem extraction results

5.2.2 Root Extraction Tests

The proposed enhanced light stemming algorithm operates the stemming and rooting processes without using the root lookup dictionary, which acts like ISRI-stemmer.Meanwhile, ISRIstemmer uses the Khoja algorithm but without using the root lookup dictionary.The obtained results are calculated based on the accuracy metrics adapted from [2,34].Basically, the effect of proposed enhanced algorithm is tested as a rooter against other existing Arabic light stemmers,which are Khoja stemmer [6], ISRI stemmer [7], Assem SnowBall-based stemmer [9], FARASA stemmer [8], and Tashaphyne stemmer [25].

Khoja stemmer extracts the root from the input word with dictionary verification, while ISRI stemmer applied the same Khoja algorithm but without using root dictionary verification step.Assem based on Snowball is presented in two variants.The first one is a rooter, while the second is a stemmer.Therefore, we cite and compare with Assem stemmer indifferently.Thus, Assem acts as rooter when it extracts roots, and Assem as stemmer when it extracts stems.

Consequently, the proposed new enhanced stemming algorithm recorded the best precision values for extracting more accurate roots.As seen in Tab.3, our enhanced stemmer got the highest linguistic accuracy on three used datasets (Gold 73.82%, Quranic corpus 63.69%, Quran index 60.75% respectively).For the fourth data (i.e., NAFIS corpus), the Tashaphyne basic stemmer obtained the highest linguistic accuracy, which is 71.26%.Noted that the Khoja-stemmer and Assem as rooter, obtained the same accuracy rate 59.77% only on NAFIS corpus.Then, our proposed enhanced stemmer reported a 56.90% accuracy rate, which is in stage four after those of Tashaphyne, Khoja, and Assem stemmers.

Table 3:Accuracy rate for root extraction results

6 Conclusions and Future Work

In this research paper, a new enhanced Arabic light stemming algorithm is presented for stems and roots extraction in the information retrieval domain.The proposed stemming algorithm is enhanced with a new adaptation of direct acyclic graph (DAG) model.This adapted DAG model is collaborated with multiple features to extract strong initial segments from the input data.The proposed enhanced light stemming algorithm can be used as a rooter and as a stemmer, according to the affixes list that is predefined and customized.Therefore, the main algorithm of proposed stemmer extracted initial outputs, and then iteratively processed to enhance the choices of stems and roots outputs until the best results are finally obtained.

For comparative evaluation purposes, four different data sets are used, which are Gold Arabic Corpus, NAFIS, Quranic Arabic corpus, and Quran index corpus.Our proposed enhanced stemming algorithm with deploying the DAG model, builds the initial segments (i.e., stem-hits), and then achieves the best results of final stems and roots.Furthermore, the outputs of our proposed enhanced stemmer are compared with those obtained from five other well-known light stemmers(Khoja, ISRI, Assem, FARASA, and Tashaphyne stemmer), using the same four data sets.Finally,this comparative process proved that our proposed enhanced stemming algorithm can excel the other five existing stemmers for almost all used datasets.

Extracting strong initial segments from the input word, has a direct impact and leads to more accuracy on the final outputs.Therefore, further study to investigate and adapt other segmentation models more efficiently than the DAG model will improve the final results.Furthermore, the effect of extraction techniques (such as stem extraction and root extraction) in improving the outcomes of the stemming algorithm, should also be studied and deployed with more robustness techniques in the future to enhance the extraction process of stemming.Many challenging in existing used data sets can be also analyzed to further preparing new valid and more comprehensive corpus in future work.

Funding Statement:The authors received no specific funding for this study.

Conficts of Interest:The authors declare that they have no conflicts of interest to report regarding the present study.