No Detail Found!

Deep learning based abstractive arabic text summarization using two layers encoder and one layer decoder

Author(s)
DIMA SULEIMAN The University of Jordan, Amman, Jordan; Princess Sumaya University for Technology, Amman, Jordan
ARAFAT AWAJAN Princess Sumaya University for Technology, Amman, Jordan
Abstract
In this paper, an abstractive Arabic text summarization model is proposed, which is based on sequence-tosequence recurrent neural network encoder decoder architecture. The proposed model consists of two layers of hidden states at the encoder and one layer of hidden states at the decoder. The encoder and decoder layers use long short-term memory. The two layers of the encoder are the input text layer and the name entities layer. The inputs for the input text layer are the word embedding of the input text words, while the inputs for the name entity layer are the word embedding of the input text name entities. In all layers, the word embedding that is used is one of the AraVec pre-trained word embedding models. Furthermore, global attention mechanism is used by the decoder to generate the summary words. Special dataset is collected and used for training and evaluating the abstractive summarization model. Moreover, the proposed model is evaluated using ROUGE1 and ROUGE1-NOORDER evaluation measures. The experimental results show that, the proposed model provides good results in terms of ROUGE1 and ROUGE1-NOORDER where the values are 38.4 and 46.4 respectively. Finally, a comparison is made between the word2Vec and dependency parsing based word2Vec word embedding models. The abstractive summarization models that use dependency based word2Vec model outperformed the models that use the original word2Vec model. As a result, the quality of the word embedding highly affects the quality of the generated summary.
Publication Details
Page(s) 3233-3244
DOI DOI not available
Published Journal: Journal of Theoretical and Applied Information Technology, Volume: 98, Issue: 16, Year: 2020

Request the full text from PASTIC

Keywords
Attention Mechanism, Abstractive text summarization, Recurrent Neural Network, ROUGE., LSTM
0

Citations

0

Downloads

53

Views