No Detail Found!

Enhancement of embedded topic model

Author(s)
Asma Gul Department of Computer Software Engineering, University of Engineering & Technology Mardan,,Pakistan
S. Zafar Ali Shah Department of Computer Software Engineering, University of Engineering & Technology Mardan,,Pakistan
Sadaqat Jan Department of Computer Software Engineering, University of Engineering & Technology Mardan,,Pakistan
Abstract
This comparative study aims to examine the performance of the Embedded Topic Model (ETM) in producing coherent topics when applied to noun-restricted corpora. As nouns in any dataset are the most informative features involving them will improve the topic quality. To evaluate this hypothesis, we compare the performance of two topic models: ETM (Embedded Topic Model) and LDA (Latent Dirichlet allocation), on three dataset variations. The first dataset is the original pre-processed dataset, while the second version consists of the dataset reduced to noun phrases only; the third version represents the dataset reduced to nouns only. To assess the performance of both models, we employ two widely used measures: Topic Coherence (TC) and Topic Diversity (TD). The experimental results revealed that the embedded topic model outperforms LDA across all the variations of the datasets. Remarkably it exhibits exceptional performance for the dataset having only nouns. In addition, the time to train the model is also reduced when the vocabulary is reduced to nouns only. This paper evaluates how the Embedded Topic Model significantly improves topic quality, especially in noun-restricted contexts. These findings provide insightful information for researchers and practitioners regarding the possible advantages of using noun-based corpus reduction strategies in topic modelling tasks.
Publication Details
Page(s) 46-51
DOI DOI not available
Published Journal: International Journal of Emerging Engineering and Technology, Volume: 2, Issue: 1, Year: 2023

Request the full text from PASTIC

Keywords
Text Mining, Topic Modelling, text summarization, topic diversity, embedded topic modelling
0

Citations

0

Downloads

38

Views