No Detail Found!

Hidden Markov Model based part of speech tagger for Urdu.

Author(s)
Waqas Anwar School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen Graduate School, China
Xuan Luli Wang School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen Graduate School, China
Xiaolong Wang School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen Graduate School, China
Abstract
In this study, we present the preliminary achievement of Hidden Markov Model (HMM) to solve the part of speech tagging problem of Urdu language. The presented HMM is derived from the combination of lexical and transition probabilities. An important feature of our tagger is to combine many distinguished smoothing techniques with HMM model to resolve the data sparseness problem. We note that the proposed HMM based Urdu Part of speech tagger with different smoothing method has achieved significant performance. We evaluate our tagger`s results regarding different smoothing methods and different word level accuracy through Analysis of Variance (ANOVA) and show how present results are significant. Also, we compose a confusion matrix about most frequent error occurring tag pairs. The development of our tagger is an important milestone toward Urdu language processing. This will open some novel research directions to mature Urdu language processing.
Publication Details
Page(s) 1190-1198
DOI DOI not available
Published Journal: Information technology Journal, Volume: 6, Issue: 8, Year: 2007

Request the full text from PASTIC

0

Citations

0

Downloads

49

Views