DOI
10.35552/0247.39.3.2325
Abstract
Background: since its discovery at the beginning of the last century, Markov models gain a great popularity, and have been widely used in different domains. However, the most prominent use was in computational linguistics, or what is known as natural language processing (NLP). Abstractly, Markov models are nothing but a statistical representation of a particular system. The mathematical statistical representation of a given system is the heart of Markov theory. Markov models characterized by solid mathematical representation, which significantly promotes using it. No doubt, Markov models are mainly used in prediction and classification, to serve computational linguistics as well as other scientific applications. They include two main types: observable Markov models (for short, known as Markov models), and hidden Markov models (HMMs). Bearing in mind that the HMMs are an extension of the Markov models, to model certain applications. Aim: In this paper, I present a brief description of HMMs, as well as some HMMs-based NLP applications. Then, I shed light the researchers’ trend towards artificial neural networks (ANNs). Methods: the global digital libraries used to collect the topic related papers. The searching keywords focus on HMMs and ANNs. The collected papers filtered out to prepare the short list computational linguistics related papers. Then, the selected papers sorted based on published date to track the transformation process towards ANNs. Results: This study shows that the ANNs have been significantly and promising used in NLP tasks. Simultaneously, the recent NLP-related research shows that HMMs have less contribution for such tasks. That is, the ANNs (especially deep learning) is the de-fact trend in NLP field. Recommendations: the NLP research community and the new linguistic researchers should highly consider this transformation.
Recommended Citation
AbuZeina, Dia Eddin
(2025)
"Language Processing: The Precedence of Neural Networks on the Account of Hidden Markov Models,"
An-Najah University Journal for Research - B (Humanities): Vol. 39:
Iss.
3, Article 2.
DOI: 10.35552/0247.39.3.2325
Available at:
https://digitalcommons.aaru.edu.jo/anujr_b/vol39/iss3/2
