in this paper, the ambiguity of nite state irreducible markov chain trajectories is reminded and is obtained for two state markov chain. i give an applicable example of this concept in president election

The well-known Linear Chain Trick (LCT) allows modelers to derive mean field ODEs that assume gamma (Erlang) distributed passage times, by transitioning individuals sequentially through a chain of sub-states. time spent in these states is the sum $k$ exponentially random variables, and thus distributed. Generalized (GLCT) extends this technique much broader phase-type family distributions, whic...

with recent developments in communication technologies, it is possible to access information any time and in any place; however, mobile environments bring forward certain requirements and exclusive challenges including low connection speeds and bandwidth limitations. thus, we need to consider mobile limitations when using web services. providing services and limited resource allocation to users...

Among the class of discrete time Markovian processes, two models are widely used, the Markov chain and the Hidden Markov Model. A major di erence between these two models lies in the relation between successive outputs of the observed variable. In a visible Markov chain, these are directly correlated while in hidden models they are not. However, in some situations it is possible to observe both...

there are some problems with estimating the time required for the manufacturing process of products, especially when there is a variable serving time, like control stage. these problems will cause overestimation of process time. layout constraints, reworking constraints and inflexible product schedule in multi product lines need a precise planning to reduce volume in particular situation of lin...

in this paper at rst, a history of mathematical models is given.next, some basic information about random variables, stochastic processesand markov chains is introduced. as follows, the entropy for a discrete timemarkov process is mentioned. after that, the entropy for sis stochastic modelsis computed, and it is proved that an epidemic will be disappeared after a longtime.

this study was performed with objective land cover change prediction (forest, agriculture, residential and orchard) using logistic regression and markov chain in the gis environment in east of mazandaran province. land cover change detected using satellite imageries belonging to the years 1987 and 2001. transition potential modeling was conducted using a logistic regression. seven variables (de...

In this paper an approximation for entropy rate of an ergodic Markov chain via sample path simulation is calculated. Although there is an explicit form of the entropy rate here, the exact computational method is laborious to apply. It is demonstrated that the estimated entropy rate of Markov chain via sample path not only converges to the correct entropy rate but also does it exponential...

This paper introduces a new multinomial approach unifying the computation of confidence intervals for Markovian models. Starting from a method used for homogeneous Markov chains, we show that it can be applied on models incorporating a hidden component. We consider three models derived from the basic homogeneous Markov chain: the Mixture Transition Distribution (MTD) model, the Hidden Markov Mo...