Markov chains have been used to model web usages and served as the basis for statistical testing, performance evaluation, and reliability analysis. However, most of such applications of Markov chains were carried out without answering the question: “Can web usage be accurately modeled by Markov chains?” In this paper, we propose a set of tests, which are easy to perform based on information abo...

WiMAX is intended for fourth generation wireless mobile communications where a group of users are provided with a connection and a fixed length queue. In present literature traffic of such network is analyzed based on the generator matrix of the Markov Arrival Process (MAP). In this paper a simple analytical technique of the two dimensional Markov chain is used to obtain the trajectory of the c...

In this paper the dynamic modeling of repairable and standby components of complex systems is analyzed using Petri Nets and ladder logic diagrams. The use of Petri Nets as modelling of a complex system avoids two basic disadvantages of Markov chain analysis. First, the Petri Net model does not grow in size as increasing the number of components and second, Markov chain has been limited to the e...

The cumulative conformance count (CCC) charts are widespread in process monitoring of high-yield manufacturing. Recently, it is found the use of variable sampling interval (VSI) scheme could further enhance the efficiency of the standard CCC charts. The average time to signal (ATS) a shift in defect rate has become traditional measure of efficiency of a chart with the VSI scheme. Determining th...

This paper presents a novel method for remaining useful life prediction using the Elliptical Basis Function (EBF) network and a Markov chain. The EBF structure is trained by a modified Expectation-Maximization (EM) algorithm in order to take into account the missing covariate set. No explicit extrapolation is needed for internal covariates while a Markov chain is constructed to represent the ev...

We consider a queueing model with finite capacities. External arrivals follow a Coxian distribution. Due to the limitation of the capacity, arrivals may be lost if the buffer is full. Our goal is to study the probability of blocking. In order to obtain the steady-state probability distribution of this model, we construct an embedded Markov chain at the departure points. The solution is solved ...

We devise a cross-layer design (CLD) of carrier sensing multiple access with collision avoidance (CSMA/CA) at the medium access control (MAC) layer with spectrum sensing (SpSe) at the physical layer for cognitive radio networks (CRNs). The proposed CLD relies on a Markov chain model with a state pair containing both the SpSe and the CSMA/CA with exponential backoff from which we derive the tran...

We propose an efficient and accurate approximate Bayesian Markov chain Monte Carlo methodology for the estimation of event rates under an overdispersed Poisson distribution. A Gibbs sampling algorithm is derived, based on a log-normal/gamma mixture density that closely approximates the conditional distribution of the Poisson parameters. This involves a moment matching process, with the exact co...

in this paper, the ambiguity of nite state irreducible markov chain trajectories is reminded and is obtained for two state markov chain. i give an applicable example of this concept in president election