Several Types of Ergodicity for M/g/1-type Markov Chains and Markov Processes
نویسندگان
چکیده
In this paper we study polynomial and geometric (exponential) ergodicity forM/G/1-type Markov chains and Markov processes. First, practical criteria for M/G/1-type Markov chains are obtained by analyzing the generating function of the first return probability to level 0. Then the corresponding criteria for M/G/1-type Markov processes are given, using their h-approximation chains. Our method yields the radius of convergence of the generating function of the first return probability, which is very important in obtaining explicit bounds on geometric (exponential) convergence rates. Our results are illustrated, in the final section, in some examples.
منابع مشابه
On $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes
In the present paper we investigate the $L_1$-weak ergodicity of nonhomogeneous continuous-time Markov processes with general state spaces. We provide a necessary and sufficient condition for such processes to satisfy the $L_1$-weak ergodicity. Moreover, we apply the obtained results to establish $L_1$-weak ergodicity of quadratic stochastic processes.
متن کاملEvaluation of First and Second Markov Chains Sensitivity and Specificity as Statistical Approach for Prediction of Sequences of Genes in Virus Double Strand DNA Genomes
Growing amount of information on biological sequences has made application of statistical approaches necessary for modeling and estimation of their functions. In this paper, sensitivity and specificity of the first and second Markov chains for prediction of genes was evaluated using the complete double stranded DNA virus. There were two approaches for prediction of each Markov Model parameter,...
متن کاملEmpirical Bayes Estimation in Nonstationary Markov chains
Estimation procedures for nonstationary Markov chains appear to be relatively sparse. This work introduces empirical Bayes estimators for the transition probability matrix of a finite nonstationary Markov chain. The data are assumed to be of a panel study type in which each data set consists of a sequence of observations on N>=2 independent and identically dis...
متن کاملOn classifying processes
We prove several results concerning classifications, based on successive observations (X 1 ,. .. , X n) of an unknown stationary and ergodic process, for membership in a given class of processes, such as the class of all finite order Markov chains.
متن کاملExplicit Criteria for Several Types of Ergodicity
The explicit criteria, collected in Tables 5.1 and 5.2, for several types of ergodicity of onedimensional diffusions or birth-death processes have been found out recently in a surprisingly short period. One of the criteria is for exponential ergodicity of birth-death processes. This problem has been opened for a long time in the study of Markov chains. The survey article explains in details the...
متن کامل