Convergence of a second order Markov chain
نویسندگان
چکیده
منابع مشابه
analysis of ruin probability for insurance companies using markov chain
در این پایان نامه نشان داده ایم که چگونه می توان مدل ریسک بیمه ای اسپیرر اندرسون را به کمک زنجیره های مارکوف تعریف کرد. سپس به کمک روش های آنالیز ماتریسی احتمال برشکستگی ، میزان مازاد در هنگام برشکستگی و میزان کسری بودجه در زمان وقوع برشکستگی را محاسبه کرده ایم. هدف ما در این پایان نامه بسیار محاسباتی و کاربردی تر از روش های است که در گذشته برای محاسبه این احتمال ارائه شده است. در ابتدا ما نشا...
15 صفحه اولSecond Order Sliding Mode Control With Finite Time Convergence
In this paper, a new smooth second order sliding mode control is proposed. This algorithm is a modified form of Super Twisting algorithm. The Super Twisting guarantees the asymptotic stability, but the finite time stability of proposed method is proved with introducing a new particular Lyapunov function. The Proposed algorithm which is able to control nonlinear systems with matched structured u...
متن کاملA Simplified Higher-Order Markov Chain Model
In this paper, we present a simplified higher-order Markov chain model for multiple categorical data sequences also called as simplified higher-order multivariate Markov chain model. The number of the parameters of the new model is only ) ) (( 2 sm s n O + which is less than ) (( 2 m ns O in the higher-order multivariate Markov chain model. Numerical experiments illustrate the benefits of our n...
متن کاملMarkov Chain Decomposition for Convergence Rate Analysis
In this paper we develop tools for analyzing the rate at which a reversible Markov chain converges to stationarity. Our techniques are useful when the Markov chain can be decomposed into pieces which are themselves easier to analyze. The main theorems relate the spectral gap of the original Markov chains to the spectral gap of the pieces. In the first case the pieces are restrictions of the Mar...
متن کاملRelative Entropy Rate between a Markov Chain and Its Corresponding Hidden Markov Chain
In this paper we study the relative entropy rate between a homogeneous Markov chain and a hidden Markov chain defined by observing the output of a discrete stochastic channel whose input is the finite state space homogeneous stationary Markov chain. For this purpose, we obtain the relative entropy between two finite subsequences of above mentioned chains with the help of the definition of...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Applied Mathematics and Computation
سال: 2014
ISSN: 0096-3003
DOI: 10.1016/j.amc.2014.05.011