Models based on Markov chains are used for decision-making studies in many application domains; however , there are no widely adopted methods for performing sensitivity analysis on the associated transition probability matrices (TPMs). This article describes two simulation-based approaches for probabilistic sensitivity analysis of a given finite-state, finite-horizon, discrete-time Markov chain...

Two-photon excitation laser scanning microscopy (TPM) was used to image human, porcine, and rabbit nasal septal cartilage. TPM provides optical sections of thick tissue specimens in situ without the use of exogenous dyes or need for tissue fixation. The cartilage tissue was imaged using near-infrared light generated by a mode-locked titanium/sapphire laser that was raster-scanned and coupled to...

We consider transformations between attractor basins of binary cylindrical cellular automata resulting from mutations. A τ -point mutation of a state consists in toggling τ sites in that state. Results of such mutations are described by a ruledependent probability matrix. The structure of this matrix is studied in relation to the structure of the state transition diagram and several theorems re...

This paper studies the stochastic stabilization problem for a class of singular Markovian jump system. The aim is to determine whether or not there is a stochastic feedback controller stabilizing a given singular Markovian jump system (SMJS). A new kind of stochastic controller only in the diffusion part is proposed such that the closed-loop system has a unique solution and is almost surely exp...

in a finite stationary markov chain, transition probabilities may depend on some explanatoryvariables. a similar problem has been considered here. the corresponding posteriors are derived andinferences are done using these posteriors. finally, the procedure is illustrated with a real example.

This paper proposes a dynamic preventive maintenance strategy for a multi-state deteriorating production system. A real-time operating state can be derived via the healthy index. A time-dependent state transition probability matrix is used to describe the aging and deteriorating system. The current probability transition matrix and the aging factor are estimated based on historical data. Then o...

In this paper, we are discuss about the issue of synchronization for singular complex dynamical networks with Markovian jumping parameters and additive time-varying delays through pinning control by Takagi-Sugeno (T-S) fuzzy theory.The complex dynamical systems consist of m nodes and the systems switch from one mode to another, a Markovian chain with glorious transition probabili...

in this paper by using the data related to the monthly precipitation of 13 stations situated in west azerbaijan province of iran in a time period of 34 years, monitoring and forecasting the probability of a drought occurrence is evaluated in next coming months. in this process, first the monthly precipitation amounts for each rainfall station are used in order to calculate the standardized prec...