chloride ion ingress in concrete is the main reason of concrete corrosion. in real world both uncertainty and stochasticity are main attributes of almost all measurements including testing and modeling of chloride content profile in concrete. regarding these facts new models should be able to represent at least some of the uncertainties in the predictions. in this paper after inspiration from c...

A common method to study the dynamic behavior of macroeconomic variables is using linear time series models; however, they are unable to explain nonlinear behavior of the series. Given the dependency between stock market and derivatives, the behavior of the underlying asset price can be modeled using Markov switching process properties and the economic regime significance. In this paper, a two-...

Markov regenerative processes (MRGPs) constitute a more general class of stochastic processes than traditional Markov processes. Markovian dependency, the first-order dependency, is the simplest and most important dependency in stochastic processes. Past history of a Markov chain is summarized in the current state and the behavior of the system thereafter only depends on the current state. Sojo...

— In this paper we present a generalized Markov décision process that subsumes the traditional discounted, infinité horizon, finite state and action Markov décision process, VeinotCs discountéd décision processes, and Koehler's generalization of these two problem classes. Résumé. — Nous présentons dans cet article un processus de Markov généralisé qui englobe le processus de décision markovien ...

In many (if not most) real-world applications, the arrival of customers to a service center is not well described by renewal processses. Quite often, the times between successive arrivals are correlated, whereas renewal processes have independent interarrival times. A natural generalization is the class of semiMarkov processes (SMP), which when specifically applied to the arrival of customers a...

This paper surveys and relates the basic concepts of process algebra and the modelling of continuous time Markov chains. It provides basic introductions to both fields, where we also study the Markov chains from an algebraic perspective, viz. that of Markov chain algebra. We then proceed to study the interrelation of reactive processes and Markov chains in this setting, and introduce the algebr...