Qualitative properties of certain piecewise deterministic Markov processes
نویسندگان
چکیده
We study a class of Piecewise Deterministic Markov Processes with state space R d × E where E is a finite set. The continuous component evolves according to a smooth vector field that is switched at the jump times of the discrete coordinate. The jump rates may depend on the whole position of the process. Working under the general assumption that the process stays in a compact set, we detail a possible construction of the process and characterize its support, in terms of the solutions set of a differential inclusion. We establish results on the long time behaviour of the process, in relation to a certain set of accessible points, which is shown to be strongly linked to the support of invariant measures. Under Hörmander-type bracket conditions, we prove that there exists a unique invariant measure and that the processes converges to equilibrium in total variation. Finally we give examples where the bracket condition does not hold, and where there may be one or many invariant measures, depending on the jump rates between the flows.
منابع مشابه
Piecewise deterministic Markov processes in biological models
We present a short introduction into the framework of piecewise deterministic Markov processes. We illustrate the abstract mathematical setting with a series of examples related to dispersal of biological systems, cell cycle models, gene expression, physiologically structured populations, as well as neural activity. General results concerning asymptotic properties of stochastic semigroups induc...
متن کاملPiecewise-deterministic Markov Processes for Sequential Monte Carlo and MCMC∗
This talk will introduce piecewise-deterministic Markov processes, and show how they can be used to develop novel, continuous-time, variants of MCMC or SMC. A particular motivation for this work is to develop Monte Carlo methods that can sample from a posterior and that scale well to large-data.
متن کاملBisimulation for Communicating Piecewise Deterministic Markov Processes (CPDPs)
CPDPs (Communicating Piecewise Deterministic Markov Processes) can be used for compositional specification of systems from the class of stochastic hybrid processes formed by PDPs (Piecewise Deterministic Markov Processes). We define CPDPs and the composition of CPDPs, and prove that the class of CPDPs is closed under composition. Then we introduce a notion of bisimulation for PDPs and CPDPs and...
متن کاملViability, Invariance and Reachability for Controlled Piecewise Deterministic Markov Processes Associated to Gene Networks
We aim at characterizing viability, invariance and some reachability properties of controlled piecewise deterministic Markov processes (PDMPs). Using analytical methods from the theory of viscosity solutions, we establish criteria for viability and invariance in terms of the first order normal cone. We also investigate reachability of arbitrary open sets. The method is based on viscosity techni...
متن کاملUniform Assymptotics in the Average Continuous Control of Piecewise Deterministic Markov Processes : Vanishing Approach
This result has been generalized by Feller (cf. [12], XIII.5) to the case of uncontrolled deterministic dynamics in continuous time, [2] to deterministic controlled dynamics, etc. A further generalization (cf. [19]) allows the limit value function with respect to a system governed by controlled deterministic dynamics to depend on the initial data. In the Brownian diffusion setting, similar resu...
متن کامل