Qualitative properties of certain piecewise deterministic Markov processes

نویسندگان

  • Michel Benaïm
  • Stéphane Le Borgne
  • Florent Malrieu
  • Pierre-André Zitt
چکیده

We study a class of Piecewise Deterministic Markov Processes with state space R d × E where E is a finite set. The continuous component evolves according to a smooth vector field that is switched at the jump times of the discrete coordinate. The jump rates may depend on the whole position of the process. Working under the general assumption that the process stays in a compact set, we detail a possible construction of the process and characterize its support, in terms of the solutions set of a differential inclusion. We establish results on the long time behaviour of the process, in relation to a certain set of accessible points, which is shown to be strongly linked to the support of invariant measures. Under Hörmander-type bracket conditions, we prove that there exists a unique invariant measure and that the processes converges to equilibrium in total variation. Finally we give examples where the bracket condition does not hold, and where there may be one or many invariant measures, depending on the jump rates between the flows.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Piecewise deterministic Markov processes in biological models

We present a short introduction into the framework of piecewise deterministic Markov processes. We illustrate the abstract mathematical setting with a series of examples related to dispersal of biological systems, cell cycle models, gene expression, physiologically structured populations, as well as neural activity. General results concerning asymptotic properties of stochastic semigroups induc...

متن کامل

Piecewise-deterministic Markov Processes for Sequential Monte Carlo and MCMC∗

This talk will introduce piecewise-deterministic Markov processes, and show how they can be used to develop novel, continuous-time, variants of MCMC or SMC. A particular motivation for this work is to develop Monte Carlo methods that can sample from a posterior and that scale well to large-data.

متن کامل

Bisimulation for Communicating Piecewise Deterministic Markov Processes (CPDPs)

CPDPs (Communicating Piecewise Deterministic Markov Processes) can be used for compositional specification of systems from the class of stochastic hybrid processes formed by PDPs (Piecewise Deterministic Markov Processes). We define CPDPs and the composition of CPDPs, and prove that the class of CPDPs is closed under composition. Then we introduce a notion of bisimulation for PDPs and CPDPs and...

متن کامل

Viability, Invariance and Reachability for Controlled Piecewise Deterministic Markov Processes Associated to Gene Networks

We aim at characterizing viability, invariance and some reachability properties of controlled piecewise deterministic Markov processes (PDMPs). Using analytical methods from the theory of viscosity solutions, we establish criteria for viability and invariance in terms of the first order normal cone. We also investigate reachability of arbitrary open sets. The method is based on viscosity techni...

متن کامل

Uniform Assymptotics in the Average Continuous Control of Piecewise Deterministic Markov Processes : Vanishing Approach

This result has been generalized by Feller (cf. [12], XIII.5) to the case of uncontrolled deterministic dynamics in continuous time, [2] to deterministic controlled dynamics, etc. A further generalization (cf. [19]) allows the limit value function with respect to a system governed by controlled deterministic dynamics to depend on the initial data. In the Brownian diffusion setting, similar resu...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2017