We show fundamental properties of the Markov semigroup recently proposed MCMC algorithms based on Piecewise-deterministic processes (PDMPs) such as Bouncy Particle Sampler, Zig-Zag process or Randomized Hamiltonian Monte Carlo method. Under assumptions typically satisfied in settings, we prove that PDMPs are Feller and their generator admits space infinitely differentiable functions with compac...

1 Markov chains and Markov processes 4 1.1 Discrete-time Markov chains . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 1.2 Continuous-time Markov chains . . . . . . . . . . . . . . . . . . . . . . . . . 6 1.3 General definitions for Markov processes . . . . . . . . . . . . . . . . . . . . 10 1.4 Poisson processes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 1.5 H...

A new Markov-based method for real time prediction of network transmission time delays is introduced. The method considers a Multi-Layer Perceptron (MLP) neural model for the transmission network, where the number of neurons in the input layer is minimized so that the required calculations are reduced and the method can be implemented in the real-time. For this purpose, the Markov process order...

Abstract: Stochastic models such as mixture models, graphical models, Markov random fields and hidden Markov models have key role in probabilistic data analysis. In this paper, we used Gaussian mixture model to the pixels of an image. The parameters of the model were estimated by EM-algorithm.   In addition pixel labeling corresponded to each pixel of true image was made by Bayes rule. In fact,...

In this short note, we have given a short proof for the existence of the Haar measure on commutative locally compact hypergroups based on functional analysis methods by using Markov-Kakutani fixed point theorem.

in this paper by using the data related to the monthly precipitation of 13 stations situated in west azerbaijan province of iran in a time period of 34 years, monitoring and forecasting the probability of a drought occurrence is evaluated in next coming months. in this process, first the monthly precipitation amounts for each rainfall station are used in order to calculate the standardized prec...

texture image analysis is one of the most important working realms of imageprocessing in medical sciences and industry. up to present, different approacheshave been proposed for segmentation of texture images. in this paper, we offeredunsupervised texture image segmentation based on markov random field (mrf)model. first, we used gabor filter with different parameters’ (frequency,orientation) va...