The arc costs are assumed to be online parameters of the network and decisions should be made while the costs of arcs are not known. The policies determine the permitted nodes and arcs to traverse and they are generally defined according to the departure nodes of the current policy nodes. In on-line created tours arc costs are not available for decision makers. The on-line traversed nodes are f...

In this paper, the convergence of a recently proposed CORDIC adaptive lattice filtering (CALF) algorithm is proved. It is shown that the update of the rotation angle (which is equivalent to the reflection coefficient) can be modeled by the state transition of a regular Markov chain, with each rotation angle being a state. The convergence of the CALF algorithm then is established as this Markov ...

Measuring particle size distribution through calculating light scattering intensity is a typical inverse problem. This paper builds an inverse mathematical model based on Mie scattering, deduces the inversion formulas for particle size, and calculates the relative coefficients through programming with built-in functions in MATLAB. In order to improve the accuracy and noise immunity of particle ...

A discrete-time conversion is applied to the continuous-time Markov process that describes the dynamics of biochemically reacting systems within the discrete-state stochastic modeling approach (chemical master equation approach). This yields a stochastically identical discrete-time Markov chain and an according formulation of the chemical master equation. Simulating the resulting chain is equiv...

In this paper we give some basic characterizations of minimal Markov basis for a connected Markov chain, which is used for performing exact tests in discrete exponential families given a sufficient statistic. We also give a necessary and sufficient condition for uniqueness of minimal Markov basis. A general algebraic algorithm for constructing a connected Markov chain was given by Diaconis and ...

We consider testing the quasi-independence hypothesis for two-way contingency tables which contain some structural zero cells. For sparse contingency tables where the large sample approximation is not adequate, the Markov chain Monte Carlo exact tests are powerful tools. To construct a connected chain over the two-way contingency tables with fixed sufficient statistics and an arbitrary configur...

A simple Monte-Carlo algorithm can be used to calculate Dempster-Shafer belief very efficiently unless the conflict between the evidences is very high. This paper introduces and explores Markov Chain Monte-Carlo algorithms for calculating Dempster-Shafer belief that can also work well when the conflict is high.

In this paper, we look at the online bounded-space bin cover problem and show how we can use the language of Markov chains to model and analyze the problem. We will use the insights given by the Markov chains to design an algorithm for the online bounded-space bin cover problem. The algorithm is a heuristic that we create by simplifying the Markov chain. We also show how we can use simple metho...

Solution concepts help designing co-evolutionary algorithms by interfacing search mechanisms and problems. This work analyses co-evolutionary dynamics by coupling the notion of solution concept with a Markov chain model of coevolution. It is shown that once stationarity has been reached by the Markov chain, and given a particular solution concept of interest, the dynamics can be seen as a Berno...

Exact calculations for probabilities on complex pedigrees are computationally intensive and very often infeasible. Markov chain Monte Carlo methods are frequently used to approximate probabilities and likelihoods of interest. However, when a locus with more than two alleles is considered , the underlying Markov chain is not guaranteed to be irreducible and the results of such analyses are unrel...