We consider the burst-level congestion control problem in a communication network with multiple traffic sources, modeled as infinite banks of fluid traffic. The controlled traffic shares a common bottleneck node with highpriority cross traffic modeled as Markov-modulated fluid. We introduce a simulation-based congestion control scheme capable of performing effectively under rapidly-varying serv...

| This paper presents a methodology to speed up the stationary analysis of large Markov chains that model asynchronous systems. Instead of directly working on the original Markov chain, we propose to analyze a smaller Markov chain obtained via a novel technique called state compression. Once the smaller chain is solved, the solution to the original chain is obtained via a process called expansi...

This paper proposes a new detection technique for fadingin/out text regions fromMPEG1 bitstreams based on a Markov model. We focus on the properties that the luminance of a text region varies linearly in fading, and that text regions require larger amount of bits than non-text regions. These features are extracted directly from a target MPEG1 bitstream and they are fed into the Markov model to ...

We describe a method for learning statistical models of images using a second-order hidden Markov mesh model. We show that the Viterbi algorithm approach used for segmenting Markov chains can be extended to Markov meshes. The segmental k-means algorithm can then be applied to iteratively estimate the state transition matrix and the probability densities of the observations for the model. We als...

Due to the effective role of Markov models in customer relationship management (CRM), there is a lack of comprehensive literature review which contains all related literatures. In this paper the focus is on academic databases to find all the articles that had been published in 2011 and earlier. One hundred articles were identified and reviewed to find direct relevance for applying Markov models...

Repairable standby system’s study and analysis is an important topic in reliability. Analytical techniques become very complicated and unrealistic especially for modern complex systems. There have been attempts in the literature to evolve more realistic techniques using simulation approach for reliability analysis of systems. This paper proposes a hybrid approach called as Markov system ...

We study the long run behaviour of interactive Markov chains on in1nite product spaces. In view of microstructure models of 1nancial markets, the interaction has both a local and a global component. The convergence of such Markov chains is analyzed on the microscopic level and on the macroscopic level of empirical 1elds. We give su5cient conditions for convergence on the macroscopic level. Usin...

This paper presents a methodology to speed up the stationary analysis of large Markov chains that model asynchronous systems. Instead of directly working on the original Markov chain, we propose to analyze a smaller Markov chain obtained via a novel technique called string-based state compression. Once the smaller chain is solved, the solution to the original chain is obtained via a process cal...

This paper presents a methodology to speed up the stationary behavior analysis of large Markov chains that model asynchronous systems. Instead of directly working on the original Markov chain, we propose to analyze a smaller Markov chain obtained via a novel technique called string-based state compression. Once the smaller chain is solved, the solution to the original chain is obtained via a pr...

A Markov-model based technique is proposed to automatically detect a patient's disease state into different subclasses of Supraventricular arrhythmia based upon automated ECG analysis. Separate Markov-models have been developed for each subclass using a finer resolution of P-waves that takes into account left and right atria and multiple slopes of the P-waves. ECG data from Physionet database h...