Transient Markov arrival processes
نویسندگان
چکیده
منابع مشابه
Approximate Transient Analysis of Queuing Networks by Decomposition based on Time-Inhomogeneous Markov Arrival Processes
We address the transient analysis of networks of queues with exponential service times. Such networks can easily have such a huge state space that their exact transient analysis is unfeasible. In this paper we propose an approximate transient analysis technique based on decomposing the queues of the network using a compact and approximate representation of the departure process of each queue. N...
متن کاملCanonical representation of order 2 transient Markov and rational arrival processes
Similar to other processes that are modulated by background Markov chains the matrix representation of a transient Markov arrival process is not unique and the use of a convenient unique canonical form is essential for practical computations. The paper presents a set of 5 Markovian forms which provide a unique and minimal representation for all members of the TMAP(2) class. In the course of the...
متن کاملAn Analysis of Transient Markov Decision Processes
This paper is concerned with the analysis ofMarkov decision processes in which a natural form of termination ensures that the expected future costs are bounded, at least under some policies. Whereas most previous analyses have restricted attention to the case where the set of states is finite, this paper analyses the case where the set of states is not necessarily finite or even countable. It i...
متن کاملModeling Correlated Arrival Events with Latent Semi-Markov Processes
The analysis of correlated point process data has wide applications, ranging from biomedical research to network analysis. In this work, we model such data as generated by a latent collection of continuous-time binary semi-Markov processes, corresponding to external events appearing and disappearing. A continuous-time modeling framework is more appropriate for multichannel point process data th...
متن کاملCanonical Form of Order-2 Non-stationary Markov Arrival Processes
Canonical forms of Markovian distributions and processes provide an efficient way of describing these structures by eliminating the redundancy of general representations. Canonical forms of order 2 stationary Markov arrival processes (MAPs) have already been established for both continuous and discrete time. In this paper we present canonical form of continuous time non-stationary MAPs of order...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: The Annals of Applied Probability
سال: 2003
ISSN: 1050-5164
DOI: 10.1214/aoap/1050689597