Service Oriented Computing (SOC) is a design paradigm that has evolved from earlier paradigms including object-orientation and component-based software engineering. Important features of services are compositionality, context-independence, encapsulation and re-usability. To support the formal design and analysis of SOC applications recently a number of Service Oriented Calculi have been propose...

A Markovian dichotomic system driven by a deterministic time-periodic force is analyzed in terms of the statistical properties of the switching events between the states. The consideration of the counting process of the switching events leads us to define a discrete phase. We obtain expressions for the instantaneous output frequency and phase diffusion associated to the dichotomic process, as w...

Several Markovian process calculi have been proposed in the literature, which differ from each other for various aspects. With regard to the action representation, we distinguish between integrated-time Markovian process calculi, in which every action has an exponentially distributed duration associated with it, and orthogonal-time Markovian process calculi, in which action execution is separat...

We study a one parameter family of discrete Löwner evolutions driven by a random walk on the real line. We show that it converges to the stochastic Löwner evolution (SLE) under rescaling. We show that the discrete Löwner evolution satisfies Markovian-type and symmetry properties analogous to SLE, and establish a phase transition property for the discrete Löwner evolution when the parameter equa...

We investigate a particle in a ratchet potential (the system) coupled to an harmonic bath of N=1-500 degrees of freedom (the discrete bath). The dynamics of the energy exchange between the system and the discrete bath is studied in the transition regime from low to high values of N . First manifestation of dissipation (energy lost by the system) appears for the bath composed of 10 less, similar...

We derive the two-dimensional transforms of the transient workload and queue-length distributions in the single-server queue with general service times and a batch Markovian arrival process (BMAP). This arrival process includes the familiar phase-type renewal process and the Markov modulated Poisson process as special cases, and allows correlated interarrival times and batch sizes. Numerical re...

This paper focuses on learning in the presence of a Markovian teammate in Ad hoc teams. A Markovian teammate’s policy is a function of a set of discrete feature values derived from the joint history of interaction, where the feature values transition in a Markovian fashion on each time step. We introduce a novel algorithm “Learning to Cooperate with a Markovian teammate”, or Lcm, that converges...