The existence of stationary Markov perfect equilibria in stochastic games is shown under a general condition called “(decomposable) coarser transition kernels”. This result covers various earlier existence results on correlated equilibria, noisy stochastic games, stochastic games with finite actions and stateindependent transitions, and stochastic games with mixtures of constant transition kern...

We consider some well-known families of two-player zero-sum perfect-information stochastic games played on finite directed graphs. Generalizing and unifying results of Liggett and Lippman, Zwick and Paterson, and Chatterjee and Henzinger, we show that the following tasks are polynomial-time (Turing) equivalent. – Solving stochastic parity games, – Solving simple stochastic games, – Solving stoc...

A stochastic graph game is played by two players on a game graph with probabilistic transitions. We consider stochastic graph games with ω-regular winning conditions specified as parity objectives, and mean-payoff (or limit-average) objectives. These games lie in NP ∩ coNP. We present a polynomial-time Turing reduction of stochastic parity games to stochastic mean-payoff games.