Further developments of extensive-form replicator dynamics using the sequence-form representation

نویسنده

  • Marc Lanctot
چکیده

Replicator dynamics model the interactions and change in large populations of agents. Standard replicator dynamics, however, only allow single action interactions between agents. Complex interactions, as modeled by general extensive games, have received comparatively little attention in this setting. Recently, replicator dynamics have been adapted to extensive-form games represented in sequence form, leading to a large reduction in computational resource requirements. In this paper, we first show that sequenceform constraints and realization equivalence to standard replicator dynamics are maintained in general n-player games. We show that sequence-form replicator dynamics can minimize regret, leading to equilibrium convergence guarantees in two-player zero-sum games. We provide the first empirical evaluation of sequence-form replicator dynamics, applied to n-player Kuhn poker with two, three, and four players. Our results show that the average strategies generated by sequence-form replicator dynamics produce approximate equilibrium strategies with increasing accuracy over time.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Efficient Evolutionary Dynamics with Extensive-Form Games

Evolutionary game theory combines game theory and dynamical systems and is customarily adopted to describe evolutionary dynamics in multi–agent systems. In particular, it has been proven to be a successful tool to describe multi–agent learning dynamics. To the best of our knowledge, we provide in this paper the first replicator dynamics applicable to the sequence form of an extensive–form game,...

متن کامل

Evolutionary Dynamics of Q-Learning over the Sequence Form

Multi–agent learning is a challenging open task in artificial intelligence. It is known an interesting connection between multi–agent learning algorithms and evolutionary game theory, showing that the learning dynamics of some algorithms can be modeled as replicator dynamics with a mutation term. Inspired by the recent sequence–form replicator dynamics, we develop a new version of theQ–learning...

متن کامل

Mixed Strong Form Representation Particle Method for Solids and Structures

In this paper, a generalized particle system (GPS) method, a general method to describe multiple strong form representation based particle methods is described. Gradient, divergence, and Laplacian operators used in various strong form based particle method such as moving particle semi-implicit (MPS) method, smooth particle hydrodynamics (SPH), and peridynamics, can be described by the GPS metho...

متن کامل

Global Stabilization of Attitude Dynamics: SDRE-based Control Laws

The State-Dependant Riccati Equation method has been frequently used to design suboptimal controllers applied to nonlinear dynamic systems. Different methods for local stability analysis of SDRE controlled systems of order greater than two such as the attitude dynamics of a general rigid body have been extended in literature; however, it is still difficult to show global stability properties of...

متن کامل

Designing Learning Algorithms over the Sequence Form of an Extensive-Form Game

We focus on multi-agent learning over extensive-form games. When designing algorithms for extensive-form games, it is common the resort to tabular representations (i.e., normal form, agent form, and sequence form). Each representation provides some advantages and suffers from some drawbacks and it is not known which representation, if any, is the best one in multi-agent learning. In particular,...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2014