Multi-agent Reinforcem to Handle Beliefs of and Embe

We have developed a new series of multi-agent reinforcement learning algorithms that choose a policy based on beliefs about co-players policies. The algorithms are applicable to situations where a state is fully observable by the agents, but there is no limit on the number of players. Some of the algorithms employ embedded beliefs to handle the cases that co-players are also choosing a policy based on their beliefs of others’ policies. Simulation experiments on Iterated Prisoners’ Dilemma games show that the algorithms using on policy-based belief converge to highly mutually-cooperative behavior, unlike the existing algorithms based on action-based belief.