Learning to Rendezvous during Multi-agent Explo- ration
نویسندگان
چکیده
We consider the problem of rendezvous between two robots collaborating in learning the layout of an unknown environment. That is, how can two autonomous exploring agents that cannot communicate with one another over long distances meet if they start exploring at di erent locations in an unknown environment. The intended application is collaborative map exploration. Ours is the rst work to formalize the characteristics of the rendezvous problem, and we approach it by proposing several alternative algorithms that the robots could use in attempting to rendezvous quickly while continuing to explore. The algorithms are based on the assumption that potential rendezvous locations, referred to as landmarks, can be determined by the robots as they explore; these locations are based on a distinctiveness measure computed with an arbitrary sensor. We consider the performance of our proposed algorithms analytically with respect to both expectedand worst-case behaviour. We then examine their behaviour under a wider set of conditions in
منابع مشابه
Utilizing Generalized Learning Automata for Finding Optimal Policies in MMDPs
Multi agent Markov decision processes (MMDPs), as the generalization of Markov decision processes to the multi agent case, have long been used for modeling multi agent system and are used as a suitable framework for Multi agent Reinforcement Learning. In this paper, a generalized learning automata based algorithm for finding optimal policies in MMDP is proposed. In the proposed algorithm, MMDP ...
متن کاملCone Invariance and Rendezvous of Multiple Agents
In this paper we present a dynamical systems framework for analyzing multi-agent rendezvous problems and characterize the dynamical behavior of the collective system. Recently, the problem of rendezvous has been addressed considerably in the graph theoretic framework, which is strongly based on the communication aspects of the problem. The proposed approach is based on set invariance theory and...
متن کاملImproving Agent Performance for Multi-Resource Negotiation Using Learning Automata and Case-Based Reasoning
In electronic commerce markets, agents often should acquire multiple resources to fulfil a high-level task. In order to attain such resources they need to compete with each other. In multi-agent environments, in which competition is involved, negotiation would be an interaction between agents in order to reach an agreement on resource allocation and to be coordinated with each other. In recent ...
متن کاملCollaborative Robot Exploration and Rendezvous: Algorithms, Performance Bounds and Observations
We consider the problem of how two heterogeneous robots can arrange to meet in an unknown environment from unknown starting locations: that is, the problem of arranging a robot rendezvous. We are interested, in particular, in allowing two robots to rendezvous so that they can collaboratively explore an unknown environment. Specifically, we address the problem of how a pair of exploring agents t...
متن کاملUNIVERSITY OF LIVERPOOL ANNUAL PROGRESS REPORT Distributed Navigation
Short description of tthe project motivation, its importance and results. Introduction Introduction and overview of the thesis, explains the the two main themes in the thesis and their relation to each other. With further introduce the models used for mobility and commucation, the related work and my personal contribution to the field. Location aware rendezvous Introduction to the rendezvous pr...
متن کامل