This paper discusses a cluster knowledge-based predictive modeling framework actualized in a learning agent that leverages on the capability of a clustering algorithm to discover in logged tutorial interactions unknown structures that may exhibit predictive characteristics. The learned cluster models are described along learner-system interaction attributes, i.e., in terms of the learner’s know...

Real-time heuristic search models an autonomous agent solving a search task. The agent operates in a real-time setting by interleaving local planning, learning and move execution. In this paper we propose a simple parametric algorithm that combines weighting with learning from multiple neighbors. Doing so breaks heuristic admissibility but allows the agent to escape heuristic depressions more q...

This paper introduces a principled approach for the design of a scalable general reinforcement learning agent. Our approach is based on a direct approximation of AIXI, a Bayesian optimality notion for general reinforcement learning agents. Previously, it has been unclear whether the theory of AIXI could motivate the design of practical algorithms. We answer this hitherto open question in the af...

Off-policy sampling and experience replay are key for improving sample efficiency scaling model-free temporal difference learning methods. When combined with function approximation, such as neural networks, this combination is known the deadly triad potentially unstable. Recently, it has been shown that stability good performance at scale can be achieved by combining emphatic weightings multi-s...

Argumentation games have been proved to be a robust and flexible tool to resolve conflicts among agents. An agent can propose its explanation and its goal known as a claim, which can be refuted by other agents. The situation is more complicated when there are more than two agents playing the game. We propose a weighting mechanism for competing premises to tackle with conflicts from multiple age...

Argumentation games have been proved to be a robust and flexible tool to resolve conflicts among agents. An agent can propose its explanation and its goal known as a claim, which can be refuted by other agents. The situation is more complicated when there are more than two agents playing the game. We propose a weighting mechanism for competing premises to tackle with conflicts from multiple age...