Hybrid coordination of reinforcement learning-based behaviors for AUV control
نویسندگان
چکیده
This paper proposes a Hybrid Coordination method for Behavior-based Control Architectures. The hybrid method takes in advantages of the robustness and modularity in competitive approaches as well as optimized trajectories in cooperative ones. This paper shows the feasibility of this hybrid method with a 3D-navigation application to an Autonomous Underwater Vehicle (AUV). The behaviors were learnt online by means of Reinforcement Learning. Continuous Q-learning implemented with a feed-forward neural network was applied. Realistic simulations were carried out. Results show the good performance of the hybrid method on behavior coordination as well as the convergence of the behaviors.
منابع مشابه
Direct gradient-based reinforcement learning for robot behavior learning
Autonomous Underwater Vehicles (AUV) represent a challenging control problem with complex, noisy, dynamics. Nowadays, not only the continuous scientific advances in underwater robotics but the increasing number of sub sea missions and its complexity ask for an automatization of submarine processes. This paper proposes a high-level control system for solving the action selection problem of an au...
متن کاملHigh-level Control of Autonomous Robots Using a Behavior-based Scheme and Reinforcement Learning
This paper proposes a behavior-based scheme for high-level control of autonomous robots. Two main characteristics can be highlighted in the control scheme. Behavior coordination is done through a hybrid methodology, which takes in advantages of the robustness and modularity in competitive approaches, as well as optimized trajectories in cooperative ones. As a second feature, behavior state/acti...
متن کاملVoltage Coordination of FACTS Devices in Power Systems Using RL-Based Multi-Agent Systems
This paper describes how multi-agent system technology can be used as the underpinning platform for voltage control in power systems. In this study, some FACTS (flexible AC transmission systems) devices are properly designed to coordinate their decisions and actions in order to provide a coordinated secondary voltage control mechanism based on multi-agent theory. Each device here is modeled as ...
متن کاملDepth Control of Model-Free AUVs via Reinforcement Learning
In this paper, we consider depth control problems of an autonomous underwater vehicle (AUV) for tracking the desired depth trajectories. Due to the unknown dynamical model of the AUV, the problems cannot be solved by most of modelbased controllers. To this purpose, we formulate the depth control problems of the AUV as continuous-state, continuous-action Markov decision processes (MDPs) under un...
متن کاملCombinando Modelos de Interação para Melhorar a Coordenação em Sistemas Multiagente
The main purpose of this paper is to implement a hybrid method of coordination from the combination of interaction models previously developed. The interaction models are based on rewards sharing for multi-agent learning, in order to discover interactively good action policies. The exchange of rewards among the agents during their interaction is a complex task and if it is not carried out prope...
متن کامل