A reinforcement learning approach to gait training improves retention
نویسندگان
چکیده
Many gait training programs are based on supervised learning principles: an individual is guided towards a desired gait pattern with directional error feedback. While this results in rapid adaptation, improvements quickly disappear. This study tested the hypothesis that a reinforcement learning approach improves retention and transfer of a new gait pattern. The results of a pilot study and larger experiment are presented. Healthy subjects were randomly assigned to either a supervised group, who received explicit instructions and directional error feedback while they learned a new gait pattern on a treadmill, or a reinforcement group, who was only shown whether they were close to or far from the desired gait. Subjects practiced for 10 min, followed by immediate and overnight retention and over-ground transfer tests. The pilot study showed that subjects could learn a new gait pattern under a reinforcement learning paradigm. The larger experiment, which had twice as many subjects (16 in each group) showed that the reinforcement group had better overnight retention than the supervised group (a 32% vs. 120% error increase, respectively), but there were no differences for over-ground transfer. These results suggest that encouraging participants to find rewarding actions through self-guided exploration is beneficial for retention.
منابع مشابه
Free gait generation with reinforcement learning for a six-legged robot
In this paper the problem of free gait generation and adaptability with reinforcement learning are addressed for a six-legged robot. Using the developed free gait generation algorithm the robot maintains to generate stable gaits according to the commanded velocity. The reinforcement learning scheme incorporated into the free gait generation makes the robot choose more stable states and develop ...
متن کاملDesign and Implementation of Fuzzy Policy Gradient Gait Learning Method for Walking Pattern Generation of Humanoid Robots
The design and implementation of Fuzzy Policy Gradient Learning (FPGL) method for humanoid robot is proposed in this paper. This paper not only introduces the phases of the humanoid robot walking, but also improves and parameterizes the gait pattern of the robot. FPGL is an integrated machine learning method based on Policy Gradient Reinforcement Learning (PGRL) and fuzzy logic concept in order...
متن کاملComparison of dyad training method with cooperative and competitive approach in the learning of Basketball Free Throw
Abstract This study aimed to Comparison of dyad training method with cooperative and competitive approach in the learning of Basketball Free Throw. The study sample included 24 girl’s students aged 13-15 years old who had no experience in free throw. Based on pretest scores, the participants were assigned to either the cooperative dyad training group or the competitive dyad training group. In ...
متن کاملAutonomous Reinforcement Learning with Experience Replay for Humanoid Gait Optimization
This paper demonstrates application of Reinforcement Learning to optimization of control of a complex system in realistic setting that requires efficiency and autonomy of the learning algorithm. Namely, Actor-Critic with experience replay (which addresses efficiency), and the Fixed Point method for step-size estimation (which addresses autonomy) is applied here to approximately optimize humanoi...
متن کاملMulticast Routing in Wireless Sensor Networks: A Distributed Reinforcement Learning Approach
Wireless Sensor Networks (WSNs) are consist of independent distributed sensors with storing, processing, sensing and communication capabilities to monitor physical or environmental conditions. There are number of challenges in WSNs because of limitation of battery power, communications, computation and storage space. In the recent years, computational intelligence approaches such as evolutionar...
متن کامل