Simulating the use of Macro-Actions Through Action Reordering
نویسندگان
چکیده
The use of macro-actions in planning introduces a trade-off. Macro-actions can offer search guidance by suggesting sequences of actions; but can potentially make search more expensive by increasing the branching factor. In this paper we present a technique for simulating the use of macro-actions by altering the order in which actions are considered for application during enforced hill-climbing search. Actions are ordered based on the number of times they have occurred, in past solution plans, following the last action added to the plan. We demonstrate that the action-reordering technique used can offer improved search performance without the negative performance impacts often observed when using macro-
منابع مشابه
Online generation and use of macro-actions in forward-chaining planning
This thesis presents a technique for online learning and management of macroactions in forward chaining planning. Macro-actions are learnt on plateaux, areas of the search landscape where the heuristic cannot offer good search guidance, and are reused when future plateaux are encountered. Libraries of macro-actions are generated, storing macro-actions for use on future problems. Several strateg...
متن کاملOnline Identification of Useful Macro-Actions for Planning
This paper explores issues encountered when performing online management of large collections of macro-actions generated for use in planning. Existing approaches to managing collections of macro-actions are designed for use with offline macro-action learning, pruning candidate macro-actions on the basis of their effect on the performance of the planner on small training problems. In this paper ...
متن کاملRoles of Macro - Actions in Accelerating Reinforcement
We analyze the use of built-in policies, or macro-actions, as a form of domain knowledge that can improve the speed and scaling of reinforcement learning algorithms. Such macro-actions are often used in robotics, and macro-operators are also well-known as an aid to state-space search in AI systems. The macro-actions we consider are closed-loop policies with termination conditions. The macro-act...
متن کاملدعوای گروهی و تأثیر آن بر حمایت از حقوق مصرفکننده
Class action is a legal procedure of a considerable group of people to take joint actions against a single defendant. In this form of action, one or more people representing while also being a member of a class, take an action for themselves and on behalf of others, regarding a common claim among the members of the class. Although the members of the class have no active role in the ju...
متن کاملPUMA: Planning Under Uncertainty with Macro-Actions
Planning in large, partially observable domains is challenging, especially when a long-horizon lookahead is necessary to obtain a good policy. Traditional POMDP planners that plan a different potential action for each future observation can be prohibitively expensive when planning many steps ahead. An efficient solution for planning far into the future in fully observable domains is to use temp...
متن کامل