Evolutionary Learning of Interpretable Decision Trees
نویسندگان
چکیده
Reinforcement learning techniques achieved human-level performance in several tasks the last decade. However, recent years, need for interpretability emerged: we want to be able understand how a system works and reasons behind its decisions. Not only assess safety of produced systems, also it extract knowledge about unknown problems. While some that optimize decision trees reinforcement do exist, they usually employ greedy algorithms or not exploit rewards given by environment. This means these may easily get stuck local optima. In this work, propose novel approach interpretable uses trees. We present two-level optimization scheme combines advantages evolutionary with Q-learning. way decompose problem into two sub-problems: finding meaningful useful decomposition state space, associating an action each state. test proposed method on three well-known benchmarks, which results competitive respect state-of-the-art both interpretability. Finally, perform ablation study confirms using gives boost non-trivial environments one-layer technique.
منابع مشابه
Learning Characteristic Decision Trees
Decision trees constructed by ID3-like algorithms suffer from an inability of detecting instances of categories not present in the set of training examples, i.e., they are discriminative representations. Instead, such instances are assigned to one of the classes actually present in the training set, resulting in undesired misclassifications. Two methods of reducing this problem by learning char...
متن کاملLearning fuzzy decision trees
We present a recurrent neural network which learns to suggest the next move during the descent along the branches of a decision tree. More precisely, given a decision instance represented by a node in the decision tree, the network provides the degree of membership of each possible move to the fuzzy set z.Lt;good movez.Gt;. These fuzzy values constitute the core of the probability of selecting ...
متن کاملEvolutionary Induction of Cost-Sensitive Decision Trees
In the paper, a new method for cost-sensitive learning of decision trees is proposed. Our approach consists in extending the existing evolutionary algorithm (EA) for global induction of decision trees. In contrast to the classical top-down methods, our system searches for the whole tree at the moment. We propose a new fitness function which allows the algorithm to minimize expected cost of clas...
متن کاملAnytime Learning of Decision Trees
The majority of existing algorithms for learning decision trees are greedy—a tree is induced topdown, making locally optimal decisions at each node. In most cases, however, the constructed tree is not globally optimal. Even the few non-greedy learners cannot learn good trees when the concept is difficult. Furthermore, they require a fixed amount of time and are not able to generate a better tre...
متن کاملBreeding Decision Trees Using Evolutionary Techniques
We explore the use of genetic algorithms to directly evolve classification decision trees. We argue on the suitability of such a concept learner due to its ability to efficiently search complex hypotheses spaces and discover conditionally dependent as well as irrelevant attributes. The performance of the system is measured on a set of artificial and standard discretized concept-learning problem...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2023
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2023.3236260