Decision Concept Lattice vs. Decision Trees and Random Forests
نویسندگان
چکیده
Decision trees and their ensembles are very popular models of supervised machine learning. In this paper we merge the ideas underlying decision trees, FCA by proposing a new learning model which can be constructed in polynomial time is applicable for both classification regression problems. Specifically, first propose polynomial-time algorithm constructing part concept lattice that based on tree. Second, describe prediction scheme solving tasks with quality comparable to state-of-the-art models.
منابع مشابه
Privately Evaluating Decision Trees and Random Forests
Decision trees and random forests are common classifiers with widespread use. In this paper,we develop two protocols for privately evaluating decision trees and random forests. We operatein the standard two-party setting where the server holds a model (either a tree or a forest),and the client holds an input (a feature vector). At the conclusion of the protocol, the clientlearns...
متن کاملForests of Decision Trees
In many cases it is better to extract a set of decision trees and a set of possible logical data descriptions instead of a single model. Methods for creating forests of decision trees based on Separability of Split Value (SSV) criterion are presented. Preliminary results confirm their usefulness in understanding data structures.
متن کاملDecision Forests with Oblique Decision Trees
Ensemble learning schemes have shown impressive increases in prediction accuracy over single model schemes. We introduce a new decision forest learning scheme, whose base learners are Minimum Message Length (MML) oblique decision trees. Unlike other tree inference algorithms,MMLoblique decision tree learning does not over-grow the inferred trees. The resultant trees thus tend to be shallow and ...
متن کاملEmbedding Decision Trees and Random Forests in Constraint Programming
In past papers, we have introduced Empirical Model Learning (EML) as a method to enable Combinatorial Optimization on real world systems that are impervious to classical modeling approaches. The core idea in EML consists in embedding a Machine Learning model in a traditional combinatorial model. So far, the method has been demonstrated by using Neural Networks and Constraint Programming (CP). I...
متن کاملHeterogeneous Forests of Decision Trees
In many cases it is better to extract a set of decision trees and a set of possible logical data descriptions instead of a single model. The trees that include premises with constraints on the distances from some reference points are more flexible because they provide nonlinear decision borders. Methods for creating heterogeneous forests of decision trees based on Separability of Split Value (S...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2021
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-030-77867-5_16