Kolmogorov's Structure Functions and Model Selection
نویسندگان
چکیده
منابع مشابه
Few paths, fewer words: model selection with automatic structure functions
We consider the problem of finding an optimal statistical model for a given binary string. Following Kolmogorov, we use structure functions. In order to get concrete results, we replace Turing machines by finite automata and Kolmogorov complexity by Shallit and Wang’s automatic complexity. The p-value of a model for given data x is the probability that there exists a model with as few states, a...
متن کاملModel selection using measure functions
The concept of measure functions for generalization performance is suggested. This concept provides an alternative way of selecting and evaluating learned models (classifiers). In addition, it makes it possible to state a learning problem as a computational problem. The the known prior (meta-)knowledge about the problem domain is captured in a measure function that, to each possible combination...
متن کاملAutomatic Model Structure Selection
Partial linear models provide good compromises between linear and nonparametric models. However, how to decide which covariates are linear and which are nonlinear is a long-standing problem and not completely solved yet. Two methods are commonly used in practice: the first method is based on hypotheses testing, which is theoretically challenging due to multiple nonparametric tests. The second m...
متن کاملA Conceptual Model on Relationship between Structure and Functions in Rangeland Ecosystems
One of the most important issues in structure-function relationship modeling is that each rangeland has numerous functions and each of them can provide the most benefits in a certain state of that ecosystem. In fact, relationship between structure and function can be varied in different states. After presentation of the Linear Structure-Function Model based on the Clementsian succession theory,...
متن کاملModel structure selection - An update
While the topic has a long history in research, model structure selection is still one of the more challenging problems in system identification. In this tutorial we focus on impulse response modelling, and link classical techniques such as hypothesis testing and information criteria (e.g. AIC) to recent model estimation approaches, including regularisation. We discuss the problem from minimum ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 2004
ISSN: 0018-9448
DOI: 10.1109/tit.2004.838346