Model Selection Using Information Theory and the MDL Principle
نویسندگان
چکیده
منابع مشابه
Model Selection using Information Theory and the MDL Principle ∗
Information theory offers a coherent, intuitive view of model selection. This perspective arises from thinking of a statistical model as a code, an algorithm for compressing data into a sequence of bits. The description length is the length of this code for the data plus the length of a description of the model itself. The length of the code for the data measures the fit of the model to the dat...
متن کاملHypothesis Selection and Testing by the MDL Principle
The central idea of the MDL (Minimum Description Length) principle is to represent a class of models (hypotheses) by a universal model capable of imitating the behavior of any model in the class. The principle calls for a model class whose representative assigns the largest probability or density to the observed data. Two examples of universal models for parametric classesM are the normalized m...
متن کاملConstructing semantic representations using the MDL principle
Words receive a signiicant part of their meaning from use in communicative settings. The formal mechanisms of lexical acquisition, as they apply to rich situational settings, may also be studied in the limited case of corpora of written texts. This work constitutes an approach to deriving semantic representations for lexemes using techniques from statistical induction. In particular, a number o...
متن کاملQuery-based summarization using MDL principle
Query-based text summarization is aimed at extracting essential information that answers the query from original text. The answer is presented in a minimal, often predefined, number of words. In this paper we introduce a new unsupervised approach for query-based extractive summarization, based on the minimum description length (MDL) principle that employs Krimp compression algorithm (Vreeken et...
متن کاملMotion-based object segmentation and estimation using the MDL principle
There are increasing demands for ultralow bit-rate video image transmission. We present a new formulation of moving object segmentation and motion estimation to quantify the potential gain in using object-oriented motion compensation in image sequence coding. Motivated by real-valued parameter estimation required in object-oriented motion-compensated video source coding, a framework motivated b...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Sociological Methods & Research
سال: 2004
ISSN: 0049-1241,1552-8294
DOI: 10.1177/0049124103262064