Minimum Description Length Principle in Supervised Learning With Application to Lasso
نویسندگان
چکیده
منابع مشابه
Minimum Description Length Principle in Supervised Learning with Application to Lasso
The minimum description length (MDL) principle in supervised learning is studied. One of the most important theories for the MDL principle is Barron and Cover’s theory (BC theory), which gives a mathematical justification of the MDL principle. The original BC theory, however, can be applied to supervised learning only approximately and limitedly. Though Barron et al. recently succeeded in remov...
متن کاملMinimum Description Length Principle
The minimum description length (MDL) principle states that one should prefer the model that yields the shortest description of the data when the complexity of the model itself is also accounted for. MDL provides a versatile approach to statistical modeling. It is applicable to model selection and regularization. Modern versions of MDL lead to robust methods that are well suited for choosing an ...
متن کاملThe Minimum Description Length Principle and Its Application to Online Learning of Handprinted Characters
Our objective is to introduce Rissanen's Minimum Description Length (MDL) Principle as a useful tool for character recognition and present a first application. Using M D L principle, a learning system has been implemented which, after simple training, is able to online recognize th trainer's handwriting in English and Chinese (including several thousand characters) with high success rate. The e...
متن کاملTransfer Learning Using the Minimum Description Length Principle with a Decision Tree Application
Transfer learning is about how learning from one domain or a collection of domains can be applied to another. It is learning from similarities and parallels, from experience. This paper is about a distribution free, data driven, extendable framework for transfer learning, based on the minimum description length principle. We define transfer learning in terms of a specific framework, where we ha...
متن کاملA tutorial introduction to the minimum description length principle
This tutorial provides an overview of and introduction to Rissanen’s Minimum Description Length (MDL) Principle. The first chapter provides a conceptual, entirely non-technical introduction to the subject. It serves as a basis for the technical introduction given in the second chapter, in which all the ideas of the first chapter are made mathematically precise. This tutorial will appear as the ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 2020
ISSN: 0018-9448,1557-9654
DOI: 10.1109/tit.2020.2998577