منابع مشابه
The Entropy Regularization Information Criterion
Effective methods of capacity control via uniform convergence bounds for function expansions have been largely limited to Support Vector machines, where good bounds are obtainable by the entropy number approach. We extend these methods to systems with expansions in terms of arbitrary (parametrized) basis functions and a wide range of regularization methods covering the whole range of general li...
متن کاملQuantized Minimum Error Entropy Criterion
Comparing with traditional learning criteria, such as mean square error (MSE), the minimum error entropy (MEE) criterion is superior in nonlinear and non-Gaussian signal processing and machine learning. The argument of the logarithm in Renyis entropy estimator, called information potential (IP), is a popular MEE cost in information theoretic learning (ITL). The computational complexity of IP is...
متن کاملPositive Entropy Equilibrium States
For transitive shifts of finite type, and more generally for shifts with specification, it is well-known that every equilibrium state for a Hölder continuous potential has positive entropy as long as the shift has positive topological entropy. We give a non-uniform specification condition under which this property continues to hold, and demonstrate that it does not necessarily hold for other no...
متن کاملThe entropy concept for non-equilibrium states.
In earlier work, we presented a foundation for the second law of classical thermodynamics in terms of the entropy principle. More precisely, we provided an empirically accessible axiomatic derivation of an entropy function defined on all equilibrium states of all systems that has the appropriate additivity and scaling properties, and whose increase is a necessary and sufficient condition for an...
متن کاملSmola The Entropy Regularization Information Criterion
Effective methods of capacity control via uniform convergence bounds for function expansions have been largely limited to Support Vector machines, where good bounds are obtainable by the entropy number approach. We extend these methods to systems with expansions in terms of arbitrary (parametrized) basis functions and a wide range of regularization methods covering the whole range of general li...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Journal of Chemical Education
سال: 1987
ISSN: 0021-9584,1938-1328
DOI: 10.1021/ed064p470.1