Bayesian optimization of hyperparameters from noisy marginal likelihood estimates

نویسندگان

چکیده

Bayesian models often involve a small set of hyperparameters determined by maximizing the marginal likelihood. optimization is an iterative method where Gaussian process posterior underlying function sequentially updated new evaluations. We propose novel framework for situations user controls computational effort and therefore precision This common in econometrics likelihood computed Markov chain Monte Carlo or importance sampling methods. The acquisition strategy gives optimizer option to explore with cheap noisy evaluations find optimum faster. applied estimating prior two popular on US macroeconomic time series data: steady-state vector autoregressive (BVAR) time-varying parameter BVAR stochastic volatility.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Fast Bayesian Optimization of Machine Learning Hyperparameters on Large Datasets

Bayesian optimization has become a successful tool for hyperparameter optimization of machine learning algorithms, such as support vector machines or deep neural networks. Despite its success, for large datasets, training and validating a single configuration often takes hours, days, or even weeks, which limits the achievable performance. To accelerate hyperparameter optimization, we propose a ...

متن کامل

Towards an Empirical Foundation for Assessing Bayesian Optimization of Hyperparameters

Progress in practical Bayesian optimization is hampered by the fact that the only available standard benchmarks are artificial test functions that are not representative of practical applications. To alleviate this problem, we introduce a library of benchmarks from the prominent application of hyperparameter optimization and use it to compare Spearmint, TPE, and SMAC, three recent Bayesian opti...

متن کامل

Using Meta-Learning to Initialize Bayesian Optimization of Hyperparameters

Model selection and hyperparameter optimization is crucial in applying machine learning to a novel dataset. Recently, a subcommunity of machine learning has focused on solving this problem with Sequential Model-based Bayesian Optimization (SMBO), demonstrating substantial successes in many applications. However, for expensive algorithms the computational overhead of hyperparameter optimization ...

متن کامل

Efcient Marginal Likelihood Optimization in Blind Deconvolution

In blind deconvolution one aims to estimate from an input blurred image y a sharp image x and an unknown blur kernel k. Recent research shows that a key to success is to consider the overall shape of the posterior distribution p(x, k|y) and not only its mode. This leads to a distinction between MAPx,k strategies which estimate the mode pair x, k and often lead to undesired results, and MAPk str...

متن کامل

Comparison of Estimates Using Record Statistics from Lomax Model: Bayesian and Non Bayesian Approaches

This paper address the problem of Bayesian estimation of the parameters, reliability and hazard function in the context of record statistics values from the two-parameter Lomax distribution. The ML and the Bayes estimates based on records are derived for the two unknown parameters and the survival time parameters, reliability and hazard functions. The Bayes estimates are obtained based on conju...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Journal of Applied Econometrics

سال: 2023

ISSN: ['1099-1255', '0883-7252']

DOI: https://doi.org/10.1002/jae.2961