Empirical variance minimization with applications in variance reduction and optimal control
نویسندگان
چکیده
We study the problem of empirical minimization for variance-type functionals over functional classes. Sharp non-asymptotic bounds excess variance are derived under mild conditions. In particular, it is shown that some restrictions imposed on class fast convergence rates can be achieved including optimal non-parametric expressive classes in non-Donsker regime additional assumptions. Our main applications include reduction and control.
منابع مشابه
SGD with Variance Reduction beyond Empirical Risk Minimization
We introduce a doubly stochastic proximal gradient algorithm for optimizing a finite average of smooth convex functions, whose gradients depend on numerically expensive expectations. Our main motivation is the acceleration of the optimization of the regularized Cox partial-likelihood (the core model used in survival analysis), but our algorithm can be used in different settings as well. The pro...
متن کاملVariance analysis of control variate technique and applications in Asian option pricing
This paper presents an analytical view of variance reduction by control variate technique for pricing arithmetic Asian options as a financial derivatives. In this paper, the effect of correlation between two random variables is shown. We propose an efficient method for choose suitable control in pricing arithmetic Asian options based on the control variates (CV). The numerical experiment shows ...
متن کاملStochastic dual averaging methods using variance reduction techniques for regularized empirical risk minimization problems
We consider a composite convex minimization problem associated with regularized empirical risk minimization, which often arises in machine learning. We propose two new stochastic gradient methods that are based on stochastic dual averaging method with variance reduction. Our methods generate a sparser solution than the existing methods because we do not need to take the average of the history o...
متن کاملBattery Energy Storage Scheduling for Optimal Load Variance Minimization
Generation portfolio can be significantly altered due to the deployment of distributed energy resources (DER) in distribution networks and the concept of microgrid. Generally, distribution networks can operate in a more resilient and economic fashion through proper coordination of DER. However, due to the partially uncontrollable and stochastic nature of some DER, the variance of net load of di...
متن کاملMulti-machine Scheduling with Variance Minimization
This paper addresses the problem of scheduling n jobs on m identical parallel machines so as to minimize the completion time variance. Properties of optimal solutions are derived first. Then, complexity results are obtained, which show that the problem is NP-complete in the strong sense when m is arbitrary, and NP-complete in the ordinary sense when m is fixed. Two algorithms are proposed. The ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Bernoulli
سال: 2022
ISSN: ['1573-9759', '1350-7265']
DOI: https://doi.org/10.3150/21-bej1392