Fast Convergence of Inertial Dynamics with Hessian-Driven Damping Under Geometry Assumptions

نویسندگان

چکیده

First-order optimization algorithms can be considered as a discretization of ordinary differential equations (ODEs) (Su et al. in Adv Neural Inf Process Syst 27, 2014). In this perspective, studying the properties corresponding trajectories may lead to convergence results which transfered numerical scheme. paper we analyse following ODE introduced by Attouch (J Differ Equ 261(10):5734–5783, 2016): $$\begin{aligned} \forall t\geqslant t_0,~\ddot{x}(t)+\frac{\alpha }{t}{\dot{x}}(t)+\beta H_F(x(t)){\dot{x}}(t)+\nabla F(x(t))=0, \end{aligned}$$ where $$\alpha >0$$ , $$\beta and $$H_F$$ denotes Hessian F. This derived build schemes do not require F twice differentiable shown (Math Program 1–43, 2020) (Optimization 72:1–40, 2021). We provide strong on error $$F(x(t))-F^*$$ integrability $$\Vert \nabla F(x(t))\Vert $$ under some geometry assumptions such quadratic growth around set minimizers. particular, show that decay rate for strongly convex function is $$O(t^{-\alpha -\varepsilon })$$ any $$\varepsilon . These are briefly illustrated at end paper.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Fast Convex Optimization via Inertial Dynamics with Hessian Driven Damping

We first study the fast minimization properties of the trajectories of the second-order evolution equation ẍ(t) + α t ẋ(t) + β∇Φ(x(t))ẋ(t) +∇Φ(x(t)) = 0, where Φ : H → R is a smooth convex function acting on a real Hilbert space H, and α, β are positive parameters. This inertial system combines an isotropic viscous damping which vanishes asymptotically, and a geometrical Hessian driven damping,...

متن کامل

Fast Convergence of Inertial Dynamics and Algorithms with Asymptotic Vanishing Damping

In a Hilbert space setting H, we study the fast convergence properties as t → +∞ of the trajectories of the second-order differential equation ẍ(t) + α t ẋ(t) +∇Φ(x(t)) = g(t), where ∇Φ is the gradient of a convex continuously differentiable function Φ : H → R, α is a positive parameter, and g : [t0,+∞[→ H is a small perturbation term. In this inertial system, the viscous damping coefficient αt...

متن کامل

degradation of oil impregnated paper insulation under influence of repetitive fast high voltage impulses

در طی سالهای اخیراستفاده ازمنابع انرژی تجدید پذیر در شبکه های مدرن بنا به دلایل زیست محیطی و اقتصادی به طور گسترده استفاده شده است همچون نیروگاههای بادی و خورشیدی .ولتاژتولیدی این نیروگاهها اغلب به فرم dc می باشد وادوات الکترونیک قدرت به عنوان مبدل و پل بین شکل موج dc وac استفاده می شوند.این پروسه باعث ایجاد پالسهایی برروی شکل موج خروجی می شود که می تواند وارد تجهیزات قدرت همچون ترانسفورماتور ی...

15 صفحه اول

Complete convergence of moving-average processes under negative dependence sub-Gaussian assumptions

The complete convergence is investigated for moving-average processes of doubly infinite sequence of negative dependence sub-gaussian random variables with zero means, finite variances and absolutely summable coefficients. As a corollary, the rate of complete convergence is obtained under some suitable conditions on the coefficients.

متن کامل

A second-order differential system with hessian-driven damping; application to non-elastic shock laws

We consider the second-order differential system with Hessian-driven damping ü+αu̇+β∇2Φ(u)u̇+∇Φ(u)+∇Ψ(u) = 0, where H is a real Hilbert space, Φ,Ψ : H → IR are scalar potentials, and α, β are positive parameters. An interesting property of this system is that, after introduction of an auxiliary variable y, it can be equivalently written as a first-order system involving only the time derivatives ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Applied Mathematics and Optimization

سال: 2023

ISSN: ['0095-4616', '1432-0606']

DOI: https://doi.org/10.1007/s00245-023-10058-6