An $$O(s^r)$$-resolution ODE framework for understanding discrete-time algorithms and applications to the linear convergence of minimax problems

نویسندگان

چکیده

There has been a long history of using ordinary differential equations (ODEs) to understand the dynamics discrete-time algorithms (DTAs). Surprisingly, there are still two fundamental and unanswered questions: (i) it is unclear how obtain suitable ODE from given DTA, (ii) connection between convergence DTA its corresponding ODEs. In this paper, we propose new machinery—an $$O(s^r)$$ -resolution framework—for analyzing behavior generic which (partially) answers above questions. The framework contains three steps: 1. To define hierarchy ODEs parameterized by degree r, where s step-size DTA. We present principal approach construct unique DTA; 2. analyze resulting ODE, -linear-convergence condition with respect an energy function, under converges linearly optimal solution; 3. bridge properties ODEs, properness function show that linear proper can automatically guarantee better illustrate machinery, utilize study classic algorithms—gradient descent ascent (GDA), proximal point method (PPM) extra-gradient (EGM)—for solving unconstrained minimax problem $$\min _{x\in \mathbb {R}^n} \max _{y\in {R}^m} L(x,y)$$ . Their O(s)-resolution explain puzzling convergent/divergent behaviors GDA, PPM EGM when L(x, y) bilinear showcase interaction terms help PPM/EGM but hurts GDA. Furthermore, their O(s)-linear-convergence conditions not only unify known scenarios have convergence, also these exhibit in much broader contexts, including class nonconvex-nonconcave problems. Finally, design optimization for problems, studying difference GDA PPM/EGM.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

the innovation of a statistical model to estimate dependable rainfall (dr) and develop it for determination and classification of drought and wet years of iran

آب حاصل از بارش منبع تأمین نیازهای بی شمار جانداران به ویژه انسان است و هرگونه کاهش در کم و کیف آن مستقیماً حیات موجودات زنده را تحت تأثیر منفی قرار می دهد. نوسان سال به سال بارش از ویژگی های اساسی و بسیار مهم بارش های سالانه ایران محسوب می شود که آثار زیان بار آن در تمام عرصه های اقتصادی، اجتماعی و حتی سیاسی- امنیتی به نحوی منعکس می شود. چون میزان آب ناشی از بارش یکی از مولفه های اصلی برنامه ...

15 صفحه اول

Minimax Trees in Linear Time with Applications

A minimax tree is similar to a Huffman tree except that, instead of minimizing the weighted average of the leaves’ depths, it minimizes the maximum of any leaf’s weight plus its depth. Golumbic (1976) introduced minimax trees and gave a Huffman-like, O(n log n)-time algorithm for building them. Drmota and Szpankowski (2002) gave another O(n log n)-time algorithm, which takes linear time when th...

متن کامل

Minimax state estimation for linear discrete-time differential-algebraic equations

This paper presents a state estimation approach for an uncertain linear equation with a non-invertible operator in Hilbert space. The approach addresses linear equations with uncertain deterministic input and noise in the measurements, which belong to a given convex closed bounded set. A new notion of a minimax observable subspace is introduced. By means of the presented approach, new equations...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Mathematical Programming

سال: 2021

ISSN: ['0025-5610', '1436-4646']

DOI: https://doi.org/10.1007/s10107-021-01669-4