An $$O(s^r)$$-resolution ODE framework for understanding discrete-time algorithms and applications to the linear convergence of minimax problems
نویسندگان
چکیده
There has been a long history of using ordinary differential equations (ODEs) to understand the dynamics discrete-time algorithms (DTAs). Surprisingly, there are still two fundamental and unanswered questions: (i) it is unclear how obtain suitable ODE from given DTA, (ii) connection between convergence DTA its corresponding ODEs. In this paper, we propose new machinery—an $$O(s^r)$$ -resolution framework—for analyzing behavior generic which (partially) answers above questions. The framework contains three steps: 1. To define hierarchy ODEs parameterized by degree r, where s step-size DTA. We present principal approach construct unique DTA; 2. analyze resulting ODE, -linear-convergence condition with respect an energy function, under converges linearly optimal solution; 3. bridge properties ODEs, properness function show that linear proper can automatically guarantee better illustrate machinery, utilize study classic algorithms—gradient descent ascent (GDA), proximal point method (PPM) extra-gradient (EGM)—for solving unconstrained minimax problem $$\min _{x\in \mathbb {R}^n} \max _{y\in {R}^m} L(x,y)$$ . Their O(s)-resolution explain puzzling convergent/divergent behaviors GDA, PPM EGM when L(x, y) bilinear showcase interaction terms help PPM/EGM but hurts GDA. Furthermore, their O(s)-linear-convergence conditions not only unify known scenarios have convergence, also these exhibit in much broader contexts, including class nonconvex-nonconcave problems. Finally, design optimization for problems, studying difference GDA PPM/EGM.
منابع مشابه
nano-rods zno as an efficient catalyst for the synthesis of chromene phosphonates, direct amidation and formylation of amines
چکیده ندارد.
the innovation of a statistical model to estimate dependable rainfall (dr) and develop it for determination and classification of drought and wet years of iran
آب حاصل از بارش منبع تأمین نیازهای بی شمار جانداران به ویژه انسان است و هرگونه کاهش در کم و کیف آن مستقیماً حیات موجودات زنده را تحت تأثیر منفی قرار می دهد. نوسان سال به سال بارش از ویژگی های اساسی و بسیار مهم بارش های سالانه ایران محسوب می شود که آثار زیان بار آن در تمام عرصه های اقتصادی، اجتماعی و حتی سیاسی- امنیتی به نحوی منعکس می شود. چون میزان آب ناشی از بارش یکی از مولفه های اصلی برنامه ...
15 صفحه اولMinimax Trees in Linear Time with Applications
A minimax tree is similar to a Huffman tree except that, instead of minimizing the weighted average of the leaves’ depths, it minimizes the maximum of any leaf’s weight plus its depth. Golumbic (1976) introduced minimax trees and gave a Huffman-like, O(n log n)-time algorithm for building them. Drmota and Szpankowski (2002) gave another O(n log n)-time algorithm, which takes linear time when th...
متن کاملMinimax state estimation for linear discrete-time differential-algebraic equations
This paper presents a state estimation approach for an uncertain linear equation with a non-invertible operator in Hilbert space. The approach addresses linear equations with uncertain deterministic input and noise in the measurements, which belong to a given convex closed bounded set. A new notion of a minimax observable subspace is introduced. By means of the presented approach, new equations...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematical Programming
سال: 2021
ISSN: ['0025-5610', '1436-4646']
DOI: https://doi.org/10.1007/s10107-021-01669-4