‘Checkers’ - Highly Efficient Derivative-Free Optimization
نویسندگان
چکیده
Derivative-free algorithms are frequently required for the optimization of nonsmooth functions defined by physical experiments or by averaging of the statistics of numerical simulations of chaotic systems such as turbulent flows. The core idea of all efficient algorithms for problems of this class is to keep function evaluations far apart until convergence is approached. Generalized Pattern Search (GPS) algorithms, such as the present, accomplish this by coordinating the search with an underlying grid which is refined and coarsened as appropriate. Rather than using the Cartesian grid (the typical choice), the present work introduces for this purpose the use of lattices derived from n-dimensional sphere packings (for a comprehensive review of such lattices and their properties see Conway & Sloane 1999). Such lattices are significantly more uniform and have much higher kissing numbers (that is, they have many more nearest neighbors) than their Cartesian counterparts; both of these facts make them much better suited for coordinating GPS algorithms. One of the most efficient subclasses of GPS algorithms, known as the Surrogate Management Framework (SMF; see Booker et al, 1999), alternates between an exploratory Search over a surrogate function interpolating all existing function evaluations (and thus summarizing the trends which they represent), and an exhaustive Poll which checks the function on neighboring points to confirm or confute the local optimality of any given Candidate Minimum Point (CMP) on the underlying grid. The present work combines the SMF with efficient lattices based on n-dimensional sphere packings, and additionally incorporates one of the highly efficient global search strategies meticulously examined by Jones (2001), thereby developing an extremely efficient lattice-based derivative-free optimization algorithm. Our code implementing this algorithm, dubbed Checkers, compares quite favorably to competing algorithms on a range of well-known optimization test problems.
منابع مشابه
Preparation, characterization and the use of sulfonic acid-functionalized phthalimide (SFP) as a highly efficient and green catalyst for the condensation of arylaldehydes with 2-naphthol
Phthalimide was reacted with chlorosulfonic acid to give sulfonic acid-functionalized phthalimide (SFP), which characterized by 1H NMR, 13C NMR, FT-IR, XRD (X-ray diffraction), SEM (scanning electron microscopy), EDX (energy-dispersive X-ray), mass, TG (thermogravimetry) and DTG (derivative thermal gravimetry) spectra. Afterward, its catalytic activity was examined for the condensation of aryla...
متن کاملPreparation, characterization and the use of sulfonic acid-functionalized phthalimide (SFP) as a highly efficient and green catalyst for the condensation of arylaldehydes with 2-naphthol
Phthalimide was reacted with chlorosulfonic acid to give sulfonic acid-functionalized phthalimide (SFP), which characterized by 1H NMR, 13C NMR, FT-IR, XRD (X-ray diffraction), SEM (scanning electron microscopy), EDX (energy-dispersive X-ray), mass, TG (thermogravimetry) and DTG (derivative thermal gravimetry) spectra. Afterward, its catalytic activity was examined for the condensation of aryla...
متن کاملConstrained derivative-free optimization on thin domains
Many derivative-free methods for constrained problems are not efficient for minimizing functions on “thin” domains. Other algorithms, like those based on Augmented Lagrangians, deal with thin constraints using penalty-like strategies. When the constraints are computationally inexpensive but highly nonlinear, these methods spend many potentially expensive objective function evaluations motivated...
متن کاملDerivative-Free Robust Optimization for Circuit Design
In this paper, we introduce a framework for derivative-free robust optimization based on the use of an efficient derivative-free optimization routine for mixed integer nonlinear problems. The proposed framework is employed to find a robust optimal design of a particular integrated circuit (namely a DC-DC converter commonly used in portable electronic devices). The proposed robust optimization a...
متن کاملAn Active Appearance Model with a Derivative-Free Optimization
A new aam matching algorithm based on a derivative free optimization is presented and evaluated in this paper. For this, we use an efficient model-based optimization algorithm, the so called newuoa algorithm from M.J.D. Powell. We compare the new matching method performances against the standard one based on a fixed Jacobian matrix learned from a training set, and show significant improvements ...
متن کامل