Investigation of Proper Orthogonal Decomposition for Echo State Networks
نویسندگان
چکیده
Echo State Networks (ESN) are a type of Recurrent Neural Network that yields promising results in representing time series and nonlinear dynamic systems. Although they equipped with very efficient training procedure, Reservoir Computing strategies, such as the ESN, require high-order networks, i.e., many neurons, resulting large number states magnitudes higher than model inputs outputs. A not only makes time-step computation more costly but also may pose robustness issues, especially when applying ESNs to problems Model Predictive Control (MPC) other optimal control problems. One way circumvent this complexity issue is through Order Reduction strategies Proper Orthogonal Decomposition (POD) its variants (POD-DEIM), whereby we find an equivalent lower order representation already trained high dimension ESN. To end, work aims investigate analyze performance POD methods Networks, evaluating their effectiveness Memory Capacity (MC) POD-reduced network compared original (full-order) We perform experiments on two numerical case studies: NARMA10 difference equation oil platform containing wells one riser. The show there little loss comparing ESN counterpart tends be superior normal same size. Also, achieves speedups around 80%
منابع مشابه
Proper orthogonal decomposition for parameter estimation in oscillating biological networks
متن کامل
Artificial viscosity proper orthogonal decomposition
We introduce improved reduced-order models for turbulent flows. These models are inspired from successful methodologies used in large eddy simulation, such as artificial viscosity, applied to standardmodels created by proper orthogonal decomposition of flows coupled with Galerkin projection. As a first step in the analysis and testing of our new methodology, we use the Burgers equation with a s...
متن کاملProper orthogonal decomposition & kriging strategies for design
Future Work Conclusions The aim of the following research is to therefore remove this obstacle to the application of kriging whilst developing a strategy for use at higher dimensions. The goal of an initial investigation was therefore to determine if these hyperparameters should be tuned after every update, and to what degree they should be tuned, in order for the model to remain effective. Thi...
متن کاملProper Orthogonal Decomposition for Optimality Systems
Proper orthogonal decomposition (POD) is a powerful technique for model reduction of non–linear systems. It is based on a Galerkin type discretization with basis elements created from the dynamical system itself. In the context of optimal control this approach may suffer from the fact that the basis elements are computed from a reference trajectory containing features which are quite different ...
متن کاملProper orthogonal decomposition of solar photospheric motions.
The spatiotemporal dynamics of the solar photosphere is studied by performing a proper orthogonal decomposition (POD) of line of sight velocity fields computed from high resolution data coming from the MDI/SOHO instrument. Using this technique, we are able to identify and characterize the different dynamical regimes acting in the system. Low-frequency oscillations, with frequencies in the range...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Neurocomputing
سال: 2023
ISSN: ['0925-2312', '1872-8286']
DOI: https://doi.org/10.1016/j.neucom.2023.126395