Investigation of Proper Orthogonal Decomposition for Echo State Networks

نویسندگان

چکیده

Echo State Networks (ESN) are a type of Recurrent Neural Network that yields promising results in representing time series and nonlinear dynamic systems. Although they equipped with very efficient training procedure, Reservoir Computing strategies, such as the ESN, require high-order networks, i.e., many neurons, resulting large number states magnitudes higher than model inputs outputs. A not only makes time-step computation more costly but also may pose robustness issues, especially when applying ESNs to problems Model Predictive Control (MPC) other optimal control problems. One way circumvent this complexity issue is through Order Reduction strategies Proper Orthogonal Decomposition (POD) its variants (POD-DEIM), whereby we find an equivalent lower order representation already trained high dimension ESN. To end, work aims investigate analyze performance POD methods Networks, evaluating their effectiveness Memory Capacity (MC) POD-reduced network compared original (full-order) We perform experiments on two numerical case studies: NARMA10 difference equation oil platform containing wells one riser. The show there little loss comparing ESN counterpart tends be superior normal same size. Also, achieves speedups around 80%

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Artificial viscosity proper orthogonal decomposition

We introduce improved reduced-order models for turbulent flows. These models are inspired from successful methodologies used in large eddy simulation, such as artificial viscosity, applied to standardmodels created by proper orthogonal decomposition of flows coupled with Galerkin projection. As a first step in the analysis and testing of our new methodology, we use the Burgers equation with a s...

متن کامل

Proper orthogonal decomposition & kriging strategies for design

Future Work Conclusions The aim of the following research is to therefore remove this obstacle to the application of kriging whilst developing a strategy for use at higher dimensions. The goal of an initial investigation was therefore to determine if these hyperparameters should be tuned after every update, and to what degree they should be tuned, in order for the model to remain effective. Thi...

متن کامل

Proper Orthogonal Decomposition for Optimality Systems

Proper orthogonal decomposition (POD) is a powerful technique for model reduction of non–linear systems. It is based on a Galerkin type discretization with basis elements created from the dynamical system itself. In the context of optimal control this approach may suffer from the fact that the basis elements are computed from a reference trajectory containing features which are quite different ...

متن کامل

Proper orthogonal decomposition of solar photospheric motions.

The spatiotemporal dynamics of the solar photosphere is studied by performing a proper orthogonal decomposition (POD) of line of sight velocity fields computed from high resolution data coming from the MDI/SOHO instrument. Using this technique, we are able to identify and characterize the different dynamical regimes acting in the system. Low-frequency oscillations, with frequencies in the range...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Neurocomputing

سال: 2023

ISSN: ['0925-2312', '1872-8286']

DOI: https://doi.org/10.1016/j.neucom.2023.126395