On learning the derivatives of an unknown mapping with multilayer feedforward networks

نویسندگان

  • A. Ronald Gallant
  • Halbert White
چکیده

Recently, multiple input, single output, single hidden layer, feedforward neural networks have been shown to be capable of approximating a nonlinear map and its partial derivatives. Specifically, neural nets have been shown to be dense in various Sobolev spaces (Hornik, Stinchcombe and White, 1989). Building upon this result, we show that a net can be trained so that the map and its derivatives are learned. Specifically, we use a result of Gallant (1987b) to show that least squares and similar estimates are strongly consistent in Sobolev norm provided the number of hidden units and the size of the training set increase together. We illustrate these results by an applic~tion to the inverse problem of chaotic dynamics: recovery of a nonlinear map from a time series of iterates. These results extend automatically to nets that embed the single hidden layer, feedforward network as a special case.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks

-We give conditions ensuring that multilayer jeedJorward networks with as Jew as a single hidden layer and an appropriately smooth hidden layer activation fimction are capable o f arbitrarily accurate approximation to an arbitrao' function and its derivatives. In fact, these networks can approximate functions that are not dtifferentiable in the classical sense, but possess only a generalized de...

متن کامل

Using Artificial Neural Network Algorithm to Predict Tensile Properties of Cotton-Covered Nylon Core Yarns

Artificial Neural Networks are information processing systems. Over the past several years, these algorithms have received much attention for their applications in pattern completing, pattern matching and classification and also for their use as a tool in various areas of problem solving. In this work, an Artificial Neural Network model is presented for predicting the tensile &#10properties of ...

متن کامل

Using Artificial Neural Network Algorithm to Predict Tensile Properties of Cotton-Covered Nylon Core Yarns

Artificial Neural Networks are information processing systems. Over the past several years, these algorithms have received much attention for their applications in pattern completing, pattern matching and classification and also for their use as a tool in various areas of problem solving. In this work, an Artificial Neural Network model is presented for predicting the tensile properties of co...

متن کامل

Differentiating Functions of the Jacobian with Respect to the Weights

Abstract For many problems, the correct behavior of a model depends not only on its input-output mapping but also on properties of its Jacobian matrix, the matrix of partial derivatives of the model’s outputs with respect to its inputs. We introduce the J-prop algorithm, an efficient general method for computing the exact partial derivatives of a variety of simple functions of the Jacobian of a...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Neural Networks

دوره 5  شماره 

صفحات  -

تاریخ انتشار 1992