Generalization by Weight-Elimination with Application to Forecasting
نویسندگان
چکیده
Inspired by the information theoretic idea of minimum description length, we add a term to the back propagation cost function that penalizes network complexity. We give the details of the procedure, called weight-elimination, describe its dynamics, and clarify the meaning of the parameters involved. From a Bayesian perspective, the complexity term can be usefully interpreted as an assumption about prior distribution of the weights. We use this procedure to predict the sunspot time series and the notoriously noisy series of currency exchange rates.
منابع مشابه
Application of artificial neural network (ANN) for the prediction of water treatment plant influent characteristics
Application of a reliable forecasting model for any water treatment plant (WTP) is essential in order to provide a tool for predicting influent water quality and to form a basis for controlling the operation of the process. This would minimize the operation and analysis costs, and assess the stability of WTP performances. This paper focuses on applying an artificial neural network (ANN) approac...
متن کاملA Comprehensive Evaluation of Weight Growth and Weight Elimination Methods Using the Tangent Plane Algorithm
The tangent plane algorithm is a fast sequential learning method for multilayered feedforward neural networks that accepts almost zero initial conditions for the connection weights with the expectation that only the minimum number of weights will be activated. However, the inclusion of a tendency to move away from the origin in weight space can lead to large weights that are harmful to generali...
متن کاملSupport vector machine with adaptive parameters in financial time series forecasting
A novel type of learning machine called support vector machine (SVM) has been receiving increasing interest in areas ranging from its original application in pattern recognition to other applications such as regression estimation due to its remarkable generalization performance. This paper deals with the application of SVM in financial time series forecasting. The feasibility of applying SVM in...
متن کاملForecasting Monthly Electric Energy Consumption Using Feature Extraction
Monthly forecasting of electric energy consumption is important for planning the generation and distribution of power utilities. However, the features of this time series are so complex that directly modeling is difficult. Three kinds of relatively simple series can be derived when a discrete wavelet transform is used to extract the raw features, namely, the rising trend, periodic waves, and st...
متن کاملFlood Forecasting Using Artificial Neural Networks: an Application of Multi-Model Data Fusion technique
Floods are among the natural disasters that cause human hardship and economic loss. Establishing a viable flood forecasting and warning system for communities at risk can mitigate these adverse effects. However, establishing an accurate flood forecasting system is still challenging due to the lack of knowledge about the effective variables in forecasting. The present study has indicated that th...
متن کامل