Weighted least square ensemble networks

Ensemble of networks has been proven to give better prediction result than a single network. Two commonly used way of determining the ensemble weights are simple average ensemble method and the generalized ensemble method. In the paper, we propose the weighted least square ensemble network. The major difference between this method and the other ensemble methods is that we do not assume that neither individual training data nor networks in the ensemble are independent and uncorrelated. Two variance of this model will also be introduced in the paper which require fewer computations. The sunspot data was used as a benchmark test of the proposed methods. From the result, we find that the correlation ensemble, one variance of the weighted least square method, gave the best ensemble weightings.