Mape-r: a Rescaled Measure of Accuracy for Cross-sectional Forecasts
نویسندگان
چکیده
Accurately measuring a population and its attributes at past, present, and future points in time has been of great interest to demographers. Within discussions of forecast accuracy, demographers have often been criticized for their inaccurate prognostications of the future. Discussions of methods and data are usually at the center of these criticisms, along with suggestions for providing an idea of forecast uncertainty. The measures used to evaluate the accuracy of forecasts also have received attention and while accuracy is not the only criteria advocated for evaluating demographic forecasts, it is generally acknowledged to be the most important. In this paper, we continue the discussion of measures of forecast accuracy by concentrating on a rescaled version of a measure that is arguably the one used most often, Mean Absolute Percent Error (MAPE). The rescaled version, MAPE-R, has not had the benefit of a major empirical test, which is the central focus of this paper. We do this by comparing 10-year population forecasts for U.S. counties to 2000 census counts. We find that the MAPE-R offers a significantly more meaningful representation of average error than MAPE in the presence of outlying errors and provide guidelines for its implementation.
منابع مشابه
Population forecast accuracy: does the choice of summary measure of error matter?
Population projections are judged primarily by their accuracy. The most commonly used measure for the precision component of accuracy is the mean absolute percent error (MAPE). Recently, the MAPE has been criticized for overstating forecast error and other error measures have been proposed. This study compares the MAPE with two alternative measures of forecast error, the Median APE and an M-est...
متن کاملUsing the R-MAPE index as a resistant measure of forecast accuracy.
BACKGROUND The mean absolute percentage error (MAPE) is probably the most widely used goodness-of-fit measure. However, it does not meet the validity criterion due to the fact that the distribution of the absolute percentage errors is usually skewed to the right, with the presence of outlier values. In these cases, MAPE overstates the corresponding population parameter. In this study, we propos...
متن کاملMacroeconomic forecasts and microeconomic forecasters
In the presence of principal-agent problems, published macroeconomic forecasts by professional economists may not measure expectations. Forecasters may use their forecasts in order to manipulate beliefs about their ability. I test a cross-sectional implication of models of reputation and information-revelation. I find that as forecasters become older and more established, they produce more radi...
متن کاملPredicting emergency department admissions.
OBJECTIVE To develop and validate models to predict emergency department (ED) presentations and hospital admissions for time and day of the year. METHODS Initial model development and validation was based on 5 years of historical data from two dissimilar hospitals, followed by subsequent validation on 27 hospitals representing 95% of the ED presentations across the state. Forecast accuracy wa...
متن کاملFindings of a Survey Conducted by Kesten Green and Len Tashman
One popular alternative to using either A or F as the denominator is to take an average of the two: (A+F)/2. Calculated over multiple forecast periods, this measure is most commonly called the symmetric MAPE (sMAPE) and has been used in recent forecasting competitions to compare the accuracy of forecasts from different methods. See, for example, www. neural-forecasting-competition.com/index.htm...
متن کامل