Skip to main content

Ruhr Economic Papers #833

2019

Roland Döhrn

Comparing Forecast Accuracy in Small Samples

The Diebold-Mariano-Test has become a common tool to compare the accuracy of macroeconomic forecasts. Since these are typically model-free forecasts, distribution free tests might be a good alternative to the Diebold-Mariano-Test. This paper suggests a permutation test. Stochastic simulations show that permutation tests outperform the Diebold-Mariano-Test. Furthermore, a test statistic based on absolute errors seems to be more sensitive to differences in forecast accuracy than a statistic based on squared errors.

ISBN: 978-3-86788-966-7

JEL-Klassifikation: C14, C15, C53

Link to the document