A comparison of the accuracy of short term foreign exchange forecasting methods
Introduction
The hypothesis that the behaviour of foreign exchange rates is, to some extent, non-linear has been examined by several authors. The evidence for a non-linear data generating process for foreign exchange rates is examined further here by the evaluation of the comparative accuracy of short term forecasts from methods based on linear and non-linear hypotheses. The linear forecasting method uses an ARMA-GARCH time series model. Two non-linear forecasting methods are used: one is a local non-parametric method using nearest neighbours; the second is a locally weighted regression. Forecast accuracy is considered from two viewpoints: point accuracy and directional accuracy of the change in exchange rate (equivalent to the sign of the period to period return). A random walk model for foreign exchange rates is used as a naı̈ve benchmark. The data used are of five frequencies: daily, four-hourly, two-hourly, hourly and half-hourly, although only the intra-day data are discussed in detail.
A range of conventional error measures is used to provide evidence about comparative accuracy of the forecasting methods. The sensitivity of the ranking of the forecasting methods to the choice of accuracy measure used is discussed in detail. For each accuracy measure, a formal significance test is used to assess the economic value of the forecasts. Tests of the significance of the directional accuracy of the forecasts are also carried out.
The structure of the paper is as follows. Details of the data are given in Section 2. Section 3 describes the forecasting methods used and their backgrounds, and details of the relevant parameters are given for each data set. Section 4 contains a description of the error measures used and formal tests for differences in accuracy are identified. An analysis of the accuracy measures by data set and forecasting method follows. Conclusions are given in Section 5.
Section snippets
Description of data
The data sets are foreign exchange rates for the US$ against the UK£, the German Mark and the Japanese Yen. These will be referred to respectively by the following codes: USDGBP, USDDEM and USDJPY. Table 1 gives full details of the dates and size of the data sets. The intra-day data from 1997 forms the basis for this analysis, the daily data and the 1986 hourly data will be mentioned solely for comparative purposes. The availability of half-hourly data permitted the observation of lower
Forecasting methods
The GARCH model, linear in mean and non-linear in variance, has been used by many authors. This model has been used to capture the heteroskedasticity of daily foreign exchange rates by, for example, Baillie and Bollerslev (1989), Milhoj (1987) and Hsieh, 1988, Hsieh, 1989. Baillie and Bollerslev (1991) used a GARCH model for intra-day rates; subsequently Baillie, Bollerslev and Mikkelson (1996) developed a fractionally integrated GARCH model. Cecen and Erkal (1996) argue that inconsistencies
Out of sample forecasting accuracy
For all data sets, one to ten periods ahead forecasts were produced for the final third of each data set, as defined in Table 1. Initially, the analysis concentrates on one period ahead forecasts. The forecast errors are described by summary accuracy measures and significance tests to evaluate relative accuracy are performed where possible.
Conclusion
The concept of forecasting accuracy has been examined empirically with different frequencies of FX data using forecasting methods based on the assumptions of either a linear or non-linear generating process. The measurement of point accuracy was achieved using a range of summary statistics coupled with tests of significance. The significance of directional accuracy was measured using Peseran and Timmerman’s test and the associated theoretical profit assessed by simple trading rules.
The error
Biography: Nigel MEADE is Reader in Management Science at the Management School, Imperial College, University of London. His research interests are statistical model building in general and applied time series analysis and forecasting in particular. He is an associate editor of the International Journal of Forecasting.
References (22)
- et al.
Error measures for generalizing about forecasting methods: empirical comparisons
International Journal of Forecasting
(1992) - et al.
Distinguishing between stochastic and deterministic behaviour in high frequency foreign exchange rate returns: can non-linear dynamic help forecasting?
International Journal of Forecasting
(1996) - et al.
Nonparametric exchange rate prediction
Journal of International Economics
(1990) - et al.
Exchange rate forecasts with simultaneous nearest-neighbour methods: evidence from the EMS
International Journal of Forecasting
(1999) Optimization of technical trading strategies and the profitability in security markets
Economics Letters
(1998)Linear, non-linear and essential foreign exchange rate prediction with simple trading rules
Journal of International Economics
(1999)Statistical properties of daily exchange rates: 1974–1983
Journal of International Economics
(1988)- et al.
A generalization of the non-parametric Henriksson–Merton test of market timing
Economics Letters
(1994) - et al.
The message in daily exchange rates: a conditional variance tale
Journal of Business and Economic Statistics
(1989) - et al.
Intra-day and inter-market volatility in foreign exchange rates
Review of Economic Studies
(1991)
Fractionally integrated generalised autoregressive conditional heteroskedasticity
Journal of Econometrics
Cited by (59)
Improving sporadic demand forecasting using a modified k-nearest neighbor framework
2024, Engineering Applications of Artificial IntelligenceForecasting municipal solid waste quantity using artificial neural network and supported vector machine techniques: A case study of Johannesburg, South Africa
2021, Journal of Cleaner ProductionCitation Excerpt :This technique has been studied and applied in time series forecast under non-parametric locally weighted regression condition by Yakowitz (1987) and Cleveland (1979) (Cleveland, 1979; Yakowitz, 1987). In view of the work presented by Meade (2002), kNN technique has also drawn lot of attentions in time series forecasting (Meade, 2002). The basic perception in employing this machine learning technique to a univariate time series is that consistent data-generating processes often produce observations of repeated patterns of behaviour.
Soft Computing Applications in Municipal Solid Waste Forecast: A Short Review
2021, Soft Computing Techniques in Solid Waste and Wastewater ManagementArtificial Intelligence Models for Forecasting of Municipal Solid Waste Generation
2021, Soft Computing Techniques in Solid Waste and Wastewater ManagementForecasting of customer demands for production planning by local k-nearest neighbor models
2021, International Journal of Production EconomicsForecasting multinomial stock returns using machine learning methods
2020, Journal of Finance and Data ScienceCitation Excerpt :The only tuning parameter of the method is the amount of neighbors k. Larger values of k lead to smoother and less detailed decision boundaries. Despite its simplicity k-nearest neighbor has shown success in different kinds of financial applications such as forecasting foreign exchange rates or stock market volatility (see e.g., Meade27; Arroyo and Maté28; Andrada-Félix, Fernández-Rodríguez and Fuertes29). Since the features in the dataset could have a variety of different scales each feature is typically re-scaled to have mean zero and variance equal to one.
Biography: Nigel MEADE is Reader in Management Science at the Management School, Imperial College, University of London. His research interests are statistical model building in general and applied time series analysis and forecasting in particular. He is an associate editor of the International Journal of Forecasting.