Demand forecasting errors in industrial context: Measurement and impacts

https://doi.org/10.1016/j.ijpe.2008.08.008Get rights and content

Abstract

It is important to know the impacts that sales forecast errors have on the supply chain. Knowing the role of forecasting and the impacts of forecast errors creates a basis for defining a realistic target for forecast accuracy, identifying the most important customers and/or products to be forecasted, and finding a suitable way to measure forecasting performance.

This paper provides a case study about assessing the impacts of sales forecast errors. The analysis steps include defining the planning flow and the role of sales forecasts in production planning and inventory management and analyzing the characteristics of sales forecasting errors of a company. The case company is a large process industry company that seeks out to improve the accuracy of their sales forecasts and to improve control over the inventory policy decisions of different sales divisions.

This case study points out some managerial problems that companies run into when demand forecasting is applied in an industrial context. One of the problems is the insufficiency of traditional error measures. The problem is analyzed and an alternative measurement practice is presented.

Introduction

Demand forecasting is commonly applied in companies that operate in consumer markets. When demand patterns are relatively smooth and continuous, demand forecasts based on historical demand are usually quite accurate. Success stories about demand forecasting typically report lower inventory levels and improved customer service. After the success of forecasting in consumer markets, there has been growing interest in applying demand forecasting in companies operating in industrial markets to apply demand forecasting, despite the fact that environment is different. In industrial markets, the importance of single customers is greater, so demand patterns are more volatile. In this environment, the historical demand does not always predict the future demand sufficiently, so human judgment plays a more important role in the forecasting process.

When the demand forecasting system is implemented in a company, there is a tendency that concepts, targets and principles are imitated from other companies to speed up the implementation. Since most of the forecasting approaches have been developed for consumer products, there is a risk that unrealistic accuracy targets and deceptive error measures are adopted, if the environment is different. Companies operating in industrial markets have special characteristics that should be addressed and understood before any techniques or approaches are applied.

Forecasting should not be considered as an individual function, but as an important part of supply-chain management. However, most research emhasizes producing the forecasts, not their usage in decision making or their impacts in the whole supply chain. Also earlier empirical research points out that in practical work, producing the forecasts is more consciously managed than evaluating its impacts in the supply-chain management (Mentzer and Moon, 2005). For example, in many companies forecast accuracy is measured, but assessing the impacts of forecast errors on supply-chain management is not managed equally well.

Many forecasting studies start from the premise that the use of forecasts and the required forecast accuracy is defined before the approach for producing the forecasts is chosen, see e.g. Heizer (2001). This does not always happen in practice, however, as the nature of sales forecasting management is more iterative. That is why it is important to get a general view about the whole forecasting process in a company, illustrate it, and communicate about it in the organization.

The emphasis of this paper is on the usage of forecasts and on the impacts of forecast errors. Through an explorative case study, we illustrate that forecasting systems in companies are not always rational with respect to the real impacts of forecast errors. The impacts of forecast errors are analyzed in order to find a target, focus, and suitable performance measurement for forecasting that fit the characteristics and needs of the case company.

In the next two sections, the literature on forecast error measurement and setting the targets for forecast accuracy is reviewed. After that, the case company's planning and forecasting operations are analyzed. At the end of the paper, managerial impacts of the analysis are reviewed and the last section provides some concluding remarks.

Section snippets

Measuring forecast errors

Forecasts are used for many purposes: marketing, sales, finance/accounting, production/purchasing, and logistics. In this paper, the focus is on forecasting from the perspective of production planning and inventory control.

An abundance of forecasting techniques exists and is available to the sales forecasting manager. In fact, it often seems that too many techniques are available, so that the choice decision can border on information overload. There are over 70 different time series techniques

Assessing the impacts of forecast errors

Potential impacts of forecast errors have been reviewed in earlier literature by e.g. Kahn (2003), and many studies have dealt with assessing the impacts of forecast errors on some specific part of supply-chain management, e.g. MRP nervousness (Ho and Ireland, 1998), MRP system inventory costs and shortages (Lee and Adam, 1986), and schedule instability and system service level (Xie et al., 2004). Possible impacts of forecast errors can be summarized into three main categories (Table 1): (1)

Introduction to the case

The purpose of assessing the impacts of different types of sales forecast errors is to answer the following questions: (1) how to define the target for forecast accuracy, (2) what are the most important products to be forecasted, and (3) what is a suitable way to measure forecasting performance.

Analyzing the impacts of forecast errors requires first defining the planning flow between forecasts and the sales. After that, it must be analyzed what is the role of demand information in the planning

The role of forecasting in planning

The planning flow of the company was analyzed on the basis of written reports and interviews. The planning flow of the company is described in Fig. 1.

The forecasts are produced at the sales units, and every month a consensus team of the headquarters produces a consensus forecast for the production units. The main point of making the consensus forecast is to match the accepted orders, commitments, and forecasts with the capacity. If the accepted orders, commitments, and forecasts per planned

Characteristics of the forecast errors in the case company

There are a few things that are characteristic to the forecast errors of the case company. First of all, forecasts are positively biased. Secondly, there are irregularities in demand patterns that are due to company's own actions such as redirecting orders between sales units or substituting a product with a similar product. Third, there are minor errors in timing, since typical order frequency is close to the length of the forecasting period. Because of these three factors, it is difficult to

Separating timing errors from the other forecast errors

This type of errors, which are considered harmless, but disturb the planners’ work and hinder the picture of “real” accuracy, should be screened out from other errors when measuring forecast accuracy. As simple it might sound, methods for that task do not exist. For example, using moving averages does not really help in smoothing such timing errors. In theory, forecasters could be asked to define the exactness of their timing evaluations, but increasing the responsibility of the salespeople

Managerial implications

A short description about the actions that resulted from doing this analysis in the case company will point out the managerial implications.

Conclusions

Forecasting is an attractive area for a technique application, which may direct the whole forecasting function in a company. Too often the real needs of forecasting in the form of impacts of errors get forgotten. Assessing the impacts of forecast errors is important but challenging. Complexity and interrelations in the planning processes make it difficult to separate the impacts of forecast errors from other planning. Therefore, analyzing a whole planning flow is needed to create a general view

References (15)

There are more references available in the full text version of this article.

Cited by (43)

  • The hybrid PROPHET-SVR approach for forecasting product time series demand with seasonality

    2021, Computers and Industrial Engineering
    Citation Excerpt :

    Hence, demand forecasting has become especially critical. Demand forecasting, which is a basic aspect of supply chain management, has important impacts on planning, capacity and inventory control decisions (Kerkkänen, Korpela, & Huiskonen, 2009). Changes in product demand will pose many problems in the supply chain, such as many out-of-stock items in the peak season and excessive inventory in the off-season.

  • Export sales forecasting using artificial intelligence

    2021, Technological Forecasting and Social Change
    Citation Excerpt :

    Forecasts have become profoundly important because of shorter lead times, increasing customer expectations and the need to deal with limited resources (Boone et al., 2019). Effective demand forecasting usually lowers inventory levels and improves customer service (Kerkkänen et al., 2009). Accurate forecasting also plays an essential role in retail operations and manufacturing (Mentzer and Bienstock, 1998; Trappey and Wu, 2008).

  • Investigating the added value of integrating human judgement into statistical demand forecasting systems

    2017, International Journal of Production Economics
    Citation Excerpt :

    While accuracy is an important indicator of forecasting performance, this indicator remains in the theoretical realm. Several researchers highlight the need to link forecast accuracy to measures linked to other business performance (Mahmoud et al., 1992; Mentzer et al., 1999; Moon et al., 2003; Kerkkänen et al., 2009). Previous studies have indicated links between improved demand forecasting accuracy and inventory management (e.g., Clarke, 2006; Oliva and Watson, 2009; Syntetos et al., 2010) and delivery times (Shan et al., 2009).

  • Sales and operations planning in the process industry: A literature review

    2017, International Journal of Production Economics
View all citing articles on Scopus
View full text