Abstract
Accurate and reliable short-term prediction of ship motions offers improvements in both safety and control quality in ship motion sensitive maritime operations. Inspired by the satisfactory nonlinear learning capability of a support vector regression (SVR) model and the strong non-stationary processing ability of empirical mode decomposition (EMD), this paper develops a hybrid autoregressive (AR)-EMD-SVR model for the short-term forecast of nonlinear and non-stationary ship motion. The proposed hybrid model is designed by coupling the SVR model with an AR-EMD technique, which employs an AR model in ends extension. In addition to the AR-EMD-SVR model, the linear AR model, non-linear SVR model, and hybrid EMD-AR model are also studied for comparison by using ship motion time series obtained from model testing in a towing tank. Prediction results suggest that the non-stationary difficulty in the SVR model is overcome by using the AR-EMD technique, and better predictions are obtained by the proposed AR-EMD-SVR model than other models.
Similar content being viewed by others
1 Introduction
Ship motions occur due to ocean environmental disturbances, such as sea waves, wind, and ocean current. They are dangerous to ship related maritime operations like ship-borne helicopter recovery, float over, launch and recovery of submarines, and cargo transfer between ships, especially in harsh sea conditions. The short-term forecast of the ship motions 5 to 10 s ahead of time may be very useful for such offshore operations for both operational safety and efficiency. Prediction information can help to provide motion compensation, which may prevent the crash of cargo in cargo transfer, improve the firing accuracy of ship-borne weapon systems (Khan et al., 2006; Ra and Whang, 2006) and performance of the motion control systems. In addition, motion predictions are employed to extend operational limits by forecasting quiescent periods where the ship motions are within acceptable limits for performing a desired maritime task. Conventional prediction approaches employ statistical data to assess whether a task can be executed. This may result in an outcome where an operation is never executed, whereas quiescent periods do exist (Riola et al., 2011).
Short-term prediction of ship motion has been widely explored for its application values in practical engineering over past decades. A large number of forecast models have been developed. According to the theoretical differences among various methods, short-term prediction models may be classified into three types: hydrodynamic-based, classic time series, and nonlinear and intelligent learning related prediction models (Huang et al., 2014). Essentially, classic time series prediction and nonlinear and intelligent learning related prediction models are both statistical approaches.
Early efforts in short-term prediction were derived from ship hydrodynamics. Hydrodynamic-based prediction consists of a convolution-based approach and a state-space-based Kalman filter approach.
The convolution-based predictor (Kaplan and Sargent, 1965) is developed using wave height measurements at the bow serving as input data. The measured wave heights are then convoluted with the ship response kernel function to obtain the motion estimation in the coming seconds. Accurate response functions and wave inputs are required. However, the ship response kernel functions are derived under the consumption of linear hydrodynamic theory while wave excitation (Chakrabarti, 1989) and loads are nonlinear (Hirdaris et al., 2014). Furthermore, uncertainties modeling should also be considered in convolutionbased predictor due to their significant influences on ship response. Effects that the uncertainties in wave spectra and ship response kernel functions have on the short-term ship motions and loads were examined by Guedes Soares (1990; 1991) and Chakrabarti (1989). Papanikolaou et al. (2014) addressed the importance of understanding and integrating uncertainties in assessing ship wave-induced loads and operations. Hirdaris (2014) summarized the uncertainty modeling for ships as well as offshore structures.
The Kalman filter is another hydrodynamicbased prediction method. Triantafyllou and Athans (1981), Triantafyllou and Bodson (1982), and Triantafyllou et al. (1983) presented a Kalman filtering technique for predicting ship motions based on a precise state-space model. Numerical results on a DD-963 destroyer suggested the feasibility of applying the Kalman filter in short-term prediction. In addition, its prediction precision greatly depended on the ocean wave frequency and the noise. For example, 5 s predictions of pitch can be reached without a noise condition, while for a noise condition, the prediction horizon is then reduced to 2–3 s. Apart from being noise sensitive, the Kalman filter is difficult to apply because of two further shortcomings. One is that accurate state-space equations and noise statistics are necessary in implementing the Kalman filter. These are hard to obtain in practical engineering situations. The other is the very large computational effort required (Yang, 2013) to derive the ship hydrodynamic coefficients from the state-space equations, resulting in difficulty in real time implementation.
Hydrodynamic-based prediction models are in essence linear methods and hence applicable for small amplitude wave-induced ship motions. Their performance depends on how exactly the linear hydrodynamic coefficients are worked out. Modeling uncertainties should be taken into consideration. These models fail to model ship motions where fluid structure interactions are strong, e.g., the influence of hydro-elasticity is significant (Hirdaris and Temarel, 2009), as nonlinear hydrodynamic coefficients are required in such a case.
Hydrodynamic-based prediction models have introduced linear assumptions, boundary conditions, simplification of nonlinear wave-wave interaction, etc. Whereas, there are no such prior restrictions in statistical prediction models as they do not explain physical processes taking place for generating ship motions. Comparatively, statistical models show advantages including relatively simple modeling and a small requirement of computer memory and time. If exact input-output values are continuously known, time series models can be identified using known input-output values based on learning processes. In the present work, statistical time series models that are usually applied in ship motion forecasting are divided into two categories. They are the classic time series and nonlinear and intelligent learning related models.
Time series analysis provides a possible solution only requiring the time history of the ship motions or the ocean waves while modeling (Yumori, 1981). Classic time series prediction models that are frequently used include autoregressive (AR) and autoregressive moving average (ARMA) models. In addition to short-term prediction, classic time series models (AR, ARMA) have also been extensively applied in other disciplines of engineering (Sakellariou and Fassois, 2006; Lee and Jun, 2010). Practical limitations of requiring accurate state-space and noise estimation in the Kalman filter and precise response kernel function in the convolution predictor are avoided. The linear and stationary AR prediction model is mostly employed for advantages such as less computational complexity and memory demands, and being convenient for real-time realization (Zhang and Chu, 2005). Order determination and parameters estimation for AR model have been widely studied. However, predictions of a single AR model in harsh condition and large forecast lead times fail to satisfy expectations. To further improve the prediction performance, Yumori (1981) developed a novel ARMA model based on a leading indicator method using a statistical way that finds a time domain model which best fits an input wave sensor time history to the ship response time history. It showed good predictions of phase and amplitude for 2 to 4 s in advance. When the prediction lead time reaches 8 s, predictions fail to capture the amplitude of the target. Moreover, satisfactory prediction is only obtained if it could sense waves at a distance from the ship, which is not always available in a practical situation. Despite its high efficiency and adaptive nature, prediction results produced by the classic time series models (AR, ARMA) are far from the expected in harsh sea conditions. As the ship motions and ocean waves are always non-stationary, it conflicts with the stationary assumption of classic time series models.
To overcome the nonlinearity hidden in real-life ship motions, nonlinear and intelligent learning related prediction models have been extensively studied. Zhou and Zhao (1996) proposed a nonlinear autoregressive (NAR) model by applying orthogonalization technique. Results indicated that the NAR model gave better prediction accuracy than the AR model. But it is still limited in nonlinear ship motion forecasting, as explicit relationships for the data sets at hand have to be hypothesized with little knowledge of the underlying law to construct the NAR model.
In contrast to model-based nonlinear methods (e.g., NAR), intelligent learning related prediction models like artificial neural networks (ANN), backpropagation (BP) networks, and wavelet neural networks (WNN) are more capable of performing nonlinear modeling without a priori knowledge of the relationships between input and output variables. Hence, they are more general and flexible modeling tools in this context. Investigations into this application of ANN methods were conducted by Khan et al. (2004; 2005; 2006) where it was seen that ANN models produced excellent predictions and were able to predict ship motions satisfactorily for up to 7 s. To deal with chaos characteristic in the ship motion, a prediction method based on the chaotic time series theory and radial basis function (RBF) ANN model was implemented by Gu et al. (2013). Simulation results revealed that the proposed model was able to predict ship motion acceptably for up to 10 s. Recently, Zhang and Liu (2014) constructed WNN with delayed system information for on-line ship dynamics prediction. Sensitivity analysis is employed to determine the inputs to the WNN and improve the generalization ability. Simulation results of ship motion prediction using measured data demonstrate the feasibility. However, prediction results of pitch, roll, and heave motions were not given.
Though the above nonlinear and intelligent models perform better in data fitting, their applications in real engineering problem are still constrained because of disadvantages, such as high computational cost, the need for substantial samples, being nonadaptive in model identification, and so forth. Furthermore, the existence of non-stationarity in ship motions also limits the prediction models in practical implementation. Although intelligent learning related prediction models may perform well in handling nonlinearity, they may not be capable in modeling non-stationary data if pre-processing of the input is not performed (Cannas et al., 2006; Deka and Chandra, 2012), especially for a long forecast horizon. In fact, modeling a nonlinear and non-stationary data set using a single nonlinear model is very difficult since there are too many possible patterns hidden in the data. A single nonlinear model may not be general enough to capture all important features.
As a result, enhanced approaches are necessary. Hybrid models that combine pre-techniques with single prediction models become variable alternatives for more effective modeling. Wavelet-based models were presented for non-stationary time series forecasting as a wavelet technique is effective in handling non-stationarity (Ozger, 2010; Deka and Chandra, 2012). However, wavelet-based hybrid models still have limitations in nonlinear and nonstationary time series forecasting because of the linearity restriction of the wavelet transform. As a consequence, it may not be suitable for nonlinear data (Huang and Wu, 2008). However, empirical mode decomposition (EMD) technique is capable of processing nonlinear and non-stationary time series. Therefore, it has been popularly employed in developing hybrid models for various time series predictions (Castro-Neto et al., 2009; Fan and Tang, 2013; Cheng and Wei, 2014; Wang et al., 2015). Hou and Qi (2011) developed an EMD based on a radial basis function neural network (EMD-RBFNN) model to handle the nonlinearity and non-stationarity in ship motions. However, a sufficiently large sample is still required for training the RBFNN model. However, a support vector regression (SVR) model requires a relatively small sample size with strong ability in learning nonlinear time series. Zhou and Shi (2013) presented an EMD based least mean square support vector machines (EMD-LSSVM) for prediction. But the performance of the EMD-LSSVM in forecasting nonlinear and non-stationary ship motions was not further studied or compared with other models. Also, the end effects in EMD processing which greatly affect the prediction results (Xiong et al., 2014) had not been addressed. In this paper, an improved AREMD-SVR model is proposed, where the AR model is employed in ends processing to eliminate the influences of end effects on prediction accuracy. Performance of the enhanced model is further examined by comparative studies with AR, SVR, and EMDAR models using experimental ship motion data.
This paper first introduces the theoretical background of the AR model, EMD technique, and the SVR model and its enhanced model. Then numerical results and comparisons are presented and discussed.
2 Theoretical formulations for the AR model and AR-EMD technique
2.1 AR prediction model
Time series analysis theory assumes that relations exist among the variables of the time sequence. As a result, the present variable is able to be represented by the previous in time. Of which, the AR model is the most used in time series forecasting because of its convenience in real-time model identification, high adaptive nature, and better frequency resolution (Zhang and Chu, 2005). For a given time series {x(t), t=1, 2, …, n}, the AR model is formulated as
where p is the model order, {ϕ1, ϕ2, …, ϕ p } are parameters of the AR model, which are unknown. {a(t), t=1, 2, …, n} is zero-mean white noise. Identification of the AR model as shown in Eq. (1) concerns the selection of model order p and corresponding parameters {ϕ1, ϕ2, …, ϕ p }, which can be found in many papers (Yang, 2013).
Various algorithms have been developed for the estimation of model parameters. In this study, the Levinson-Durbin (L-D) algorithm is employed in parameter estimation. With the given ship motion sequence x i (i=1, 2, …, n) and model order p, L-D algorithm can be summarized in Table 1 (Huang et al., 2015). The least mean square algorithm suffers from convergence speed and an eigenvalue spread problem (Myllylä, 2001), and the use of the recursive least square algorithm introduces memory intensive and numerically-unstable problems (Douglas, 1996). In addition, the determination of the forgetting factor is not always adaptive.
There are several available methods to specify model orders, such as Akaike information criterion (AIC), Bayesian information criterion (BIC), and final prediction error criterion (FPE). The BIC criterion is applied for model order selection in this study. The BIC value of general AR( p ) is defined as
where σ2 is the covariance. Model order p0 that leads to the minimum BIC value is chosen as the optimal order.
Once the prediction model as presented in Eq. (1) is determined, a k-step-ahead adaptive predictor can be presented as
where \(\hat x\left( {t + k} \right)\) is the prediction value of k steps advancing.
2.2 EMD technique using AR model in ends processing
Decomposition is critical in signal processing. Complex signals are frequently decomposed into several simple components. Then, information contained in each component would be analyzed to reduce the complexity and enhance interpretability. Conventionally, Fourier transform and wavelet analysis are the approaches adopted most often. However, it is well known that Fourier transform fails to extract the frequency information from non-stationary signals. Although effective in handling nonstationarity, wavelet analysis suffers from its nonadaptive nature as it applies the same type of basis functions to the entire range of data. Similarly, wavelet analysis also represents a signal by a linear combination of wavelet basis functions. Its decomposition results for nonlinear data can be misleading (Huang and Wu, 2008; Kim et al., 2012). Therefore, a set of basis functions that reflects the time-varying property of a signal is required.
A data-driven technique known as EMD has been proposed by Huang et al. (1998), which is powerful and adaptive in analyzing nonlinear and non-stationary data sets. It provides an effective approach for decomposing a signal into a collection of so-called intrinsic mode functions (IMFs), which can be treated as empirical basis functions. An IMF resulting from the EMD procedure should satisfy two conditions: (1) the number of extremas and the number of zero-crossings should be equal or differ by one, and (2) the local average should be zero, i.e., the mean of the upper envelope defined by the local maxima and the lower envelope defined by the local minima is zero (Huang et al., 1998).
Algorithms of EMD for decomposing a given sequence x(t) are summarized as follows:
-
(1)
Identify the local extrema.
-
(2)
Generate the upper envelope u(t) and the lower envelope l(t) via the spline interpolation among all local maxima and local minima, respectively. Then, the mean envelope is obtained: m(t)=[l(t)+u(t)]/2.
-
(3)
Subtract m(t) from the signal x(t) to obtain the IMF candidate: h(t)=x(t)−m(t).
-
(4)
Verify whether h(t) satisfies the conditions for IMFs, do step (1) to step (4) until h(t) is an IMF.
-
(5)
Get the nth IMF component imf n (t)=h(t) (after n shifting processes) and the corresponding residue r(t)=x(t)-h(t).
-
(6)
Repeat the whole algorithm with r(t) obtained in step (5) until the residue is a monotonic function.
By implementing these algorithms, the decomposition procedure of a signal is expressed as
In practice, one of the essential questions in EMD is boundary effects processing. Researchers have proposed techniques for processing the boundary effects, such as the characteristic wave extending method (Huang et al., 1998), a ratio extension method (Wu and Riemenschneider, 2010), and the mirror image extending method (Zhao and Huang, 2001). Among the various approaches, the symmetric extending method is the most popular when implementing EMD processing. However, extended results by using symmetric extension method and nonpredictive methods are far from satisfactory as great differences always exist between the extended and real extrema. Despite the fact that EMD-based prediction models have already been extensively researched in substantial papers and generally proved to be an effective way for improving prediction performance of various models (Yu et al., 2008; Fan et al., 2013), the influence of end effects on prediction results (Xiong et al., 2014; Huang et al., 2015) is rarely properly established.
In this study, the AR model as presented in Section 2.1 is applied in boundary effects processing. An analytical signal comprised of three sine functions in Eq. (5) is studied as an example to compare the performance of EMD-SVR models using the symmetric extension method and AR-based extension method.
Fig. 1 presents the extension results of the AR prediction model and the symmetric extension method, from which it is seen that the AR prediction model provides reasonable and satisfactory extension results, while the exterma produced by the symmetric extension method fail to match the true ones.
Results presented in Fig. 2 further highlight that considerable reduction of the end effects on prediction accuracy has been made by employing the AR model in boundary processing instead of the symmetric extension method.
3 SVR and AR-EMD-SVR prediction models
3.1 Formulation descriptions of SVR model
Support vector machine (SVM) theory is a statistical learning theory-based method with a strong capacity to handle nonlinear problems. Its basic idea is to map the nonlinear data into high dimension feature space using a nonlinear mapping function, where linear techniques are available (Zhou and Shi, 2013). SVR is a nonlinear prediction model that is based on SVM theory. It has been widely applied in short-term prediction problems, such as traffic flow forecasting (Castro-Neto et al., 2009) and electric load forecasting (Fan et al., 2013). Descriptions of identification algorithms for the SVR model can be found in (Castro-Neto et al., 2009; Fan and Tang, 2013; Huo et al., 2014).
Given a training data set of N points {(x i , y i ), i=1, 2, …, N} with input data x i ∈RN and output data y i ∈R, then, according to SVM theory, a linear regression function can be presented as
in a feature space Z, where w is a vector in Z, and the input space RN is mapped into feature space Z through the corresponding mapping function Φ(x). Eq. (6) in the feature space is usually designated as an SVR model and applied to estimate the unknown nonlinear function, where the parameters w and b need to be selected.
As is well known, the SVM method aims to minimize the empirical risk and overall fitting errors. The regression problem is equivalent to the optimization problem as
where C is a regularization constant and e i is the estimation error.
To solve the optimization problem, the Lagrangian function L can be given as
where a=[a1, a2, …, a N ] represents the Lagrangian multipliers.
Then, Karush-Kuhn-Tucker (KKT) conditions for identifying the SVR model can be summarized as
The linear equation system (9) can be further written as
where \({y_N} = {\left[ {{y_1},{\rm{ }}{y_1},{\rm{ }} \ldots ,{\rm{ }}{y_N}} \right]^{\rm{T}}},{e_1} = {\left[ {1,{\rm{ }}1,{\rm{ }} \ldots {\rm{, 1}}} \right]^{\rm{T}}},{\rm{ }}{a_N} = {\left[ {{a_1},{\rm{ }}{a_2},{\rm{ }} \ldots {\rm{, }}{a_N}} \right]^{\rm{T}}}\) , I is an identity matrix, \({Q_N} = \left( {\Phi \left( {{x_i}} \right),\Phi \left( {{x_i}} \right)} \right) = k\left( {{x_i},{\rm{ }}{x_j}} \right),{\rm{ }}i,j = 1,{\rm{ 2, }} \ldots {\rm{, }}N\) , and k(x i , x j ) is a kernel function that satisfies the Mercer theorem. In the present study, the RBF with a width of β is chosen:
The parameters of b and a for SVR model can be reached by solving linear equation system in Eq. (10), and the regression is rewritten as
3.2 Hybridization process of AR-EMD-SVR prediction model
Time series of ship motions are kinds of complicated nonlinear and non-stationary signals, which consist of components with different characteristics. Despite being capable of handling nonlinearity, the SVR model fails to handle non-stationarity for shortterm problems (Fan and Tang, 2013). A combination of AR-EMD and the SVR model provides an effective way to improve the prediction accuracy for nonlinear and non-stationary time series.
The implementation procedure for ship motion prediction using hybrid AR-EMD-SVR model comprises three steps, which are illustrated by a flowchart as shown in Fig. 3. In the first step, ship motion time series is decomposed into two simple and meaningful IMFs and a residual through EMD processing. In the second step, prediction of decomposed components is preformed individually with the SVR model. In the final step, the predictions are aggregated to attain the final forecast.
4 Results and discussion
This section focuses on the prediction performance of the proposed AR-EMD-SVR model. Comparison studies among the AR-EMD-SVR model, AR model, SVR model, and EMD-AR model have been conducted using ship motion time series from model testing in a towing tank.
4.1 Brief description of ship motion data from model testing
4.1.1 Heave and pitch motion of a large container ship
Model testing based ship motion time series of a large container ship moving at a speed of 24 knots in heading waves with the condition of sea state 5 are used in the simulation (Fig. 4). The length, beam, and draft are 304 m, 35 m, and 10 m, respectively. Ship motion status (heave, pitch) was sampled at 50 Hz in model testing and down-sampled to two points per second when the simulation was implemented.
4.1.2 Brief analysis of the non-stationary and nonlinear nature in ship motionIntroduction
Conventionally, a time series, {x(t)}, is stationary in the board sense, if, for all t,
where E[] is the expected value defined as the ensemble average of the quantity, and R xx is the covariance function (Brockwell and Davis, 1991).
In brief, for stationary time series, the expected values and covariance corresponding to specified time delay should not vary with time. As shown in Fig. 5, it can be seen that the expected value E[x(t)] and covariance with time delay of 10 steps E[x(t)x(t+10)] are approximately equal to zero.
Based on the definition of a stationary process, quantitative methods of consecutive statistics are used to analyze the stationarity of the ship motions in Fig. 4. Moreover, a recurrence plot, a direct and effective graphical approach for reflecting the evolution tendency and potential periodicity of a dynamic system (Eckmann et al., 1987), is also applied in stationarity analysis. Recurrence plot lattices of stationary time series should subject to uniform distribution. However, the plot lattices of the nonstationary time series must be non-uniform.
Fig. 6 gives the covariance function and the expected values of heave and pitch motions. Obvious time dependent variations of the statistic for heave and pitch motions are suggested, indicating the existence of non-stationarity in the experimental ship motion data.
This observation is further demonstrated by the recurrence plots in Fig. 7. The non-uniform distribution nature is easily found. This indicates that the given ship motions for prediction simulation study are non-stationary. Due to the non-stationarity, the intra-wave frequency modulation, designated as an indicator for nonlinearity (Huang et al., 1998; 2009), also exists in the motion data. Therefore, the heave and pitch motions in Fig. 4 are non-stationary and nonlinear.
4.2 Evaluation of prediction accuracy
for forecasting accuracy evaluation, prediction results are studied by (1) comparing time histories of the above models’ forecasts with actual ship motions, (2) computing the correlation coefficient (r) and the root mean square error (RMSE) as shown in Eqs. (14) and (15), and (3) drawing scatter diagrams of prediction results and corresponding measured ship motions.
where \({{\hat x}_t}\) is the forecast results with a mean value of \({\hat x_m}\) , x t is the measured ship motions, xm is the mean value of x t , and n represents the testing times.
4.3 Prediction results, comparison, and analysis
A sliding data window with the size of 500 points is used to construct the prediction models, and 1000 points are employed for testing.
Figs. 8 and 9 present the 10-lead-step predicted time histories of heave and pitch motions by models of SVR, AR, EMD-AR, and AR-EMD-SVR. It is immediately obvious that predictions of the nonlinear SVR model provide the lowest level of agreement with both the measured heave and the pitch motions. Spatial and temporal offsets generally exist relative to the targets, especially the spatial offsets, which are rather large in the troughs and peaks. Comparatively, predictions of the linear AR model show smaller spatial and temporal deviations relative to the target. Nevertheless, deviations between the predictions and observations are still out of the expected range. Neither the single AR nor the SVR model produces reasonable predictions, as spatial offsets and temporal shifts generally exist and are seen to become larger as the non-stationarity increases from a comparison between Figs. 8 and 9.
In contrast, as the 10-lead-step forecasts suggested, EMD hybrid models predict far better than the single AR and SVR models. Not only are, for the most part, the peaks and troughs reasonably captured, but the short-term fluctuations in the ship motions are also reproduced remarkably well. Predictions in Figs. 8 and 9, in spite of minor spatial offset in local positions, display a fidelity to the measurements that is certainly acceptable for most practical applications. The AR-EMD-SVR model is superior to the EMDAR model in that it captures the ship motions more precisely in the troughs and peaks.
The observations are further confirmed by the corresponding scatter diagrams given in Figs. 10 and 11, which are related to the heave and pitch motions, respectively. The relevant correlation coefficient r, a widely accepted measure of the degree of linear association between the target and the realized outcome of a prediction model, of each diagram is also provided. Note that in Fig. 10 the magnitudes of the correlation coefficients respect to scatter diagrams of AR, EMD-AR, SVR, and AR-EMD-SVR models are 0.75, 0.93, 0.80, and 0.97, and in Fig. 11 they are 0.91, 0.93, 0.90, and 0.95, respectively. Which are highly consistent with the observations from Figs. 8 and 9.
The poor performance of AR model in predicting non-stationary and nonlinear ship motions essentially results from its stationary and linear theoretical assumptions. On the other side, the unexpected predictions by SVR model provide evidence that the method is non-stationary limited, which agrees with the conclusion given by Fan et al. (2012).
Further comparison between the predictions given by Figs. 8–11 shows that the SVR model results in large prediction errors, indicating that the stationary nonlinear model is more sensitive to the non-stationarity than the linear model. This is probably because the prediction errors resulting from the nonlinear model are themselves nonlinear.
As shown in Figs. 8–11, substantial improvements in short-term predictions of nonlinear and non-stationary ship motions are obtained by using the AR-EMD coupled models. This demonstrates that non-stationarity brings obvious negative effects into the predictions. It is also clear that the AREMD technique is an effective way to improve the prediction performance of single AR and SVR models, as it is capable of handling nonlinear and nonstationary data. From Figs. 8–11 we can see that, the AR-EMD-SVR model matches the target better and produces higher prediction accuracy. The comparison of the EMD-AR and AR-EMD-SVR models highlights the difficulty of the former model. Even though AR-EMD can help handle the nonstationarity, EMD-AR model still suffers a “nonlinear” difficulty stemming from the linear assumption of the AR model. The AR-EMD-SVR model shows a superior performance in forecasting nonstationary and non-linear ship motion, where the non-stationarity and nonlinearity processing capabilities are inherited from the AR-EMD technique and the SVR model, respectively.
To learn the ensemble prediction behaviors of the above mentioned four models, short-term forecasts were made of ship motions with lead times varying from 1 s to 10 s. For comparison among the above prediction models and to understand the evolutionary process of error measures with respect to lead times, forecast errors of RMSE and r are represented graphically in Figs. 12 and 13 (p.573).
It appears from Figs. 12 and 13 that the forecasting accuracy of each model decreases as the predicted lead time increases. Taking AR-EMD-SVR as an example, in heave prediction, as the lead time varies from 1 s to 10 s, the value of RMSE increases from 0.01 m to 0.13 m while the corresponding correlation coefficient decreasing from 1.00 to 0.90. Comparison among prediction errors of AR, SVR, EMD-AR, and AR-EMD-SVR models lead to a more comprehensive validation that AR-EMD is effective in improving the accuracy of the AR and SVR models, and that the proposed AR-EMD-SVR model performs best in both heave and pitch predictions.
Further comparison of the prediction errors of AR, EMD-AR, and SVR models reveals how the nonlinearity and non-stationarity impact on predictions as the lead time increases. It may be seen from the RMSE as shown in Figs. 12 and 13 that the SVR model is likely to produce better predictions than both AR and its EMD hybridized model when the prediction lead time is smaller than a certain bound. In the present case, the bound is 5 s for heave motion and 4 s for pitch motion. However, once the lead times exceed the bounds, the SVR model leads to overall higher prediction errors than the AR and EMD-AR models. The two observations indicate that the nonlinearity results in dominant effects on the predictions if the lead time less than a certain bound, whereas the non-stationarity shows a weak impact on the predictions. When the lead time surpasses the above mentioned bounds, the non-stationarity produces a stronger negative effect on the short-term predictions than the nonlinearity. Therefore, neither the nonlinear SVR nor the enhanced AR model shows limitation in predicting non-linear and nonstationary ship motions. As the results given in Figs 12 and 13, this difficulty has been well overcome by the proposed AR-EMD-SVR model.
5 Conclusions
In this paper, a hybrid AR-EMD-SVR model has been developed for short-term prediction of nonlinear and non-stationary ship motions. The SVR model is coupled with an EMD technique using the AR model in boundary processing. An analytical signal is employed to examine the improvement of the AR model in boundary extension compared to the conventional symmetric extension method. Comparisons show that AR model-based boundary extension method leads to more reasonable extension results for EMD and provides better prediction accuracy. Research on performance of the proposed AREMD-SVR model compared to AR, SVR, and EMDAR models was conducted applying ship motion data from model testing. Results suggest that AR-EMD is able to handle the non-stationarity in ship motions whereas conventional AR and SVR suffer difficulty. Comparative analysis of AR, SVR, EMD-AR, and AR-EMD-SVR models highlights the superiority of the proposed method providing forecasts.
References
Brockwell, P.J., Davis, R.A., 1991. Stationary Time Series. In: Time Series: Theory and Methods. Springer Series in Statics, Springer, New York, p.1–13. [doi:10.1007/978- 1-4419-0320-4_1]
Cannas, B., Fanni, A., See, L., et al., 2006. Data preprocessing for river flow forecasting using neural networks: wavelet transforms and data partitioning. Physics and Chemistry of the Earth, Parts A/B/C, 31(18):1164–1171. [doi:10.1016/j.pce.2006.03.020]
Castro-Neto, M., Jeong, Y.S., Jeong, M.K., et al., 2009. Online-SVR for short-term traffic flow prediction under typical and atypical traffic conditions. Expert Systems with Applications, 36(3):6164–6173. [doi:10.1016/j.eswa. 2008.07.069]
Chakrabarti, S.K., 1989. Approximate methods in short-term wave response distribution. Ocean Engineering, 16(4): 373–399. [doi:10.1016/0029-8018(89)90014-0]
Cheng, C.H., Wei, L.Y., 2014. A novel time-series model based on empirical mode decomposition for forecasting TAIEX. Economic Modelling, 36:136–141. [doi:10. 1016/j.econmod.2013.09.033]
Deka, P., Chandra, P.R., 2012. Discrete wavelet neural network approach in significant wave height forecasting for multistep lead time. Ocean Engineering, 43:32–42. [doi:10.1016/j.oceaneng.2012.01.017]
Douglas, S.C., 1996. Efficient approximate implementations of the fast affine projection algorithm using orthogonal transforms. IEEE International Conference on Acoustics, Speech, and Signal Processing, Atlanta, USA, 3:1656–1659. [doi:10.1109/ICASSP.1996.544123]
Eckmann, J.P., Kamphorst, S.O., Ruelle, D., 1987. Recurrence plots of dynamical systems. Europhysics Letters, 4(9):973–977. [doi:10.1209/0295-5075/4/9/004]
Fan, G.F., Qing, S., Wang, H., et al., 2013. Support vector regression model based on empirical mode decomposition and auto regression for electric load forecasting. Energies, 6(4):1887–1901. [doi:10.3390/en6041887]
Fan, J., Tang, Y.Z., 2013. An EMD-SVR method for nonstationary time series prediction. IEEE International Conference on Quality, Reliability, Risk, Maintenance, and Safety Engineering, Chengdu, China, p.1765–1770. [doi:10.1109/QR2MSE.2013.6625918]
Gu, M., Liu, C.D., Zhang, J.F., 2013. Extreme short-term prediction of ship motion based on chaotic theory and RBF neural network. Journal of Ship Mechanics, 17(10): 1147–1152 (in Chinese). [doi:10.3969/j.issn.1007-7294. 2013.10.007]
Guedes Soares, C., 1990. Effect of spectral shape uncertainty in the short-term wave-induced ship responses. Applied Ocean Research, 12(2):54–69. [doi:10.1016/S0141-1187 (05)80030-6]
Guedes Soares, C., 1991. Effect of transfer function uncertainty on short-term ship responses. Ocean Engineering, 18(4):329–362. [doi:10.1016/0029-8018(91)90018-L]
Hirdaris, S.E., 2014. Special issue on uncertainty modelling for ships and offshore structures. Ocean Engineering, 86:1–2. [doi:10.1016/j.oceaneng.2014.05.001]
Hirdaris, S.E., Temarel, P., 2009. Hydroelasticity of ships: recent advances and future trends. Proceedings of the Institution of Mechanical Engineers, Part M: Journal of Engineering for the Maritime Environment, 223(3):305–330. [doi:10.1243/14750902JEME160]
Hirdaris, S.E., Bai, W., Dessi, D., et al., 2014. Loads for use in the design of ships and offshore structures. Ocean Engineering, 78:131–174. [doi:10.1016/j.oceaneng.2013.09. 012]
Hou, J.J., Qi, Y.S., 2011. On the prediction in time domain of ship non-stationary swaying motions. 3rd International Conference on Information Technology and Computer Science, Huangshi, China. American Society of Mechanical Engineers, New York, USA, p.230–234. [doi:10. 1115/1.859742.paper57]
Huang, L.M., Duan, W.Y., Han, Y., et al., 2014. A review of short-term prediction techniques for ship motions in seaway. Journal of Ship Mechanics, 18(12):1534–1542. [doi:10.3969/j.issn.1007-7294.2014.12.013]
Huang, L.M., Duan, W.Y., Han, Y., et al., 2015. Extending the scope of AR model in forecasting non-stationary ship motion by using AR-EMD technique. Journal of Ship Mechanics, 19(9), in press.
Huang, N.E., Wu, Z.H., 2008. A review on Hilbert-Huang transform: method and its applications to geophysical studies. Reviews of Geophysics, 46(2):1–23. [doi:10. 1029/2007RG000228]
Huang, N.E., Shen, Z., Long, S.R., et al., 1998. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis. Proceedings of the Royal Society A: Mathematical, Physical and Engineering Sciences, 454(1971):903–995. [doi:10.1098/rspa.1998.0193]
Huang, N.E., Wu, Z.H., Long, S.R., et al., 2009. On instantaneous frequency. Advances in Adaptive Data Analysis, 01(02):177–229. [doi:10.1142/S1793536909000096]
Huo, H.B., Ji, Y., Zhu, X.J., et al., 2014. Control-oriented dynamic identification modeling of a planar SOFC stack based on genetic algorithm-least squares support vector regression. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 15(10):829–839. [doi:10.1631/jzus.A1400011]
Kaplan, P., Sargent, T.P., 1965. A preliminary study of prediction techniques for aircraft carrier motions at sea. Report No. AD0624155, Oceanic Inc. Plainview NY, USA.
Khan, A., Bil, C., Marion, K.E., et al., 2004. Real time prediction of ship motions and attitudes using advanced prediction techniques. 24th International Congress Council of the Aeronautical Sciences, Yokohama, Japan, p.1–10.
Khan, A., Bil, C., Marion, K.E., 2005. Ship motion prediction for launch and recovery of air vehicles. Proceedings of MTS/IEEE Oceans, Washington, USA, 3:2795–2801. [doi:10.1109/OCEANS.2005.1640198]
Khan, A., Bil, C., Marion, K.E., et al., 2006. Real time prediction of ship motion for the aid of helicopter and aircraft deployment and recovery. 25th International Congress Council of the Aeronautical Sciences, Hamburg, Germany, p.1–6.
Kim, D., Kim, K.O., Oh, H.S., 2012. Extending the scope of empirical mode decomposition by smoothing. EURASIP Journal on Advances in Signal Processing, 2012:168. [doi:10.1186/1687-6180-2012-168]
Lee, J., Jun, C.H., 2010. Biclustering of ARMA time series. Journal of Zhejiang University-SCIENCE A (Applied Physics & Engineering), 11(12):959–965. [doi:10.1631/jzus.A1001334]
Myllylä, V., 2001. Robust fast affine projection algorithm for acoustic echo cancellation. International Workshop on Acoustic Echo and Noise Control, Darmstadt, Germany, p.143–146.
Ozger, M., 2010. Significant wave height forecasting using wavelet fuzzy logic approach. Ocean Engineering, 37(16): 1443–1451. [doi:10.1016/j.oceaneng.2010.07.009]
Papanikolaou, A., Mohammed, E.A., Hirdaris, S.E., 2014. Stochastic uncertainty modeling for ship design loads and operational guidance. Ocean Engineering, 86:47–57. [doi:10.1016/j.oceaneng.2014.01.014]
Ra, W.S., Whang, I.H., 2006. Real-time long-term prediction of ship motion for fire control applications. Electronics Letters, 42(18):1020–1022. [doi:10.1049/el:20061053]
Riola, J.M., Diaz, J.J., Giron-Sierra, J.M., 2011. The prediction of calm opportunities for landing on a ship: aspects of the problem. IEEE-Spain Oceans, Santander, Spain, p.1-8. [doi:10.1109/Oceans-Spain.2011.6003435]
Sakellariou, J.S., Fassois, S.D., 2006. Stochastic output error vibration-based damage detection and assessment in structures under earthquake excitation. Journal of Sound and Vibration, 297(3-5):1048–1067. [doi:10.1016/j.jsv. 2006.05.009]
Triantafyllou, M., Athans, M., 1981. Real time estimation of the heaving and pitching motions of a ship, using a Kalman filter. IEEE Oceans, Boston, USA, p.1090–1095. [doi:10.1109/OCEANS.1981.1151582]
Triantafyllou, M., Bodson, M., 1982. Real time prediction of marine vessel motion using Kalman filtering techniques. Offshore Technology Conference, Houston, USA. [doi:10.4043/4388-MS]
Triantafyllou, M., Bodson, M., Athans, M., 1983. Real time estimation of ship motions using Kalman filtering techniques. IEEE Journal of Oceanic Engineering, 8(1):9–20. [doi:10.1109/JOE.1983.1145542]
Wang, W.C., Chau, K.W., Xu, D.M., et al., 2015. Improving forecasting accuracy of annual runoff time series using ARIMA based on EEMD decomposition. Water Resources Management, 29(8):2655–2675. [doi:10.1007/s11269-015-0962-6]
Wu, Q., Riemenschneider, S.D., 2010. Boundary extension and stop criteria for empirical mode decomposition. Advances in Adaptive Data Analysis, 02(02):157–169. [doi:10.1142/S1793536910000434]
Xiong, T., Bao, Y.K., Hu, Z.Y., 2014. Does restraining end effect matter in EMD-based modeling framework for time series prediction? Some experimental evidences. Neurocomputing, 123:174–184. [doi:10.1016/j.neucom. 2013.07.004]
Yang, X.L., 2013. Displacement motion prediction of a landing deck for recovery operations of rotary UAVs. International Journal of Control, Automation and Systems, 11(1):58–64. [doi:10.1007/s12555-011-0157-8]
Yu, L., Wang, S.Y., Lai, K.K., 2008. Forecasting crude oil price with an EMD-based neural network ensemble learning paradigm. Energy Economics, 30(5):2623–2635. [doi:10.1016/j.eneco.2008.05.003]
Yumori, I.R., 1981. Real time prediction of ship response to ocean waves using time series analysis. IEEE Oceans, Boston, USA, p.1082–1089. [doi:10.1109/OCEANS. 1981.1151574]
Zhang, J., Chu, F., 2005. Real-time modeling and prediction of physiological hand tremor. IEEE International Conference on Acoustics, Speech, and Signal Processing, Philadelphia, USA, 5:v/645–v/648. [doi:10.1109/ICASSP.2005.1416386]
Zhang, W.J., Liu, Z.J., 2014. Real-time ship motion prediction based on time delay wavelet neural network. Journal of Applied Mathematics, 2014:176297. [doi:10.1155/2014/176297]
Zhao, J.P., Huang, D.J., 2001. Mirror extending and circular spline function for empirical mode decomposition method. Journal of Zhejiang University-SCIENCE, 2(3):247–252. [doi:10.1631/jzus.2001.0247]
Zhou, B., Shi, A.G., 2013. Empirical mode decomposition based LSSVM for ship motion prediction. 10th International Symposium on Neural Networks, Advances in Neural Networks, Dalian, China, p.319–325. [doi:10. 1007/978-3-642-39065-4_39]
Zhou, S.Q., Zhao, X.R., 1996. A nonlinear method of extreme short time prediction for warship motions at sea. Journal of Harbin Engineering University, 17(4):1–7 (in Chinese).
Author information
Authors and Affiliations
Corresponding author
Additional information
Project supported by the National Natural Science Foundation of China (No. 51079032)
ORCID: Wen-yang DUAN, http://orcid.org/0000-0002-7811-4986/0000-0002-7811-4986; Li-min HUANG, http://orcid.org/0000-0002-7944-2754/0000-0002-7944-2754
Rights and permissions
About this article
Cite this article
Duan, Wy., Huang, Lm., Han, Y. et al. A hybrid AR-EMD-SVR model for the short-term prediction of nonlinear and non-stationary ship motion. J. Zhejiang Univ. Sci. A 16, 562–576 (2015). https://doi.org/10.1631/jzus.A1500040
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.A1500040
Key words
- Nonlinear and non-stationary ship motion
- Short-term prediction
- Empirical mode decomposition (EMD)
- Support vector regression (SVR) model
- Autoregressive (AR) model