nach oben

Soft Computing

Erschienen in:

05.09.2023 | Application of soft computing

A noise-immune and attention-based multi-modal framework for short-term traffic flow forecasting

verfasst von: Guanru Tan, Teng Zhou, Boyu Huang, Haowen Dou, Youyi Song, Zhizhe Lin

Erschienen in: Soft Computing | Ausgabe 6/2024

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Accurately forecasting short-term traffic flow is essential for intelligent transportation systems. However, current methods often struggle to fully exploit implicit variation patterns and heterogeneous correlations in traffic flow data, and can be sensitive to non-Gaussian noise. In this paper, we propose a novel noise-immune and attention-based multi-modal model (NIAMNet) for short-term traffic flow forecasting. Inspired by the success of computer vision techniques, NIAMNet transforms one-dimensional traffic flow into images and embeds residual dual-attention blocks (RDB) to extract in-deep features. Besides, we introduce a dynamic noise-immune loss to address the impact of noise and outliers on model performance. Experimental results on four real-world benchmark datasets demonstrate the superiority of NIAMNet over existing methods, achieving the lowest MAPE (10.43, 9.79, 10.51, and 11.01) and RMSE (247.13, 192.36, 208.40, and 150.01). Additional ablation experiments are carried out to provide insight into the significance of each component. Our approach contributes to the development of more accurate and robust short-term traffic flow forecasting models.

Vorheriger Artikel A PSO-optimized novel PID neural network model for temperature control of jacketed CSTR: design, simulation, and a comparative study

Nächster Artikel Heat sink/source impact on Williamson liquid flow over a stretching cylinder with modified Fourier and Fick’s law

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Cai L, Zhang Z, Yang J, Yidan Y, Zhou T, Qin J (2019) A noise-immune Kalman filter for short-term traffic flow forecasting. Physica A Stat Mech Appl 536:122601. https://doi.org/10.1016/j.physa.2019.122601CrossRef

Cai L, Yidan Yu, Zhang S, Song Y, Xiong Z, Zhou T (2020a) A sample-rebalanced outlier-rejected k-nearest neighbour regression model for short-term traffic flow forecasting. IEEE Access 8:22686–22696. https://doi.org/10.1109/ACCESS.2020.2970250

Cai W, Yang J, Yidan Yu, Song Y, Zhou T, Qin J (2020b) PSO-ELM: a hybrid learning model for short-term traffic flow forecasting. IEEE Access 8:6505–6514. https://doi.org/10.1109/ACCESS.2019.2963784

Cai L, Lei M, Zhang S, Yidan Yu, Zhou T, Qin J (2020c) A noise-immune LSTM network for short-term traffic flow forecasting. Chaos 30(2):023135. https://doi.org/10.1063/1.5120502

Chai W, Zheng Y, Tian L, Qin J, Zhou T (2023) GA-KELM: genetic-algorithm-improved kernel extreme learning machine for traffic flow forecasting. Mathematics 11(16):3574CrossRef

Chan KY, Dillon TS, Singh J, Chang E (2011) Neural-network-based models for short-term traffic flow forecasting using a hybrid exponential smoothing and Levenberg-Marquardt algorithm. IEEE Trans Intell Transp Syst 13(2):644–654. https://doi.org/10.1109/TITS.2011.2174051CrossRef

Chen B, Xing L, Zhao H, Zheng N, Prı JC et al (2016) Generalized correntropy for robust adaptive filtering. IEEE Trans Signal Process 64(13):3376–3387. https://doi.org/10.1109/TSP.2016.2539127ADSMathSciNetCrossRef

Chen L-C, Papandreou G, Kokkinos I, Murphy K, Yuille AL (2017) DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs. IEEE Trans Pattern Anal Mach Intell 40(4):834–848. https://doi.org/10.1109/TPAMI.2017.2699184CrossRefPubMed

Chen W, An J, Li R, Li F, Guoqi Xie Md, Bhuiyan ZA, Li K (2018) A novel fuzzy deep-learning approach to traffic flow prediction with uncertain spatial-temporal data features. Future Gener Comput Syst 89:78–88. https://doi.org/10.1016/j.future.2018.06.021CrossRef

Chen B, Zheng Y, Ren P (2021) Error loss networks. arXiv preprint arXiv:2106.03722

Chen J, Kao S, He H, Zhuo W, Wen S, Lee C-H, Chan S-HG (2023) Run, don’t walk: chasing higher flops for faster neural networks. arXiv preprint arXiv:2303.03667

Cheng S, Feng L, Peng P (2020) Short-term traffic forecasting by mining the non-stationarity of spatiotemporal patterns. IEEE Trans Intell Transp Syst. https://doi.org/10.1109/TITS.2020.2991781CrossRef

Cui Z, Huang B, Dou H, Cheng Y, Guan J, Zhou T (2022a) A two stages hybrid extreme learning model for short-term traffic flow forecasting. Mathematics. https://doi.org/10.3390/math10122087

Cui Z, Huang B, Dou H, Tan G, Zheng S, Zhou T (2022b) GSA-ELM: a hybrid learning model for short-term traffic flow forecasting. IET Intell Transp Syst 16(1):41–52. https://doi.org/10.1049/itr2.12127

Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, Dehghani M, Minderer M, Heigold G, Gelly S et al (2020) An image is worth 16x16 words: transformers for image recognition at scale. arXiv preprint arXiv:2010.11929

Dou H, Tan J, Wei H, Wang F, Yang J, Ma X-G, Wang J, Zhou T (2022) Transfer inhibitory potency prediction to binary classification: a model only needs a small training set. Comput Methods Programs Biomed. https://doi.org/10.1016/j.cmpb.2022.106633CrossRefPubMed

Fang W, Zhuo W, Yan J, Song Y, Jiang D, Zhou T (2022) Attention meets long short-term memory: a deep learning network for traffic flow forecasting. Physica A Stat Mech Appl 587:126485. https://doi.org/10.1016/j.physa.2021.126485

Feng X, Ling X, Zheng H, Chen Z, Yiwen X (2018) Adaptive multi-kernel SVM with spatial-temporal correlation for short-term traffic flow prediction. IEEE Trans Intell Transp Syst 20(6):2001–2013. https://doi.org/10.1109/TITS.2018.2854913CrossRef

Haibo X, Jiang C (2020) Deep belief network-based support vector regression method for traffic flow forecasting. Neural Comput Appl 32:2027–2036. https://doi.org/10.1007/s00521-019-04339-xCrossRef

He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778

Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreetto M, Adam H (2017) MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv preprint arXiv:1704.04861

Hu W, Li Yan, Liu K, Wang H (2016) A short-term traffic flow forecasting method based on the hybrid PSO-SVR. Neural Process Lett 43(1):155–172. https://doi.org/10.1007/s11063-015-9409-6CrossRef

Huakang L, Huang D, Youyi S, Jiang D, Zhou T, Qin J (2020) ST-TrafficNet: a spatial-temporal deep learning network for traffic forecasting. Electronics 9(9):1–17. https://doi.org/10.3390/electronics9091474CrossRef

Huakang L, Ge Z, Song Y, Jiang D, Zhou T, Qin J (2021) A temporal-aware LSTM enhanced by loss-switch mechanism for traffic flow forecasting. Neurocomputing 427:169–178. https://doi.org/10.1016/j.neucom.2020.11.026CrossRef

Huang G, Liu Z, Van Der ML, Weinberger KQ (2017) Densely connected convolutional networks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 4700–4708

Huang H, Zheng S, Yang Z, Wu Y, Li Y, Qiu J, Cheng Y, Lin P, Lin Y, Ji Guan, Mikulis DJ, Zhou T, Wu R (2022) Voxel-based morphometry and a deep learning model for the diagnosis of early Alzheimer’s disease based on cerebral gray matter changes. Cereb Cortex. https://doi.org/10.1093/cercor/bhac099CrossRefPubMedPubMedCentral

Li X, Kang Y, Li F (2020) Forecasting with time series imaging. Expert Syst Appl 160:113680. https://doi.org/10.1016/j.eswa.2020.113680CrossRef

Lippi M, Bertini M, Frasconi P (2013) Short-term traffic flow forecasting: an experimental comparison of time-series analysis and supervised learning. IEEE Trans Intell Transp Syst 14(2):871–882. https://doi.org/10.1109/TITS.2013.2247040CrossRef

Liu W, Pokharel PP, Principe JC (2007) Correntropy: properties and applications in non-gaussian signal processing. IEEE Trans Signal Process 55(11):5286–5298. https://doi.org/10.1109/TSP.2007.896065ADSMathSciNetCrossRef

Luo Y, Wei M, Li S, Ling J, Xie G, Yao S (2023a) An effective co-support guided analysis model for multi-contrast MRI reconstruction. IEEE J Biomed Health Inform 27:2477–2488

Luo Y, Huang Q, Ling J, Lin K, Zhou T (2023b) Local and global knowledge distillation with direction-enhanced contrastive learning for single-image deraining. Knowledge-Based Systems, pp 1–10

Miglani A, Kumar N (2019) Deep learning models for traffic flow prediction in autonomous vehicles: a review, solutions, and challenges. Vehic Commun 20:100184. https://doi.org/10.1016/j.vehcom.2019.100184CrossRef

Qiu J, Tan G, Lin Y, Guan J, Dai Z, Wang F, Zhuang C, Wilman AH, Huang H, Cao Z et al (2022) Automated detection of intracranial artery stenosis and occlusion in magnetic resonance angiography: a preliminary study based on deep learning. Magn Reson Imaging 94:105–111. https://doi.org/10.1016/j.mri.2022.09.006CrossRefPubMed

Shahriari S, Ghasri M, Sisson SA, Rashidi T (2020) Ensemble of ARIMA: combining parametric and bootstrapping technique for traffic flow prediction. Transp A Transp Sci 16(3):1552–1573. https://doi.org/10.1080/23249935.2020.1764662CrossRef

Song Z, Guo Y, Yao W, Ma J (2019) Short-term traffic speed prediction under different data collection time intervals using a SARIMA-SDGM hybrid prediction model. PLoS One 14(6):e0218626. https://doi.org/10.1371/journal.pone.0218626CrossRefPubMedPubMedCentral

Tan M, Le Q (2019) EfficientNet: rethinking model scaling for convolutional neural networks. In: International conference on machine learning. PMLR, pp 6105–6114

Tan G, Zheng S, Huang B, Cui Z, Dou H, Yang X, Zhou T (2021) Hybrid GA-SVR: an effective way to predict short-term traffic flow. In: 21st International conference on algorithms and architectures for parallel processing (ICA3PP 2021), pp 1–11. https://doi.org/10.1007/978-3-030-95388-1_4

Tan G, Huang B, Cui Z, Dou H, Zheng S, Zhou T (2022) A noise-immune reinforcement learning method for early diagnosis of neuropsychiatric systemic lupus erythematosus. Math Biosci Eng 19(3):2219–2239. https://doi.org/10.3934/mbe.2022104CrossRefPubMed

Wang Z, Oates T (2015) Encoding time series as images for visual inspection and classification using tiled convolutional neural networks. In: Workshops at the twenty-ninth AAAI conference on artificial intelligence

Wang Y, Van Schuppen JH, Vrancken J (2013) Prediction of traffic flow at the boundary of a motorway network. IEEE Trans Intell Transp Syst 15(1):214–227. https://doi.org/10.1109/TITS.2013.2278192CrossRef

Woo S, Park J, Lee J-Y, Kweon IS (2018) Cbam: convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp 3–19

Xia D, Zhang M, Xiaobo Yan Yu, Bai YZ, Li Y, Li H (2021) A distributed WND-LSTM model on MapReduce for short-term traffic flow prediction. Neural Comput Appl 33(7):2393–2410. https://doi.org/10.1007/s00521-020-05076-2CrossRef

Xie Y, Zhang Y, Ye Z (2007) Short-term traffic volume forecasting using Kalman filter with discrete wavelet decomposition. Comput Aided Civ Infrastruct Eng 22(5):326–334. https://doi.org/10.1111/j.1467-8667.2007.00489.xCrossRef

Xu Y, Kong Q-J, Liu Y (2013) Short-term traffic volume prediction using classification and regression trees. In: 2013 IEEE intelligent vehicles symposium (IV). IEEE, pp 493–498 https://doi.org/10.1109/IVS.2013.6629516

Xu S, Chan HK, Zhang T (2019) Forecasting the demand of the aviation industry using hybrid time series SARIMA-SVR approach. Transp Res Part E Logist Transp Rev 122:169–180. https://doi.org/10.1016/j.tre.2018.12.005CrossRef

Yang H-F, Dillon TS, Chang E, Chen Y-PP (2018) Optimized configuration of exponential smoothing and extreme learning machine for traffic flow forecasting. IEEE Trans Ind Inform 15(1):23–34. https://doi.org/10.1109/TII.2018.2876907CrossRef

Yang S, Li H, Luo Y, Li J, Song Y, Zhou T (2022) Spatiotemporal adaptive fusion graph network for short-term traffic flow forecasting. Mathematics 10(9):1594. https://doi.org/10.3390/math10091594CrossRef

Yao R, Zhang W, Zhang L (2020) Hybrid methods for short-term traffic flow prediction based on ARIMA-GARCH model and wavelet neural network. J Transp Eng Part A Syst 146(8):04020086. https://doi.org/10.1061/JTEPBS.0000388CrossRef

Yuan Y, Quan T, Song Y, Guan J, Zhou T, Wu R (2022) Noise-immune extreme ensemble learning for early diagnosis of neuropsychiatric systemic lupus erythematosus. IEEE J Biomed Health Inform. https://doi.org/10.1109/JBHI.2022.3164937CrossRefPubMed

Yuanli G, Wenqi L, Xinyue X, Qin L, Shao Z, Zhang H (2019) An improved bayesian combination model for short-term traffic prediction with deep learning. IEEE Trans Intell Transp Syst 21(3):1332–1342. https://doi.org/10.1109/TITS.2019.2939290CrossRef

Zeng B, Li C (2018) Improved multi-variable grey forecasting model with a dynamic background-value coefficient and its application. Comput Ind Eng 118:278–290. https://doi.org/10.1016/j.cie.2018.02.042CrossRef

Zeng J, Zhang M, Lin S-B (2022) Fully corrective gradient boosting with squared hinge: fast learning rates and early stopping. Neural Netw 147:136–151. https://doi.org/10.1016/j.neunet.2021.12.016CrossRefPubMed

Zhang Y, Zhang Y, Haghani A (2014) A hybrid short-term traffic flow forecasting method based on spectral analysis and statistical volatility model. Transp Res Part C Emerg Technol 43:65–78. https://doi.org/10.1016/j.trc.2013.11.011CrossRef

Zheng H, Lin F, Feng X, Chen Y (2021) A hybrid deep learning model with attention-based Conv-LSTM networks for short-term traffic flow prediction. IEEE Trans Intell Transp Syst 22(11):6910–6920. https://doi.org/10.1109/TITS.2020.2997352CrossRef

Zhou T, Han G, Xuemiao X, Lin Z, Han C, Huang Y, Qin J (2017) \(\delta \)-agree adaboost stacked autoencoder for short-term traffic flow forecasting. Neurocomputing 247(4):31–38. https://doi.org/10.1016/j.neucom.2017.03.049

Zhou T, Jiang D, Lin Z, Han G, Xuemiao X, Qin J (2019) Hybrid dual Kalman filtering model for short-term traffic flow forecasting. IET Intell Transp Syst 13(6):1023–1032. https://doi.org/10.1049/iet-its.2018.5385CrossRef

Zhou T, Dou H, Tan J, Song Y, Wang F, Wang J (2022) Small dataset solves big problem: an outlier-insensitive binary classifier for inhibitory potency prediction. Knowl Based Syst. https://doi.org/10.1016/j.knosys.2022.109242

Zhu JZ, Cao JX, Zhu Y (2014) Traffic volume forecasting based on radial basis function neural network with the consideration of traffic flows at the adjacent intersections. Transp Res Part C Emerg Technol 47:139–154. https://doi.org/10.1016/j.trc.2014.06.011CrossRef

Titel: A noise-immune and attention-based multi-modal framework for short-term traffic flow forecasting
verfasst von: Guanru Tan
Teng Zhou
Boyu Huang
Haowen Dou
Youyi Song
Zhizhe Lin
Publikationsdatum: 05.09.2023
Verlag: Springer Berlin Heidelberg
Erschienen in: Soft Computing / Ausgabe 6/2024
Print ISSN: 1432-7643
Elektronische ISSN: 1433-7479
DOI: https://doi.org/10.1007/s00500-023-09173-x

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 6/2024

A novel Gaussian process regression-based stock index interval forecasting model integrating optimal variables screening with bidirectional long short-term memory

Peak stress and peak strain evaluation of concrete columns confined with lateral ties under axial compression by artificial neural networks

A PSO-optimized novel PID neural network model for temperature control of jacketed CSTR: design, simulation, and a comparative study

Dynamic link utilization empowered by reinforcement learning for adaptive storage allocation in MANET

DMPPT control of photovoltaic systems under partial shading conditions based on optimized neural networks

A many objective chimp optimization algorithm to de-cluster earthquake catalogs in space time domain

Premium Partner