nach oben

Knowledge and Information Systems

Erschienen in:

17.12.2018 | Regular Paper

Enhancing stock market prediction with extended coupled hidden Markov model over multi-sourced data

verfasst von: Xi Zhang, Yixuan Li, Senzhang Wang, Binxing Fang, Philip S. Yu

Erschienen in: Knowledge and Information Systems | Ausgabe 2/2019

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

Traditional stock market prediction methods commonly only utilize the historical trading data, ignoring the fact that stock market fluctuations can be impacted by various other information sources such as stock-related events. Although some recent works propose event-driven prediction approaches by considering the event data, how to leverage the joint impacts of multiple data sources still remains an open research problem. In this work, we study how to explore multiple data sources to improve the performance of the stock prediction. We introduce an extended coupled hidden Markov model incorporating the news events with the historical trading data. To address the data sparsity issue of news events for each single stock, we further study the fluctuation correlations between the stocks and incorporate the correlations into the model to facilitate the prediction task. Evaluations on China A-share market data in 2016 show the superior performance of our model against previous methods.

Vorheriger Artikel Learning concept embeddings for dataless classification via efficient bag-of-concepts densification

Nächster Artikel A knowledge-based approach to multiplayer games in peer-to-peer networks

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

https://github.com/fxsjy/jieba.

http://dwz.cn/stockdata.

http://www.wind.com.cn/.

Abdelaziz AH, Zeiler S, Kolossa D (2015) Learning dynamic stream weights for coupled-hmm-based audio–visual speech recognition. IEEE/ACM TASLP 23(5):863–876

Abushariah MA, Ainon RN, Zainuddin R, Elshafei M, Khalifa OO (2010) Natural speaker-independent Arabic speech recognition system based on hidden Markov models using sphinx tools. In: 2010 International conference on computer and communication engineering (ICCCE), pp 1–6

Akita R, Yoshihara A, Matsubara T, Uehara K (2016) Deep learning for stock prediction using numerical and textual information. In: IEEE/ACIS 15th international conference on computer and information science (ICIS), pp 1–6

Alsmadi IM, Karabatis G, Aleroud A (2016) Information fusion for cyber-security analytics, vol 691. Springer, Cham

Chang CY, Zhang Y, Teng Z, Bozanic Z, Ke B (2016) Measuring the information content of financial news. In: Proceedings of the 26th international conference on computational linguistics (COLING’16), pp 3216–3225

Chen K, Zhou Y, Dai F (2015) A lstm-based method for stock returns prediction: a case study of china stock market. In: 2015 IEEE international conference on big data, pp 2823–2824

Cheng P, Qiu Z, Ran B (2006) Particle filter based traffic state estimation using cell phone network data. IEEE Intell Transp Syst Conf 2006:1047–1052

Chiang WC, Enke D, Wu T, Wang R (2016) An adaptive stock index trading decision support system. Expert Syst Appl 59:195–207CrossRef

Chong E, Han C, Park FC (2017) Deep learning networks for stock market analysis and prediction: methodology, data representations, and case studies. Expert Syst Appl 83:187–205CrossRef

10.

Cutler DM, Poterba JM, Summers LH (1989) What moves stock prices. J Portf Manag 15:4–12CrossRef

11.

Das SR, Chen MY (2007) Yahoo! for amazon: sentiment extraction from small talk on the web. Manag Sci 53(9):1375–1388CrossRef

12.

Ding X, Zhang Y, Liu T, Duan J (2014) Using structured events to predict stock price movement: an empirical investigation. In: EMNLP, pp 1415–1425

13.

Ding X, Zhang Y, Liu T, Duan J (2015) Deep learning for event-driven stock prediction. In: IJCAI, pp 2327–2333

14.

Elmezain M, Al-Hamadi A, Appenrodt J, Michaelis B (2009) A hidden Markov model-based isolated and meaningful hand gesture recognition. Int J Electr Comput Syst Eng 3(3):156–163

15.

Fama EF (1965) The behavior of stock-market prices. J Bus 38(1):34–105CrossRef

16.

Feldman R, Rosenfeld B, Bar-Haim R, Fresko M (2011) The stock sonar-sentiment analysis of stocks based on a hybrid approach. In: Proceedings of the twenty-third innovative applications of artificial intelligence conference, pp 1642–1647

17.

Goumatianos N, Christou IT, Lindgren P, Prasad R (2017) An algorithmic framework for frequent intraday pattern recognition and exploitation in forex market. Knowl Inf Syst 53(3):767–804CrossRef

18.

Gupta A, Dhingra B (2012) Stock market prediction using hidden Markov models. In: 2012 IEEE students conference on engineering and systems (SCES), pp 1–4

19.

Hai T, Shirai K, Velcin J (2015) Sentiment analysis on social media for stock movement prediction. Expert Syst Appl 42(24):9603–9611CrossRef

20.

Hassan MR, Nath B (2005) Stock market forecasting using hidden markov model: a new approach. In: Proceedings. 5th international conference on intelligent systems design and applications, pp 192–196

21.

Hogenboom F, Frasincar F, Kaymak U, De Jong F (2011) An overview of event extraction from text. In: Workshop on detection, representation, and exploitation of events in the semantic web (DeRiVE 2011) at tenth international semantic web conference (ISWC 2011), vol 779, pp 48–57

22.

Jia H (2016) Investigation into the effectiveness of long short term memory networks for stock price prediction. arXiv preprint arXiv:1603.07893

23.

Kogan S, Levin D, Routledge BR, Sagi JS, Smith NA (2009) Predicting risk from financial reports with regression. In: Proceedings of human language technologies: the 2009 annual conference of the North American Chapter of the Association for Computational Linguistics, pp 272–280

24.

Kumar P, Gauba H, Roy PP, Dogra DP (2017) Coupled hmm-based multi-sensor data fusion for sign language recognition. Pattern Recognit Lett 86:1–8CrossRef

25.

Lavrenko V, Schmill M, Lawrie D, Ogilvie P, Jensen D, Allan J (2000) Mining of concurrent text and time series. In: KDD-2000 workshop on text mining, pp 37–44

26.

Li Q, Jiang L, Li P, Chen H (2015) Tensor-based learning for predicting stock movements. In: AAAI, pp 1784–1790

27.

Li X, Xie H, Chen L, Wang J, Deng X (2014) News impact on stock price return via sentiment analysis. Knowl Based Syst 69:14–23CrossRef

28.

Luss R, D’Aspremont A (2015) Predicting abnormal returns from news using text classification. Quant Finance 15(6):999–1012MathSciNetCrossRefMATH

29.

Mikolov T, Sutskever I, Chen K, Corrado GS, Dean J (2013) Distributed representations of words and phrases and their compositionality. In: Advances in neural information processing systems, pp 3111–3119

30.

Nefian AV (2007) Coupled hidden markov model for audiovisual speech recognition. US Patent 7,165,029

31.

Nguyen T, Phung D, Adams B, Venkatesh S (2013) Event extraction using behaviors of sentiment signals and burst structure in social media. Knowl Inf Syst pp 1–26

32.

Nguyen TH, Shirai K (2015) Topic modeling based sentiment analysis on social media for stock market prediction. In: Proceedings of the 53rd annual meeting of the association for computational linguistics (ACL-15), pp 1354–1364

33.

Nickel C, Busch C, Rangarajan S, Möbius M (2011) Using hidden markov models for accelerometer-based biometric gait recognition. In: IEEE 7th international colloquium on signal processing and its applications (CSPA), pp 58–63

34.

Oliveira N, Cortez P, Areal N (2017) The impact of microblogging data for stock market prediction: using Twitter to predict returns, volatility, trading volume and survey sentiment indices. Expert Syst Appl 73:125–144CrossRef

35.

Park SH, Lee JH, Song JW, Park TS (2009) Forecasting change directions for financial time series using hidden Markov model. Rough sets knowledge technology, pp 184–191

36.

Patra JC, Thanh NC, Meher PK (2009) Computationally efficient flann-based intelligent stock price prediction system. In: IEEE international joint conference on neural networks (IJCNN), pp 2431–2438

37.

Peng Y, Jiang H (2015) Leverage financial news to predict stock price movements using word embeddings and deep neural networks. arXiv preprint arXiv:1506.07220

38.

Poh KL (2000) An intelligent decision support system for investment analysis. Knowl Inf Syst 2(3):340–358CrossRefMATH

39.

Rabiner LR (1989) A tutorial on hidden markov models and selected applications in speech recognition. Proc IEEE 77(2):257–286CrossRef

40.

Roman J, Jameel A (1996) Backpropagation and recurrent neural networks in financial analysis of multiple stock market returns. In: Proceedings of the IEEE twenty-ninth Hawaii international conference on system sciences, vol 2, pp 454–460

41.

Saad EW, Prokhorov DV, Wunsch DC (1998) Comparative study of stock trend prediction using time delay, recurrent and probabilistic neural networks. IEEE Trans Neural Netw 9(6):1456–1470CrossRef

42.

Schumaker RP, Chen H (2009a) A quantitative stock prediction system based on financial news. Inf Process Manag 45(5):571–583CrossRef

43.

Schumaker RP, Chen H (2009b) Textual analysis of stock market prediction using breaking financial news: the azfin text system. ACM Trans Inf Syst (TOIS) 27(2):12CrossRef

44.

Si J, Mukherjee A, Liu B, Li Q, Li H, Deng X (2013) Exploiting topic based twitter sentiment for stock prediction. In: 51st annual meeting of the association for computational linguistics (ACL 2013), pp 24–29

45.

Si J, Mukherjee A, Liu B, Pan SJ, Li Q, Li H (2014) Exploiting social relations and sentiment for stock prediction. In: The conference on empirical methods on natural language processing (EMNLP-14), vol 14, pp 1139–1145

46.

Tetlock PC (2007) Giving content to investor sentiment: the role of media in the stock market. J Finance 62(3):1139–1168CrossRef

47.

Tetlock PC, Saar-Tsechansky M, Macskassy S (2008) More than words: quantifying language to measure firms’ fundamentals. J Finance 63(3):1437–1467CrossRef

48.

Wang S, Hu X, Yu P, Li Z (2014) Mmrate: inferring multi-aspect diffusion networks with multi-pattern cascades. In: Proceedings of the ACM SIGKDD international conference on knowledge discovery and data mining, pp 1246–1255

49.

Wang S, Li F, Stenneth L, Philip SY (2016) Enhancing traffic congestion estimation with social media by coupled hidden markov model. In: Joint European conference on machine learning and knowledge discovery in databases. Springer, pp 247–264

50.

Wang WY, Hua Z (2014) A semiparametric gaussian copula regression model for predicting financial risks from earnings calls. In: Proceedings of the 52nd annual meeting of the association for computational linguistics (ACL 2014), pp 1155–1165

51.

Weng B, Ahmed MA, Megahed FM (2017) Stock market one-day ahead movement prediction using disparate data sources. Expert Syst Appl 79:153–163CrossRef

52.

Xie B, Passonneau RJ, Wu L, Creamer GG (2013) Semantic frames to predict stock price movement. In: Proceedings of the 51st annual meeting of the association for computational linguistics (ACL 2013), pp 873–883

53.

Yoshihara A, Fujikawa K, Seki K, Uehara K (2014) Predicting stock market trends by recurrent deep neural networks. In: Pacific rim international conference on artificial intelligence. Springer, pp 759–769

54.

Zhang J, Shi X, Kong X, Shuai HH, Yu PS (2014) Discovering organizational correlations from twitter. In: IEEE international conference on data mining workshop, pp 243–250

55.

Zhang X, Fuehres H, Gloor PA (2011) Predicting stock market indicators through twitter? I hope it is not as bad as I fear. Proc Soc Behav Sci 26:55–62CrossRef

56.

Zhang X, Yao Y, Ji Y, Fang B (2016) Effective and fast near duplicate detection via signature-based compression metrics. Math Prob Eng 8–13:1–12

57.

Zhang X, Qu S, Huang J, Fang B, Yu PS (2018) Stock market prediction via multi-source multiple instance learning. IEEE Access 6:50720–50728CrossRef

58.

Zhang X, Shi J, Wang D, Fang B (2018) Exploiting investors social network for stock prediction in China’s market. J Comput Sci 28:294–303CrossRef

59.

Zhang X, Zhang Y, Wang S, Yao Y, Fang B, Yu PS (2018) Improving stock market prediction via heterogeneous information fusion. Knowl Based Syst 143:236–247CrossRef

60.

Zhang Y (2004) Prediction of financial time series with hidden markov models. Master’s thesis, School of Computing Science, Simon Fraser University

61.

Zhu W, Lan C, Xing J, Zeng W, Li Y, Shen L, Xie X (2016) Co-occurrence feature learning for skeleton based action recognition using regularized deep LSTM networks. In: Proceedings of the thirtieth AAAI conference on artificial intelligence (AAAI’16), pp 3697–3703

Titel: Enhancing stock market prediction with extended coupled hidden Markov model over multi-sourced data
verfasst von: Xi Zhang
Yixuan Li
Senzhang Wang
Binxing Fang
Philip S. Yu
Publikationsdatum: 17.12.2018
Verlag: Springer London
Erschienen in: Knowledge and Information Systems / Ausgabe 2/2019
Print ISSN: 0219-1377
Elektronische ISSN: 0219-3116
DOI: https://doi.org/10.1007/s10115-018-1315-6

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Weitere Artikel der Ausgabe 2/2019

A new local density and relative distance based spectrum clustering

Mentor-spotting: recommending expert mentors to mentees for live trouble-shooting in Codementor

Leveraging external information in topic modelling

Investigations into Data Ecosystems: a systematic mapping study

GOAL: a clustering-based method for the group optimal location problem

A knowledge-based approach to multiplayer games in peer-to-peer networks