Skip to main content
Top
Published in: Soft Computing 6/2021

03-01-2021 | Methodologies and Application

Sentiment analysis of stock markets using a novel dimensional valence–arousal approach

Published in: Soft Computing | Issue 6/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Sentiment analysis has been used in many studies to predict stock market trends. Current sentimental analysis approaches focus only on the upward and downward movement of the price, which is not sufficient for more precise prediction of stock sentiments. Previous studies have focused on the trend (valence) regarding stocks because it represents the upward and downward trend of a stock. However, investors should be attention on trading (arousal) because the stock price increases or decreases even quickly or slowly; they may not to do trade. Therefore, this paper applies the concept of dimensional valence–arousal to define sentiments which intensities of trading and trends of the stock market for data annotation. The paper proposes a deep learning prediction model to predict the intensities of stock dimensional valence–arousal (SDVA), called the hierarchical title–keyword-based attentional hybrid network (HAHTKN). The paper modifies the hierarchical attention network (HAN) to our proposed HAHTKN model, comprising (1) a title encoder, (2) a keyword encoder, (3) a title–keyword encoder, (4) word-level encoder, (5) a sentence-level encoder and (6) stock DVA prediction layer. The experimental results show that the proposed HAHTKN prediction model for the SDVA task outperformed other baseline machine learning models and HAN-based models.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Footnotes
1
Chinese Knowledge and Information Processing (CKIP) (https://​ckip.​iis.​sinica.​edu.​tw/​).
 
Literature
go back to reference Abdi A, Shamsuddin SM, Hasan S, Piran J (2019) Deep learning-based sentiment classification of evaluative text based on multi-feature fusion. Inf Process Manag 56(4):1245–1259 Abdi A, Shamsuddin SM, Hasan S, Piran J (2019) Deep learning-based sentiment classification of evaluative text based on multi-feature fusion. Inf Process Manag 56(4):1245–1259
go back to reference Abreu J, Fred L, Macêdo D, Zanchettin C (2019) Hierarchical attentional hybrid neural networks for document classification. Proc ICANN 2019:96–402 Abreu J, Fred L, Macêdo D, Zanchettin C (2019) Hierarchical attentional hybrid neural networks for document classification. Proc ICANN 2019:96–402
go back to reference Agarwal S, Kumar S, Goel U (2019) Stock market response to information diffusion through internet sources: a literature review. Int J Inf Manag 45:118–131 Agarwal S, Kumar S, Goel U (2019) Stock market response to information diffusion through internet sources: a literature review. Int J Inf Manag 45:118–131
go back to reference Basak S, Kar S, Saha S, Khaidem L, Dey SR (2019) Predicting the direction of stock market prices using tree-based classifiers. N Am J Econ Finance 47:52–567 Basak S, Kar S, Saha S, Khaidem L, Dey SR (2019) Predicting the direction of stock market prices using tree-based classifiers. N Am J Econ Finance 47:52–567
go back to reference Batra R, Daudpota SM (2018) Integrating StockTwits with sentiment analysis for better prediction of stock price movement. Proc iCoMET 2018:1–5 Batra R, Daudpota SM (2018) Integrating StockTwits with sentiment analysis for better prediction of stock price movement. Proc iCoMET 2018:1–5
go back to reference Carnicero J, Rojas D (2019) Chapter 8—Healthcare decision-making support based on the application of big data to electronic medical records: a knowledge management cycle. In: Kobeissy F, Alawieh A, Zaraket FA, Wang K (eds) Leveraging biomedical and healthcare data. Academic Press, New York, pp 121–131 Carnicero J, Rojas D (2019) Chapter 8—Healthcare decision-making support based on the application of big data to electronic medical records: a knowledge management cycle. In: Kobeissy F, Alawieh A, Zaraket FA, Wang K (eds) Leveraging biomedical and healthcare data. Academic Press, New York, pp 121–131
go back to reference Chen YJ, Chen YM, Lu CL (2016a) Enhancement of stock market forecasting using an improved fundamental analysis-based approach. Soft Comput 21(13):3735–3757 Chen YJ, Chen YM, Lu CL (2016a) Enhancement of stock market forecasting using an improved fundamental analysis-based approach. Soft Comput 21(13):3735–3757
go back to reference Chen W, Cai Y, Lai K, Xie H (2016b) A topic-based sentiment analysis model to predict stock market price movement using Weibo mood. Web Intell 14(4):287–300 Chen W, Cai Y, Lai K, Xie H (2016b) A topic-based sentiment analysis model to predict stock market price movement using Weibo mood. Web Intell 14(4):287–300
go back to reference Chiang WC, Enke D, Wu T, Wang R (2016) An adaptive stock index trading decision support system. Expert Syst Appl 59:195–207 Chiang WC, Enke D, Wu T, Wang R (2016) An adaptive stock index trading decision support system. Expert Syst Appl 59:195–207
go back to reference Ding X, Zhang Y, Liu T, Duan J (2016) Knowledge-driven event embedding for stock prediction. Proc COLING 2016:2133–2142 Ding X, Zhang Y, Liu T, Duan J (2016) Knowledge-driven event embedding for stock prediction. Proc COLING 2016:2133–2142
go back to reference Dong YH, Chen H, Qian WN, Zhou AY (2015) Micro-blog social moods and Chinese stock market: the influence of emotional valence and arousal on Shanghai composite index volume. Int J Embed Syst 7(2):148–155 Dong YH, Chen H, Qian WN, Zhou AY (2015) Micro-blog social moods and Chinese stock market: the influence of emotional valence and arousal on Shanghai composite index volume. Int J Embed Syst 7(2):148–155
go back to reference Feuerriegel S, Gordon J (2018) Long-term stock index forecasting based on text mining of regulatory disclosures. Decis Support Syst 112:88–97 Feuerriegel S, Gordon J (2018) Long-term stock index forecasting based on text mining of regulatory disclosures. Decis Support Syst 112:88–97
go back to reference Gálvez RH, Gravano A (2017) Assessing the usefulness of online message board mining in automatic stock prediction systems. J Comput Sci 19:43–56 Gálvez RH, Gravano A (2017) Assessing the usefulness of online message board mining in automatic stock prediction systems. J Comput Sci 19:43–56
go back to reference Gao S, Young MT, Qiu JX, Yoon HJ, Christian JB, Fearn PA, Tourassi GD, Ramanthan A (2018) Hierarchical attention networks for information extraction from cancer pathology reports. J Am Med Inf Assoc 25(3):321–330 Gao S, Young MT, Qiu JX, Yoon HJ, Christian JB, Fearn PA, Tourassi GD, Ramanthan A (2018) Hierarchical attention networks for information extraction from cancer pathology reports. J Am Med Inf Assoc 25(3):321–330
go back to reference Gaurav D, Tiwari SM, Goyal A, Gandhi N (2020) Machine intelligence-based algorithms for spam filtering on document labeling. Soft Comput 24:9625–9638 Gaurav D, Tiwari SM, Goyal A, Gandhi N (2020) Machine intelligence-based algorithms for spam filtering on document labeling. Soft Comput 24:9625–9638
go back to reference Hasan M, Rundensteiner E, Agu E (2019) Automatic emotion detection in text streams by analyzing Twitter data. Int J Data Sci Anal 7(1):35–51 Hasan M, Rundensteiner E, Agu E (2019) Automatic emotion detection in text streams by analyzing Twitter data. Int J Data Sci Anal 7(1):35–51
go back to reference Henrique BM, Sobreiro VA, Kimura H (2018) Stock price prediction using support vector regression on daily and up to the minute prices. J Finance Data Sci 4(3):183–201 Henrique BM, Sobreiro VA, Kimura H (2018) Stock price prediction using support vector regression on daily and up to the minute prices. J Finance Data Sci 4(3):183–201
go back to reference Ikonomakis EK, Kotsiantis S, Tampakas V (2005) Text classification using machine learning techniques. WSEAS Trans Comput 4(8):966–974 Ikonomakis EK, Kotsiantis S, Tampakas V (2005) Text classification using machine learning techniques. WSEAS Trans Comput 4(8):966–974
go back to reference Ingle V, Deshmukh S (2017) Predictive mining for stock market based on live news TF-IDF features. Int J Auton Comput 2(4):341–365 Ingle V, Deshmukh S (2017) Predictive mining for stock market based on live news TF-IDF features. Int J Auton Comput 2(4):341–365
go back to reference Islam MR, Al-Shaikhli IFT, Abdulkadir A (2018) A scientific review of soft-computing techniques and methods for stock market prediction. Int J Eng Technol 7(2.5):27–31 Islam MR, Al-Shaikhli IFT, Abdulkadir A (2018) A scientific review of soft-computing techniques and methods for stock market prediction. Int J Eng Technol 7(2.5):27–31
go back to reference Jaeger SR, Roigard CM, Jin D, Vidal L, Ares G (2019) Valence, arousal and sentiment meanings of 33 facial emoji: insights for the use of emoji in consumer research. Food Res Int 119:895–907 Jaeger SR, Roigard CM, Jin D, Vidal L, Ares G (2019) Valence, arousal and sentiment meanings of 33 facial emoji: insights for the use of emoji in consumer research. Food Res Int 119:895–907
go back to reference Khan W, Malik U, Ghazanfar MA, Azam MA, Alyoubi KH, Alfakeeh AS (2019) Predicting stock market trends using machine learning algorithms via public sentiment and political situation analysis. Soft Comput 24:11019–11043 Khan W, Malik U, Ghazanfar MA, Azam MA, Alyoubi KH, Alfakeeh AS (2019) Predicting stock market trends using machine learning algorithms via public sentiment and political situation analysis. Soft Comput 24:11019–11043
go back to reference Kim M, Park EL, Cho S (2018) Stock price prediction through sentiment analysis of corporate disclosures using distributed representation. Intell Data Anal 22(6):1395–1413 Kim M, Park EL, Cho S (2018) Stock price prediction through sentiment analysis of corporate disclosures using distributed representation. Intell Data Anal 22(6):1395–1413
go back to reference Li B, Chan KCC, Ou C, Ruifeng S (2017) Discovering public sentiment in social media for predicting stock movement of publicly listed companies. Inf Syst 69:81–92 Li B, Chan KCC, Ou C, Ruifeng S (2017) Discovering public sentiment in social media for predicting stock movement of publicly listed companies. Inf Syst 69:81–92
go back to reference Liang W, Xie H, Rao Y, Lau RYK, Wang FL (2018) Universal affective model for readers’ emotion classification over short texts. Expert Syst Appl 114:322–333 Liang W, Xie H, Rao Y, Lau RYK, Wang FL (2018) Universal affective model for readers’ emotion classification over short texts. Expert Syst Appl 114:322–333
go back to reference Maqsood H, Mehmood I, Maqsood M et al (2019) A local and global event sentiment based efficient stock exchange forecasting using deep learning. Int J Inf Manag 50:432–451 Maqsood H, Mehmood I, Maqsood M et al (2019) A local and global event sentiment based efficient stock exchange forecasting using deep learning. Int J Inf Manag 50:432–451
go back to reference Nti IK, Adekoya AF, Weyori BA (2020) A systematic review of fundamental and technical analysis of stock market predictions. Artif Intell Rev 53:3007–3057 Nti IK, Adekoya AF, Weyori BA (2020) A systematic review of fundamental and technical analysis of stock market predictions. Artif Intell Rev 53:3007–3057
go back to reference Oliveira N, Cortez P, Areal N (2017) The impact of microblogging data for stock market prediction: using Twitter to predict returns, volatility, trading volume and survey sentiment indices. Expert Syst Appl 73:125–144 Oliveira N, Cortez P, Areal N (2017) The impact of microblogging data for stock market prediction: using Twitter to predict returns, volatility, trading volume and survey sentiment indices. Expert Syst Appl 73:125–144
go back to reference Pagolu VS, Challa RKN, Panda G, Majhi B (2016) Sentiment analysis of Twitter data for predicting stock market movements. In: Proceedings of the 2016 international conference on signal processing, communication, power and embedded system (SCOPES), pp 1345–1350 Pagolu VS, Challa RKN, Panda G, Majhi B (2016) Sentiment analysis of Twitter data for predicting stock market movements. In: Proceedings of the 2016 international conference on signal processing, communication, power and embedded system (SCOPES), pp 1345–1350
go back to reference Patel J, Shah S, Thakkar P, Kotecha K (2015) Predicting stock and stock price index movement using trend deterministic data preparation and machine learning techniques. Expert Syst Appl 42:259–268 Patel J, Shah S, Thakkar P, Kotecha K (2015) Predicting stock and stock price index movement using trend deterministic data preparation and machine learning techniques. Expert Syst Appl 42:259–268
go back to reference Ranco G, Bordino I, Bormetti G, Caldarelli G, Lillo F, Treccani MT (2016) Coupling news sentiment with web browsing data improves prediction of intra-day price dynamics. PLoS ONE 11:e0146576 Ranco G, Bordino I, Bormetti G, Caldarelli G, Lillo F, Treccani MT (2016) Coupling news sentiment with web browsing data improves prediction of intra-day price dynamics. PLoS ONE 11:e0146576
go back to reference Russell JA (1980) A circumplex model of affect. J Pers Soc Psychol 36(6):1161–1178 Russell JA (1980) A circumplex model of affect. J Pers Soc Psychol 36(6):1161–1178
go back to reference Saumya S, Singh JP, Kumar P (2016) Predicting stock movements using social network. Proc I3E 2016:567–572 Saumya S, Singh JP, Kumar P (2016) Predicting stock movements using social network. Proc I3E 2016:567–572
go back to reference Shah D, Isah H, Zulkernine F (2018) Predicting the effects of news sentiments on the stock market. In: Proceedings of 2018 IEEE international conference on big data (IEEE big data), pp 10–13 Shah D, Isah H, Zulkernine F (2018) Predicting the effects of news sentiments on the stock market. In: Proceedings of 2018 IEEE international conference on big data (IEEE big data), pp 10–13
go back to reference Shang C, You F (2019) Data analytics and machine learning for smart process manufacturing: recent advances and perspectives in the big data era. Engineering 5:1010–1016 Shang C, You F (2019) Data analytics and machine learning for smart process manufacturing: recent advances and perspectives in the big data era. Engineering 5:1010–1016
go back to reference Shi L, Teng Z, Wang L, Zhang Y, Binder A (2018) DeepClue: visual interpretation of text-based deep stock prediction. IEEE Trans Knowl Data Eng 31(6):1094–1108 Shi L, Teng Z, Wang L, Zhang Y, Binder A (2018) DeepClue: visual interpretation of text-based deep stock prediction. IEEE Trans Knowl Data Eng 31(6):1094–1108
go back to reference Song S, Huang H, Ruan T (2019) Abstractive text summarization using LSTM-CNN based deep learning. Multimed Tools Appl 78(1):857–875 Song S, Huang H, Ruan T (2019) Abstractive text summarization using LSTM-CNN based deep learning. Multimed Tools Appl 78(1):857–875
go back to reference Stefan F, Helmut P (2014) News-based trading strategies. Decis Support Syst 90:65–74 Stefan F, Helmut P (2014) News-based trading strategies. Decis Support Syst 90:65–74
go back to reference Tsaptsinos A (2017) Lyrics-based music genre classification using a hierarchical attention network. Proc ISMIR 2017:694–701 Tsaptsinos A (2017) Lyrics-based music genre classification using a hierarchical attention network. Proc ISMIR 2017:694–701
go back to reference Vanstone BJ, Gepp A, Harris G (2019) Do news and sentiment play a role in stock price prediction? Appl Intell 49(11):3815–3820 Vanstone BJ, Gepp A, Harris G (2019) Do news and sentiment play a role in stock price prediction? Appl Intell 49(11):3815–3820
go back to reference Wang Y (2017) Stock market forecasting with financial micro-blog based on sentiment and time series analysis. J Shanghai Jiaotong Univ (Sci) 22(2):173–179 Wang Y (2017) Stock market forecasting with financial micro-blog based on sentiment and time series analysis. J Shanghai Jiaotong Univ (Sci) 22(2):173–179
go back to reference Wang F, Zhang Y, Rao Q, Li K, Zhang H (2016) Exploring mutual information-based sentimental analysis with kernel-based extreme learning machine for stock prediction. Soft Comput 21(12):3193–3205 Wang F, Zhang Y, Rao Q, Li K, Zhang H (2016) Exploring mutual information-based sentimental analysis with kernel-based extreme learning machine for stock prediction. Soft Comput 21(12):3193–3205
go back to reference Warriner AB, Kuperman V, Brysbaert M (2013) Norms of valence, arousal, and dominance for 13,915 English lemmas. Behav Res Methods 45(4):1191–1207 Warriner AB, Kuperman V, Brysbaert M (2013) Norms of valence, arousal, and dominance for 13,915 English lemmas. Behav Res Methods 45(4):1191–1207
go back to reference Wu J, Yu L, Chang P (2014) An intelligent stock trading system using comprehensive features. Appl Soft Comput 23:39–50 Wu J, Yu L, Chang P (2014) An intelligent stock trading system using comprehensive features. Appl Soft Comput 23:39–50
go back to reference Wu GG, Hou TC, Lin J (2019a) Can economic news predict Taiwan stock market returns. Asia Pac Manag Rev 24(19):54–59 Wu GG, Hou TC, Lin J (2019a) Can economic news predict Taiwan stock market returns. Asia Pac Manag Rev 24(19):54–59
go back to reference Wu J, Yang C, Liu K, Huang M (2019b) A deep learning model for dimensional valence–arousal intensity prediction in stock market. Proc IEEE iCAST 2019:1–6 Wu J, Yang C, Liu K, Huang M (2019b) A deep learning model for dimensional valence–arousal intensity prediction in stock market. Proc IEEE iCAST 2019:1–6
go back to reference Yadav R, Kumar AV, Kumar A (2019) News-based supervised sentiment analysis for prediction of futures buying behavior. IIMB Manag Rev 31(2):157–166 Yadav R, Kumar AV, Kumar A (2019) News-based supervised sentiment analysis for prediction of futures buying behavior. IIMB Manag Rev 31(2):157–166
go back to reference Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies (NAACL HLT), pp 1480–1489 Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. In: Proceedings of the 2016 conference of the North American chapter of the association for computational linguistics: human language technologies (NAACL HLT), pp 1480–1489
go back to reference Ying H, Zhuang F, Zhang F et al (2018) Sequential recommender system based on hierarchical attention network. In: Proceedings of the IJCAI-ECAI-18, pp 3926–3932 Ying H, Zhuang F, Zhang F et al (2018) Sequential recommender system based on hierarchical attention network. In: Proceedings of the IJCAI-ECAI-18, pp 3926–3932
go back to reference Zhang J, Cui S, Xu Y, Li Q, Li Y (2018a) A novel data-driven stock price trend prediction system. Expert Syst Appl 97:60–69 Zhang J, Cui S, Xu Y, Li Q, Li Y (2018a) A novel data-driven stock price trend prediction system. Expert Syst Appl 97:60–69
go back to reference Zhang X, Zhang Y, Wang S, Yao T, Fang B, Yu PS (2018b) Improving stock market prediction via heterogeneous information fusion. Knowl Based Syst 143:236–247 Zhang X, Zhang Y, Wang S, Yao T, Fang B, Yu PS (2018b) Improving stock market prediction via heterogeneous information fusion. Knowl Based Syst 143:236–247
Metadata
Title
Sentiment analysis of stock markets using a novel dimensional valence–arousal approach
Publication date
03-01-2021
Published in
Soft Computing / Issue 6/2021
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI
https://doi.org/10.1007/s00500-020-05454-x

Other articles of this Issue 6/2021

Soft Computing 6/2021 Go to the issue

Premium Partner