Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Detecting Changing Financial Relationships: A Self Organising Map Approach Read chapter Read first chapter

2015 | OriginalPaper | Chapter

A Proposed Framework for Evaluating the Effectiveness of Financial News Sentiment Scoring Datasets

Authors : Islam Qudah, Fethi A. Rabhi, Maurice Peat

Published in: Enterprise Applications and Services in the Finance Industry

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

The impact of financial news on financial markets has been studied extensively. A number of news sentiment scoring techniques are being widely used in research and industry. However, results from sentiment studies are hard to interpret contextual and sentiment related parameters change. Sometimes, the conditions which lead to the results are not fully documented and the results are not repeatable. Based on service-oriented computing principles, this paper proposes a framework that automates the process of incorporating different contextual parameters when running news sentiment impact studies. The framework also preserves the set of parameters/dataset and conditions for the end user to enable them to reproduce their results. This is demonstrated using a case study that shows how end users can flexibly select different contextual and sentiment related parameters and conduct news impact studies on daily stock prices.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Evaluation of News-Based Trading Strategies
next chapter Finding Evidence of Irrational Exuberance in the Oil Market
Literature
1.
Healy, A.D., Lo, A.W.: Managing real-time risks and returns: the thomson reuters newsscope event indices. In: Professor Hand, D.J., Professor of Statistics, Imperial College, London; Chief Scientific Advisor, Winton Capital Management; and President, Royal Statistical Society, 73
2.
Moniz, A., Brar, G., Davis, C.: Have I got news for youMacQuarie Research Report (2009)
3.
Al Shaikh, M.M., Prendinger, H., Ishizuka, M.: An analytical approach to assess sentiment of text. In: 10th International Conference on Computer and Information Technology, 2007 ICCIT 2007, pp. 1–6 (2007)
4.
Antweiler, W., Frank, M.Z.: Is all that talk just noise? the information content of internet stock message boards. J. Finan. 59(3), 1259–1294 (2004)CrossRef
5.
Azar, P.D.: Sentiment analysis in financial news (Doctoral dissertation, Harvard University) (2009)
6.
Baker, M., Wurgler, J.: Investor sentiment and the cross section of stock returns. J. Finan. 61(4), 1645–1680 (2006)CrossRef
7.
Barber, B.M., Odean, T.: All that glitters: The effect of attention and news on the buying behavior of individual and institutional investors. Rev. Finan. Stud. 21(2), 785–818 (2008)CrossRef
8.
Beheshti, S., Venugopal, S., Ryu, S.H., Benatallah, B., Wang, W.: Big data and cross-document coreference resolution: Current state and future opportunities (2013). ArXiv Preprint arXiv:​1311.​3987
9.
Bollen, J., Mao, H.: Twitter mood as a stock market predictor. Computer 44(10), 0091–94 (2011)CrossRef
10.
11.
Cahan, R., Jussa, J., Luo, Y.: Breaking news: How to use news sentiment to pick stocks. Macquarie US Equity Research (2009)
12.
Cambria, E., Schuller, B., Xia, Y., Havasi, C.: New avenues in opinion mining and sentiment analysis ieeexplore.ieee.org. (2013)
13.
Cambria, E., Song, Y., Wang, H., Howard, N.: Semantic multi-dimensional scaling for open-domain sentiment analysis ieeexplore.ieee.org. (2013)
14.
Cambria, E., Xia, Y., Hussain, A.: Affective common sense knowledge acquisition for sentiment analysis lrec.elra.info. (2012)
15.
16.
Da, Z., Engelberg, J., Gao, P.: In search of attention. J. Finan. 66(5), 1461–1499 (2011)CrossRef
17.
Das, S.R., Chen, M.Y.: Yahoo! for amazon: Sentiment extraction from small talk on the web. Manage. Sci. 53(9), 1375–1388 (2007)CrossRef
18.
Dzielinski, M., Rieger, M.O., Talpsepp, T.: Volatility asymmetry, news, and private investors. The Handbook of News Analytics in Finance, pp. 255–270 (2011)
19.
Fang, L., Peress, J.: Media coverage and the Cross section of stock returns. J. Finan. 64(5), 2023–2052 (2009)CrossRef
20.
Hafez, P.: Detection of seasonality in newsflow. White Paper Available from RavenPack (2009)
21.
Hagenau, M., Korczak, A., Neumann, D.: Buy on bad news, sell on good news: How insider trading analysis can benefit from textual analysis of corporate disclosures. In: Workshop on Information Systems and Economics (WISE 2012), Orlando, Florida, USA (2012)
22.
Hirshleifer, D., Lim, S.S., Teoh, S.H.: Driven to distraction: Extraneous events and underreaction to earnings news. J. Finan. 64(5), 2289–2325 (2009)CrossRef
23.
24.
25.
Jasny, B.R., Chin, G., Chong, L., Vignieri, S.: Data replication & reproducibility. again, and again, and again…. introduction. Science 334(6060), 1225 (2011). (New York, N.Y.)CrossRef
26.
Jindal, N., Liu, B.: Identifying comparative sentences in text documents. In: Proceedings of the 29th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, pp. 244–251 (2006)
27.
Joachims, T.: Making large scale SVM learning practical. Universität Dortmund (1999)
28.
29.
Kothari, S., Li, X., Short, J.E.: The effect of disclosures by management, analysts, and business press on cost of capital, return volatility, and analyst forecasts: A study using content analysis. Account. Rev. 84(5), 1639–1670 (2009)CrossRef
30.
Leinweber, D.: Nerds on wall street. Math, Machines and Wired Markets (2009)
31.
32.
Liu, B.: Sentiment analysis and opinion mining. Synth. Lect. Hum. Lang. Technol. 5(1), 1–167 (2012)CrossRef
33.
Loughran, T., McDonald, B.: When is a liability not a liability? textual analysis, dictionaries, and 10 Ks. J. Finan. 66(1), 35–65 (2011)CrossRef
34.
Lugmayr, A.: Predicting the future of investor sentiment with social media in stock exchange investments: A basic framework for the DAX performance index. In: Handbook of social media management, pp. 565–589. Springer, Heidelberg (2013)
35.
Mitra, G., Mitra, L.: The handbook of news analytics in finance John Wiley & Sons. (2011)
36.
Narayanan, R., Liu, B., & Choudhary, A. (2009). Sentiment analysis of conditional sentences. Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing: Volume 1-vol. 1, pp. 180–189
37.
Nicholls, C., Song, F.: Comparison of feature selection methods for sentiment analysis. In: Advances in Artificial Intelligence, pp. 286–289. Springer, Berlin Heidelberg (2010)
38.
O’Keefe, T., Koprinska, I.: Feature selection and weighting methods in sentiment analysis cs.otago.ac.nz. (2009)
39.
Pang, B., Lee, L., Vaithyanathan, S.: Thumbs up?: Sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 Conference on Empirical Methods in Natural Language Processing-vol. 10, pp. 79–86 (2002)
40.
Pang, B., Lee, L.: A sentimental education: Sentiment analysis using subjectivity summarization based on minimum cuts. In: Proceedings of the 42nd Annual Meeting on (2004)
41.
Peng, R.D.: Reproducible research in computational science. Science 334(6060), 1226–1227 (2011). (New York, N.Y.)CrossRef
42.
Pink, G., Radford, W., Cannings, W., Naoum, A., Nothman, J., Tse, D., et al.: SYDNEY CMCRC at TAC 2013. In: Proceedings of the Text Analysis Conference (TAC2013) (2013)
43.
44.
Rabhi, F.A., Yao, L., Guabtni, A.: ADAGE: A framework for supporting user-driven ad-hoc data analysis processes. Computing 94(6), 489–519 (2012)CrossRef
45.
Rasolofo, Y., Savoy, J.: Term proximity scoring for keyword-based retrieval systems. In: Sebastiani, F. (ed.) ECIR 2003. LNCS, vol. 2633, pp. 207–218. Springer, Heidelberg (2003)CrossRef
46.
RavenPack. RavenPack news scores user guideRavenPack (2010)
47.
Robertson, C., Geva, S., Wolff, R.: What types of events provide the strongest evidence that the stock market is affected by company specific news? Proc. Fifth Australas. Conf. Data Min. Analystics 61, 145–153 (2006)
48.
Robertson, C.S., Rabhi, F.A., Peat, M.: A service-oriented approach towards real time financial news analysis. In: Consumer Information Systems (2011)
49.
Schneider, K.: On word frequency information and negative evidence in naive bayes text classification. In: Advances in Natural Language Processing, pp. 474–485. Springer (2004)
50.
Scott, J., Stumpp, M., Xu, P.: News, not trading volume, builds momentum. Finan. Anal. J. 46, 45–54 (2003)CrossRef
51.
52.
Siering, M.: “Boom” or “ruin”–does it make a difference? using text mining and sentiment analysis to support intraday investment decisions. In: 2012 45th Hawaii International Conference on System Science (HICSS), pp. 1050–1059 (2012)
53.
54.
55.
Taboada, M., Brooke, J., Tofiloski, M., Voll, K., Stede, M.: Lexicon-based methods for sentiment analysis. Computat. Linguist. 37(2), 267–307 (2011)CrossRef
56.
Tetlock, P.C.: Giving content to investor sentiment: The role of media in the stock market. J. Finan. 62(3), 1139–1168 (2007)CrossRef
57.
Tetlock, P.C., Saar Tsechansky, M., Macskassy, S.: More than words: Quantifying language to measure firms’ fundamentals. J. Finan. 63(3), 1437–1467 (2008)CrossRef
58.
59.
60.
Turney, P.D.: Thumbs up or thumbs down?: Semantic orientation applied to unsupervised classification of reviews. In: Proceedings of the 40th Annual Meeting on Association for Computational Linguistics, pp. 417–424 (2002)
61.
62.
63.
Wiebe, J.M., Bruce, R.F., O’Hara, T.P.: Development and use of a gold-standard data set for subjectivity classifications. In: Proceedings of the 37th Annual Meeting of the Association for Computational Linguistics on Computational Linguistics, pp. 246–253 (1999)
64.
65.
66.
67.
Li, F.: Do Stock Market Investors Understand the Downside Risk Sentiment of Corporate Annual Reports (2007)
68.
Minev, M., Schommer, C., Grammatikos, T.: News and stock markets: A survey on abnormal returns and prediction models (2012)
69.
Nassirtoussi, A.K., Aghabozorgi, S., Wah, T.Y., Ngo, D.C.L.: Text mining for market prediction: A systematic review. Expert Syst. Appl. 41(16), 7653–7670 (2014)CrossRef
70.
71.
72.
Metadata
Title
A Proposed Framework for Evaluating the Effectiveness of Financial News Sentiment Scoring Datasets
Authors
Islam Qudah
Fethi A. Rabhi
Maurice Peat
Copyright Year
2015
Book
Enterprise Applications and Services in the Finance Industry

Print ISBN: 978-3-319-28150-6

Electronic ISBN: 978-3-319-28151-3

Copyright Year: 2015

DOI
https://doi.org/10.1007/978-3-319-28151-3_3

Premium Partner

    Image Credits