Skip to main content

2016 | OriginalPaper | Buchkapitel

Interpretability of Computational Models for Sentiment Analysis

verfasst von : Han Liu, Mihaela Cocea, Alexander Gegov

Erschienen in: Sentiment Analysis and Ontology Engineering

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Sentiment analysis, which is also known as opinion mining, has been an increasingly popular research area focusing on sentiment classification/regression. In many studies, computational models have been considered as effective and efficient tools for sentiment analysis. Computational models could be built by using expert knowledge or learning from data. From this viewpoint, the design of computational models could be categorized into expert based design and data based design. Due to the vast and rapid increase in data, the latter approach of design has become increasingly more popular for building computational models. A data based design typically follows machine learning approaches, each of which involves a particular strategy of learning. Therefore, the resulting computational models are usually represented in different forms. For example, neural network learning results in models in the form of multi-layer perceptron network whereas decision tree learning results in a rule set in the form of decision tree. On the basis of above description, interpretability has become a main problem that arises with computational models. This chapter explores the significance of interpretability for computational models as well as analyzes the factors that impact on interpretability. This chapter also introduces several ways to evaluate and improve the interpretability for computational models which are used as sentiment analysis systems. In particular, rule based systems, a special type of computational models, are used as an example for illustration with respects to evaluation and improvements through the use of computational intelligence methodologies.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Schlager, J.: Systems engineering: key to modern development. IRE Trans. EM 3(3), 64–66 (1956) Schlager, J.: Systems engineering: key to modern development. IRE Trans. EM 3(3), 64–66 (1956)
2.
Zurück zum Zitat Hall, A.D.: A Methodology for Systems Engineering. Van Nostrand Reinhold (1962) Hall, A.D.: A Methodology for Systems Engineering. Van Nostrand Reinhold (1962)
3.
Zurück zum Zitat Mitchell, T.M.: Machine Learning, McGraw Hill (1997) Mitchell, T.M.: Machine Learning, McGraw Hill (1997)
4.
Zurück zum Zitat Liu, H., Gegov, A., Stahl, F.: Categorization and construction of rule based systems. In: 15th International Conference on Engineering Applications of Neural Networks, Sofia, Bulgaria (2014) Liu, H., Gegov, A., Stahl, F.: Categorization and construction of rule based systems. In: 15th International Conference on Engineering Applications of Neural Networks, Sofia, Bulgaria (2014)
5.
Zurück zum Zitat Ross, T.J.: Fuzzy Logic with Engineering Applications. John Wiley & Sons Ltd, West Sussex (2004)MATH Ross, T.J.: Fuzzy Logic with Engineering Applications. John Wiley & Sons Ltd, West Sussex (2004)MATH
6.
Zurück zum Zitat Simpson, S.G.: Mathematical Logic, PA (2013) Simpson, S.G.: Mathematical Logic, PA (2013)
7.
Zurück zum Zitat Tan, P.-N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Pearson Education, New Jersey (2006) Tan, P.-N., Steinbach, M., Kumar, V.: Introduction to Data Mining. Pearson Education, New Jersey (2006)
8.
Zurück zum Zitat Higgins, C.M.: Classification and Approximation with Rule Based Networks. Pasadena, California (1993) Higgins, C.M.: Classification and Approximation with Rule Based Networks. Pasadena, California (1993)
9.
Zurück zum Zitat Uttley, A.M.: The design of conditional probability computers. Inf. Control 2, 1–24 (1959)CrossRefMATH Uttley, A.M.: The design of conditional probability computers. Inf. Control 2, 1–24 (1959)CrossRefMATH
10.
Zurück zum Zitat Kononenko, I.: Bayesain Neual Networks. Biol. Cybern. 61, 361–370 (1989)CrossRef Kononenko, I.: Bayesain Neual Networks. Biol. Cybern. 61, 361–370 (1989)CrossRef
11.
Zurück zum Zitat Rosenblatt, F.: Principles of Neurodynamics: Perceptron and the Theory of Brain Mechanisms. Spartan Books, Washington, DC (1962)MATH Rosenblatt, F.: Principles of Neurodynamics: Perceptron and the Theory of Brain Mechanisms. Spartan Books, Washington, DC (1962)MATH
12.
Zurück zum Zitat Ekeberg, O., Lansner, A.: Automatic generation of internal representations in a probabilistic artificial neural network. In: Proceedings of the First European Conference on Neural Networks (1988) Ekeberg, O., Lansner, A.: Automatic generation of internal representations in a probabilistic artificial neural network. In: Proceedings of the First European Conference on Neural Networks (1988)
13.
Zurück zum Zitat Altrabsheh, N., Cocea, M., Fallahkhair, S.: Sentiment analysis: towards a tool for analysing real-time students feedback. In: 2014 IEEE 26th International Conference on Tools with Artificial Intelligence, Limassol, Cyprus (2014) Altrabsheh, N., Cocea, M., Fallahkhair, S.: Sentiment analysis: towards a tool for analysing real-time students feedback. In: 2014 IEEE 26th International Conference on Tools with Artificial Intelligence, Limassol, Cyprus (2014)
14.
Zurück zum Zitat Liu, B.: Sentiment Analysis and Opinion Mining. Morgan & Claypool Publishers (2012) Liu, B.: Sentiment Analysis and Opinion Mining. Morgan & Claypool Publishers (2012)
15.
Zurück zum Zitat Stahl, F., Jordanov, I.: An overview of use of neural networks for data mining tasks. In: WIREs: Data Mining and Knowledge Discovery, pp. 193–208 (2012) Stahl, F., Jordanov, I.: An overview of use of neural networks for data mining tasks. In: WIREs: Data Mining and Knowledge Discovery, pp. 193–208 (2012)
16.
Zurück zum Zitat Liu, H., Gegov, A., Stahl, F.: J-measure based hybrid pruning for complexity reduction in classification rules. WSEAS Trans. Syst. 12(9), 433–446 (2013) Liu, H., Gegov, A., Stahl, F.: J-measure based hybrid pruning for complexity reduction in classification rules. WSEAS Trans. Syst. 12(9), 433–446 (2013)
17.
Zurück zum Zitat Liu, H., Gegov, A., Stahl, F.: Unified framework for construction of rule based classification systems. In: Pedrycz, W., Chen, S.M. (eds.) Inforamtion Granularity, Big Data and Computational Intelligence, vol. 8, pp. 209–230, Springer (2015) Liu, H., Gegov, A., Stahl, F.: Unified framework for construction of rule based classification systems. In: Pedrycz, W., Chen, S.M. (eds.) Inforamtion Granularity, Big Data and Computational Intelligence, vol. 8, pp. 209–230, Springer (2015)
18.
Zurück zum Zitat Quinlan, R.: C4.5: Programs for Machine Learning, Morgan Kaufman (1993) Quinlan, R.: C4.5: Programs for Machine Learning, Morgan Kaufman (1993)
19.
Zurück zum Zitat Fürnkranz, J.: Separate-and-conquer rule learning. Artif. Intell. Rev. 13, 3–54 (1999)CrossRefMATH Fürnkranz, J.: Separate-and-conquer rule learning. Artif. Intell. Rev. 13, 3–54 (1999)CrossRefMATH
20.
Zurück zum Zitat Cendrowska, J.: PRISM: an algorithm for inducing modular rules. Int. J. Man-Machine Stud. 27, 349–370 (1987)CrossRefMATH Cendrowska, J.: PRISM: an algorithm for inducing modular rules. Int. J. Man-Machine Stud. 27, 349–370 (1987)CrossRefMATH
21.
Zurück zum Zitat Deng, X.: A Covering-Based Algorithm for Classification: PRISM. Regina (2012) Deng, X.: A Covering-Based Algorithm for Classification: PRISM. Regina (2012)
22.
Zurück zum Zitat Liu, H., Gegov, A., Cocea, M.: Network Based Rule Representation for Knowledge Discovery and Predictive Modelling. In: IEEE International Conference on Fuzzy Systems, Istanbul (2015) Liu, H., Gegov, A., Cocea, M.: Network Based Rule Representation for Knowledge Discovery and Predictive Modelling. In: IEEE International Conference on Fuzzy Systems, Istanbul (2015)
23.
Zurück zum Zitat Rish, I.: An empirical study of the Naïve Bayes classifier. In: IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, vol. 3, no. 22, pp. 41–46 (2001) Rish, I.: An empirical study of the Naïve Bayes classifier. In: IJCAI 2001 Workshop on Empirical Methods in Artificial Intelligence, vol. 3, no. 22, pp. 41–46 (2001)
24.
Zurück zum Zitat Liu, H., Gegov, A., Cocea, M.: Rule Based Systems for Big Data: A Machine Learning Approach, vol. 13. Springer, Berlin (2016) Liu, H., Gegov, A., Cocea, M.: Rule Based Systems for Big Data: A Machine Learning Approach, vol. 13. Springer, Berlin (2016)
25.
Zurück zum Zitat Quinlan, R.: Discovering rules from large collections of examples: a case study. In: Michie, D. (ed.) Expert Systems in the Micro-Electronic Age, pp. 168–201. Edinburgh, Edinburgh (1979) Quinlan, R.: Discovering rules from large collections of examples: a case study. In: Michie, D. (ed.) Expert Systems in the Micro-Electronic Age, pp. 168–201. Edinburgh, Edinburgh (1979)
27.
Zurück zum Zitat Elomaa, T., Kääriäinen, M.: An analysis of reduced error pruning. J. Artif. Intell. Res. 15(1), 163–187 (2001)MathSciNetMATH Elomaa, T., Kääriäinen, M.: An analysis of reduced error pruning. J. Artif. Intell. Res. 15(1), 163–187 (2001)MathSciNetMATH
28.
Zurück zum Zitat Altrabsheh, N., Cocea, M., Fallahkhair, S.: Learning sentiment from students’ feedback for real-time interventions in classrooms. In: Adaptive and intelligent systems: Third International Conference, ICAIS 2014, Bournemouth (2014) Altrabsheh, N., Cocea, M., Fallahkhair, S.: Learning sentiment from students’ feedback for real-time interventions in classrooms. In: Adaptive and intelligent systems: Third International Conference, ICAIS 2014, Bournemouth (2014)
29.
Zurück zum Zitat Kummer, O., Savoy, J.: Feature Selection in Sentiment Analysis. In: CORIA 2012, Bordeaux (2012) Kummer, O., Savoy, J.: Feature Selection in Sentiment Analysis. In: CORIA 2012, Bordeaux (2012)
30.
31.
Zurück zum Zitat Jolliffe, I.T.: Principal Component Analysis. Springer, New York (2002)MATH Jolliffe, I.T.: Principal Component Analysis. Springer, New York (2002)MATH
32.
Zurück zum Zitat Yu, H., Yang, J.: A direct LDA algorithm for high-dimensional data—with application to face recognition. Patt. Recogn. 34(10), 2067–2069 (2001)CrossRefMATH Yu, H., Yang, J.: A direct LDA algorithm for high-dimensional data—with application to face recognition. Patt. Recogn. 34(10), 2067–2069 (2001)CrossRefMATH
33.
Zurück zum Zitat Yates, D.S., Moore, D.S., Starnes, D.S.: The Practice of Statistics, 3rd ed. Freeman (2008) Yates, D.S., Moore, D.S., Starnes, D.S.: The Practice of Statistics, 3rd ed. Freeman (2008)
34.
Zurück zum Zitat Deming, W.E.: On probability as a basis for action. Am. Stat. 29(4), 146–152 (1975) Deming, W.E.: On probability as a basis for action. Am. Stat. 29(4), 146–152 (1975)
35.
Zurück zum Zitat Kerry, S.M., Bland, J.M.: The intracluster correlation coefficient in cluster randomisation. Br. Med. J. 316(7142), 1455–1460 (1998)CrossRef Kerry, S.M., Bland, J.M.: The intracluster correlation coefficient in cluster randomisation. Br. Med. J. 316(7142), 1455–1460 (1998)CrossRef
36.
Zurück zum Zitat Kerber, R.: ChiMerge: discretization of numeric attributes. In: Proceedings of the 10th National Conference on Artificial Intelligence, California (1992) Kerber, R.: ChiMerge: discretization of numeric attributes. In: Proceedings of the 10th National Conference on Artificial Intelligence, California (1992)
37.
Zurück zum Zitat Medhat, W., Hassan, A., Korashy, H.: Sentiment analysis algorithms and applications: a survey. Ain Shams Eng. J. 5(4), 1093–1113 (2014)CrossRef Medhat, W., Hassan, A., Korashy, H.: Sentiment analysis algorithms and applications: a survey. Ain Shams Eng. J. 5(4), 1093–1113 (2014)CrossRef
38.
Zurück zum Zitat Yi, H., Li, W.: Document sentiment classification by exploring description model of topical terms. Comput. Speech Lang. 50, 386–403 (2011) Yi, H., Li, W.: Document sentiment classification by exploring description model of topical terms. Comput. Speech Lang. 50, 386–403 (2011)
39.
Zurück zum Zitat Lewis, D.D., Ringuette, M.: A comparison of two learning algorithms for text categorization. In: Third Annual Symposium on Document Analysis and Information Retrieval, Las Vegas (1994) Lewis, D.D., Ringuette, M.: A comparison of two learning algorithms for text categorization. In: Third Annual Symposium on Document Analysis and Information Retrieval, Las Vegas (1994)
40.
Zurück zum Zitat Chakrabarti, S., Roy, S., Soundalgekar, M.V.: Fast and accurate text classification via multiple linear discriminant projections. Int. J. Very Large Data Bases 12(2), 170–185 (2003)CrossRef Chakrabarti, S., Roy, S., Soundalgekar, M.V.: Fast and accurate text classification via multiple linear discriminant projections. Int. J. Very Large Data Bases 12(2), 170–185 (2003)CrossRef
41.
Zurück zum Zitat Zhao, C., Wang, S., Li, D.: Fuzzy sentiment membership determining for sentiment classification. In: IEEE International Conference on Data Mining Workshop (ICDMW), Shenzhen (2014) Zhao, C., Wang, S., Li, D.: Fuzzy sentiment membership determining for sentiment classification. In: IEEE International Conference on Data Mining Workshop (ICDMW), Shenzhen (2014)
42.
Zurück zum Zitat Nadali, S., Murad, M., Kadir, R.: Sentiment classification of customer reviews based on fuzzy logic. In: International Symposium in Information Technology (ITSim), Kuala Lumpur (2010) Nadali, S., Murad, M., Kadir, R.: Sentiment classification of customer reviews based on fuzzy logic. In: International Symposium in Information Technology (ITSim), Kuala Lumpur (2010)
43.
Zurück zum Zitat Colace, F., Santo, M.D., Greco, L.: A probabilistic approach to Tweets’ sentiment classification. In: 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, Geneva (2013) Colace, F., Santo, M.D., Greco, L.: A probabilistic approach to Tweets’ sentiment classification. In: 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction, Geneva (2013)
Metadaten
Titel
Interpretability of Computational Models for Sentiment Analysis
verfasst von
Han Liu
Mihaela Cocea
Alexander Gegov
Copyright-Jahr
2016
DOI
https://doi.org/10.1007/978-3-319-30319-2_9