Skip to main content
Erschienen in: Neural Processing Letters 2/2017

01.03.2017

Cascaded Convolutional Neural Networks for Aspect-Based Opinion Summary

verfasst von: Xiaodong Gu, Yiwei Gu, Haibing Wu

Erschienen in: Neural Processing Letters | Ausgabe 2/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

This paper studies aspect-based opinion summary (AOS) of reviews on particular products. In practice, an AOS system needs to address two core subtasks, aspect extraction and sentiment classification. Most existing approaches to aspect extraction, using linguistic analysis or topic modeling, are general across different products but not precise enough or suitable for particular products. Instead we take a less general but more precise scheme, which directly maps each review sentence into pre-defined aspects. To tackle aspect mapping and sentiment classification, we propose a convolutional neural network (CNN) based method, cascaded CNN (C-CNN). C-CNN contains two levels of convolutional networks. Multiple CNNs at level 1 deal with aspect mapping task. If a review sentence belongs to pre-defined aspect categories, a single CNN at level 2 determines its sentiment polarity. Experimental results show that C-CNN with pre-trained word embedding outperform cascaded SVM with feature engineering. We also build a system called OpiSum with C-CNN. The demo of OpiSum can be found at http://​114.​215.​167.​42.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Gao Z-K, Cai Q, Yang Y-X, Dang W-D, Zhang S-S (2016) Multiscale limited penetrable horizontal visibility graph for analyzing nonlinear time series. Sci Rep 6:35622. doi:10.1038/srep35622 CrossRef Gao Z-K, Cai Q, Yang Y-X, Dang W-D, Zhang S-S (2016) Multiscale limited penetrable horizontal visibility graph for analyzing nonlinear time series. Sci Rep 6:35622. doi:10.​1038/​srep35622 CrossRef
2.
Zurück zum Zitat Gao Z-K, Cai Q, Yang Y-X, Dong N, Zhang S-S (2017) Visibility graph from adaptive optimal kernel time-frequency representation for classification of epileptiform EEG. Int J Neural Syst 27:1750005CrossRef Gao Z-K, Cai Q, Yang Y-X, Dong N, Zhang S-S (2017) Visibility graph from adaptive optimal kernel time-frequency representation for classification of epileptiform EEG. Int J Neural Syst 27:1750005CrossRef
4.
Zurück zum Zitat Gao Z-K, Yang Y-X, Fang P-C, Zou Y, Xia C-Y, Du M (2015) Multiscale complex network for analyzing experimental multivariate time series. EPL (Europhys Lett) 109(3):30005CrossRef Gao Z-K, Yang Y-X, Fang P-C, Zou Y, Xia C-Y, Du M (2015) Multiscale complex network for analyzing experimental multivariate time series. EPL (Europhys Lett) 109(3):30005CrossRef
5.
Zurück zum Zitat Hu M, Liu B (2004) Mining opinion features in customer reviews. AAAI 4:755–760 Hu M, Liu B (2004) Mining opinion features in customer reviews. AAAI 4:755–760
6.
Zurück zum Zitat Blair-Goldensohn S, Hannan K, McDonald R, Neylon T, Reis GA, Reynar J (2008) Building a sentiment summarizer for local service reviews. In: Proceedings of WWW workshop on NLP in the information explosion era, pp 339–348 Blair-Goldensohn S, Hannan K, McDonald R, Neylon T, Reis GA, Reynar J (2008) Building a sentiment summarizer for local service reviews. In: Proceedings of WWW workshop on NLP in the information explosion era, pp 339–348
7.
Zurück zum Zitat Kim S, Zhang J, Chen Z, Oh AH, Liu S (2013) A hierarchical aspect-sentiment model for online reviews. In: AAAI Kim S, Zhang J, Chen Z, Oh AH, Liu S (2013) A hierarchical aspect-sentiment model for online reviews. In: AAAI
8.
Zurück zum Zitat Kobayashi N, Inui K, Matsumoto Y (2007) Extracting aspect-evaluation and aspect-of relations in opinion mining. In: EMNLP-CoNLL, Citeseer, pp 1065–1074 Kobayashi N, Inui K, Matsumoto Y (2007) Extracting aspect-evaluation and aspect-of relations in opinion mining. In: EMNLP-CoNLL, Citeseer, pp 1065–1074
9.
Zurück zum Zitat Sauper C, Barzilay R (2013) Automatic aggregation by joint modeling of aspects and values. J Artif Intell Res 46:89–127 Sauper C, Barzilay R (2013) Automatic aggregation by joint modeling of aspects and values. J Artif Intell Res 46:89–127
10.
Zurück zum Zitat Yang B, Cardie C (2012) Extracting opinion expressions with semi-Markov conditional random fields. In: Proceedings of the 2012 joint conference on empirical methods in natural language processing and computational natural language learning, Association for Computational Linguistics, pp 1335–1345 Yang B, Cardie C (2012) Extracting opinion expressions with semi-Markov conditional random fields. In: Proceedings of the 2012 joint conference on empirical methods in natural language processing and computational natural language learning, Association for Computational Linguistics, pp 1335–1345
11.
Zurück zum Zitat Zhao WX, Jiang J, Yan H, Li X (2010) Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid. In: Proceedings of the 2010 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 56–65 Zhao WX, Jiang J, Yan H, Li X (2010) Jointly modeling aspects and opinions with a MaxEnt-LDA hybrid. In: Proceedings of the 2010 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 56–65
12.
Zurück zum Zitat Joshi M, Penstein-Rosé C (2009) Generalizing dependency features for opinion mining. In: Proceedings of the ACL-IJCNLP 2009 conference short papers, Association for Computational Linguistics, pp 313–316 Joshi M, Penstein-Rosé C (2009) Generalizing dependency features for opinion mining. In: Proceedings of the ACL-IJCNLP 2009 conference short papers, Association for Computational Linguistics, pp 313–316
13.
Zurück zum Zitat Qiu G, Liu B, Bu J, Chen C (2011) Opinion word expansion and target extraction through double propagation. Comput Linguist 37(1):9–27CrossRef Qiu G, Liu B, Bu J, Chen C (2011) Opinion word expansion and target extraction through double propagation. Comput Linguist 37(1):9–27CrossRef
14.
Zurück zum Zitat Wu Y, Zhang Q, Huang X, Wu L (2009) Phrase dependency parsing for opinion mining. In: Proceedings of the 2009 conference on empirical methods in natural language processing: volume 3, Association for Computational Linguistics, pp 1533–1541 Wu Y, Zhang Q, Huang X, Wu L (2009) Phrase dependency parsing for opinion mining. In: Proceedings of the 2009 conference on empirical methods in natural language processing: volume 3, Association for Computational Linguistics, pp 1533–1541
15.
Zurück zum Zitat Zhuang L, Jing F, Zhu X-Y (2006) Movie review mining and summarization. In: Proceedings of the 15th ACM international conference on information and knowledge management, ACM, pp 43–50 Zhuang L, Jing F, Zhu X-Y (2006) Movie review mining and summarization. In: Proceedings of the 15th ACM international conference on information and knowledge management, ACM, pp 43–50
16.
Zurück zum Zitat Breck E, Choi Y, Cardie C (2007) Identifying expressions of opinion in context. In: Proceedings of the 20th international joint conference on artificial intelligence, pp 2683–2688 Breck E, Choi Y, Cardie C (2007) Identifying expressions of opinion in context. In: Proceedings of the 20th international joint conference on artificial intelligence, pp 2683–2688
17.
Zurück zum Zitat Irsoy O, Cardie C (2014) Opinion mining with deep recurrent neural networks. In: Proceedings of the 2014 conference on empirical methods in natural language processing, pp 720–728 Irsoy O, Cardie C (2014) Opinion mining with deep recurrent neural networks. In: Proceedings of the 2014 conference on empirical methods in natural language processing, pp 720–728
18.
Zurück zum Zitat Jakob N, Gurevych I (2010) Extracting opinion targets in a single-and cross-domain setting with conditional random fields. In: Proceedings of the 2010 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 1035–1045 Jakob N, Gurevych I (2010) Extracting opinion targets in a single-and cross-domain setting with conditional random fields. In: Proceedings of the 2010 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 1035–1045
19.
Zurück zum Zitat Jin W, Ho HH, Srihari RK (2009) A novel lexicalized HMM-based learning framework for web opinion mining. In: Proceedings of the 26th annual international conference on machine learning, Citeseer, pp 465–472 Jin W, Ho HH, Srihari RK (2009) A novel lexicalized HMM-based learning framework for web opinion mining. In: Proceedings of the 26th annual international conference on machine learning, Citeseer, pp 465–472
20.
Zurück zum Zitat Brody S, Elhadad N (2010) An unsupervised aspect-sentiment model for online reviews. In: Paper presented at the human language technologies: the 2010 annual conference of the North American Chapter of the Association for Computational Linguistics. Los Angeles, California Brody S, Elhadad N (2010) An unsupervised aspect-sentiment model for online reviews. In: Paper presented at the human language technologies: the 2010 annual conference of the North American Chapter of the Association for Computational Linguistics. Los Angeles, California
21.
Zurück zum Zitat Chen Z, Mukherjee A, Liu B (2014) Aspect extraction with automated prior knowledge learning. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics, pp 347–358 Chen Z, Mukherjee A, Liu B (2014) Aspect extraction with automated prior knowledge learning. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics, pp 347–358
22.
Zurück zum Zitat Jo Y, Oh AH (2011) Aspect and sentiment unification model for online review analysis. In: Proceedings of the fourth ACM international conference on Web search and data mining, ACM, pp 815–824 Jo Y, Oh AH (2011) Aspect and sentiment unification model for online review analysis. In: Proceedings of the fourth ACM international conference on Web search and data mining, ACM, pp 815–824
23.
Zurück zum Zitat Kim Y (2014) Convolutional neural networks for sentence classification. In: Proceedings of the 2014 conference on empirical methods in natural language processing. pp 1746–1751 Kim Y (2014) Convolutional neural networks for sentence classification. In: Proceedings of the 2014 conference on empirical methods in natural language processing. pp 1746–1751
24.
Zurück zum Zitat Moghaddam S, Ester M (2012) On the design of LDA models for aspect-based opinion mining. In: Proceedings of the 21st ACM international conference on Information and knowledge management, ACM, pp 803–812 Moghaddam S, Ester M (2012) On the design of LDA models for aspect-based opinion mining. In: Proceedings of the 21st ACM international conference on Information and knowledge management, ACM, pp 803–812
25.
Zurück zum Zitat Mukherjee A, Liu B (2012) Aspect extraction through semi-supervised modeling. In: Proceedings of the 50th annual meeting of the Association for Computational Linguistics: Long Papers-vol 1, Association for Computational Linguistics, pp 339–348 Mukherjee A, Liu B (2012) Aspect extraction through semi-supervised modeling. In: Proceedings of the 50th annual meeting of the Association for Computational Linguistics: Long Papers-vol 1, Association for Computational Linguistics, pp 339–348
26.
Zurück zum Zitat Sauper C, Haghighi A, Barzilay R (2011) Content models with attitude. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics: human language technologies, volume 1, Association for Computational Linguistics, pp 350–358 Sauper C, Haghighi A, Barzilay R (2011) Content models with attitude. In: Proceedings of the 49th annual meeting of the Association for Computational Linguistics: human language technologies, volume 1, Association for Computational Linguistics, pp 350–358
27.
Zurück zum Zitat Bespalov D, Bai B, Qi Y, Shokoufandeh (2011) A Sentiment classification based on supervised latent n-gram analysis. In: Proceedings of the 20th ACM international conference on information and knowledge management, ACM, pp 375–382 Bespalov D, Bai B, Qi Y, Shokoufandeh (2011) A Sentiment classification based on supervised latent n-gram analysis. In: Proceedings of the 20th ACM international conference on information and knowledge management, ACM, pp 375–382
28.
Zurück zum Zitat Davidov D, Tsur O, Rappoport (2010) A Enhanced sentiment learning using twitter hashtags and smileys. In: Proceedings of the 23rd international conference on computational linguistics: posters, Association for Computational Linguistics, pp 241–249 Davidov D, Tsur O, Rappoport (2010) A Enhanced sentiment learning using twitter hashtags and smileys. In: Proceedings of the 23rd international conference on computational linguistics: posters, Association for Computational Linguistics, pp 241–249
29.
Zurück zum Zitat Nakagawa T, Inui K, Kurohashi S (2010) Dependency tree-based sentiment classification using CRFs with hidden variables. In: Human language technologies: the 2010 annual conference of the North American chapter of the Association for Computational Linguistics, Association for Computational Linguistics, pp 786–794 Nakagawa T, Inui K, Kurohashi S (2010) Dependency tree-based sentiment classification using CRFs with hidden variables. In: Human language technologies: the 2010 annual conference of the North American chapter of the Association for Computational Linguistics, Association for Computational Linguistics, pp 786–794
30.
Zurück zum Zitat Ng V, Dasgupta S, Arifin S (2006) Examining the role of linguistic knowledge sources in the automatic identification and classification of reviews. In: Proceedings of the COLING/ACL on main conference poster sessions, Association for Computational Linguistics, pp 611–618 Ng V, Dasgupta S, Arifin S (2006) Examining the role of linguistic knowledge sources in the automatic identification and classification of reviews. In: Proceedings of the COLING/ACL on main conference poster sessions, Association for Computational Linguistics, pp 611–618
31.
Zurück zum Zitat Paltoglou G, Thelwall M (2010) A study of information retrieval weighting schemes for sentiment analysis. In: Proceedings of the 48th annual meeting of the Association for Computational Linguistics, Association for Computational Linguistics, pp 1386–1395 Paltoglou G, Thelwall M (2010) A study of information retrieval weighting schemes for sentiment analysis. In: Proceedings of the 48th annual meeting of the Association for Computational Linguistics, Association for Computational Linguistics, pp 1386–1395
32.
Zurück zum Zitat Pang B, Lee L, Vaithyanathan S (2002) Thumbs up: sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 conference on empirical methods in natural language processing, vol 10, Association for Computational Linguistics, pp 79–86 Pang B, Lee L, Vaithyanathan S (2002) Thumbs up: sentiment classification using machine learning techniques. In: Proceedings of the ACL-02 conference on empirical methods in natural language processing, vol 10, Association for Computational Linguistics, pp 79–86
33.
Zurück zum Zitat Riloff E, Patwardhan S, Wiebe J (2006) Feature subsumption for opinion analysis. In: Proceedings of the 2006 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 440–448 Riloff E, Patwardhan S, Wiebe J (2006) Feature subsumption for opinion analysis. In: Proceedings of the 2006 conference on empirical methods in natural language processing, Association for Computational Linguistics, pp 440–448
35.
Zurück zum Zitat Kalchbrenner N, Grefenstette E, Blunsom P (2014) A convolutional neural network for modelling sentences. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics, pp 655–665 Kalchbrenner N, Grefenstette E, Blunsom P (2014) A convolutional neural network for modelling sentences. In: Proceedings of the 52nd annual meeting of the Association for Computational Linguistics, pp 655–665
36.
Zurück zum Zitat Santos CND, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of the 25th international conference on computational linguistics, pp 69–78 Santos CND, Gatti M (2014) Deep convolutional neural networks for sentiment analysis of short texts. In: Proceedings of the 25th international conference on computational linguistics, pp 69–78
37.
Zurück zum Zitat Lin C, He Y (2009) Joint sentiment/topic model for sentiment analysis. In: Proceedings of the 18th ACM conference on Information and knowledge management, ACM, pp 375–384 Lin C, He Y (2009) Joint sentiment/topic model for sentiment analysis. In: Proceedings of the 18th ACM conference on Information and knowledge management, ACM, pp 375–384
38.
Zurück zum Zitat Jin W, Ho HH, Srihari RK (2009) OpinionMiner: a novel machine learning system for web opinion mining and extraction. In: Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, ACM, pp 1195–1204 Jin W, Ho HH, Srihari RK (2009) OpinionMiner: a novel machine learning system for web opinion mining and extraction. In: Proceedings of the 15th ACM SIGKDD international conference on Knowledge discovery and data mining, ACM, pp 1195–1204
39.
Zurück zum Zitat Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 2012:1097–1105 Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Adv Neural Inf Process Syst 2012:1097–1105
40.
Zurück zum Zitat Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9 Szegedy C, Liu W, Jia Y, Sermanet P, Reed S, Anguelov D, Erhan D, Vanhoucke V, Rabinovich A (2015) Going deeper with convolutions. In: Proceedings of the IEEE conference on computer vision and pattern recognition, pp 1–9
41.
Zurück zum Zitat Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. J Mach Learn Res 12(Aug):2493–2537MATH Collobert R, Weston J, Bottou L, Karlen M, Kavukcuoglu K, Kuksa P (2011) Natural language processing (almost) from scratch. J Mach Learn Res 12(Aug):2493–2537MATH
42.
Zurück zum Zitat Shen Y, He X, Gao J, Deng L, Mesnil G (2014) A latent semantic model with convolutional-pooling structure for information retrieval. In: Proceedings of the 23rd ACM international conference on conference on information and knowledge management, ACM, pp 101–110 Shen Y, He X, Gao J, Deng L, Mesnil G (2014) A latent semantic model with convolutional-pooling structure for information retrieval. In: Proceedings of the 23rd ACM international conference on conference on information and knowledge management, ACM, pp 101–110
43.
Zurück zum Zitat Shen Y, He X, Gao J, Deng L, Mesnil G (2014) Learning semantic representations using convolutional neural networks for web search. In: Proceedings of the 23rd international conference on world wide web, ACM, pp 373–374 Shen Y, He X, Gao J, Deng L, Mesnil G (2014) Learning semantic representations using convolutional neural networks for web search. In: Proceedings of the 23rd international conference on world wide web, ACM, pp 373–374
44.
Zurück zum Zitat Santos CND, Xiang B, Zhou B (2015) Classifying relations by ranking with convolutional neural networks. In: Proceedings of ACL-IJCNLP 2015, ACL, pp 626–634 Santos CND, Xiang B, Zhou B (2015) Classifying relations by ranking with convolutional neural networks. In: Proceedings of ACL-IJCNLP 2015, ACL, pp 626–634
45.
Zurück zum Zitat Zeng D, Liu K, Lai S, Zhou G, Zhao J (2014) Relation classification via convolutional deep neural network. In: Proceedings of the 25th international conference on computational linguistics, pp 2335–2344 Zeng D, Liu K, Lai S, Zhou G, Zhao J (2014) Relation classification via convolutional deep neural network. In: Proceedings of the 25th international conference on computational linguistics, pp 2335–2344
46.
Zurück zum Zitat Le QV, Mikolov T (2014) Distributed representations of sentences and documents. In: Proceedings of The 31st international conference on machine learning, pp 1188–1196 Le QV, Mikolov T (2014) Distributed representations of sentences and documents. In: Proceedings of The 31st international conference on machine learning, pp 1188–1196
47.
Zurück zum Zitat Nair V, Hinton GE (2010) Rectified linear units improve restricted Boltzmann machines. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp 807–814 Nair V, Hinton GE (2010) Rectified linear units improve restricted Boltzmann machines. In: Proceedings of the 27th international conference on machine learning (ICML-10), pp 807–814
48.
Zurück zum Zitat Wu H, Gu X (2015) Towards dropout training for convolutional neural networks. Neural Netw 71:1–10CrossRef Wu H, Gu X (2015) Towards dropout training for convolutional neural networks. Neural Netw 71:1–10CrossRef
Metadaten
Titel
Cascaded Convolutional Neural Networks for Aspect-Based Opinion Summary
verfasst von
Xiaodong Gu
Yiwei Gu
Haibing Wu
Publikationsdatum
01.03.2017
Verlag
Springer US
Erschienen in
Neural Processing Letters / Ausgabe 2/2017
Print ISSN: 1370-4621
Elektronische ISSN: 1573-773X
DOI
https://doi.org/10.1007/s11063-017-9605-7

Weitere Artikel der Ausgabe 2/2017

Neural Processing Letters 2/2017 Zur Ausgabe

Neuer Inhalt