Skip to main content
Erschienen in: Neural Computing and Applications 13/2022

25.02.2022 | Original Article

SKG-Learning: a deep learning model for sentiment knowledge graph construction in social networks

verfasst von: Bo Zhang, Yue Hu, Duo Xu, Maozhen Li, Meizi Li

Erschienen in: Neural Computing and Applications | Ausgabe 13/2022

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Traditional sentiment analysis methods pay little attention to the inseparable relations between evaluation words and evaluation aspects, and the relations between evaluation words and topics. There have been many studies of knowledge graph (KG), which can effectively store and manage massive amounts of information and is suitable to associate emotion words with evaluation aspects and topics. This study proposes SKG-Learning based on a deep learning model to construct a sentiment knowledge graph (SKG) for sentiment analysis. Entity and relation are the cornerstones of SKG; thus, the task of SKG-Learning is divided into named entity recognition and relation extraction. We propose a bidirectional long short-term memory model (Bi-LSTM) with background knowledge embedding and co-extraction of features (BBC-LSTM) to extract entities. BBC-LSTM completes the embedding of background knowledge such as topic and emotion information and uses three-dimensional tensors to co-extract the deep features of aspect entities and sentiment entities. It solves the problems that it is difficult to recognize entities from insufficient context, and traditional models usually neglect the relevance between sentiment entities and aspect entities. A relation extraction model based on an encoder–decoder model (ED-Learning) is proposed to extract and classify the relation between sentiment and aspect entity, that is, the emotional tendency of sentiment entity toward aspect entity. Experiments show that the proposed methods can more efficiently extract entities and relations from social network texts. We confirm the validity of an SKG constructed by the SKG-Learning model in an emotional analysis task.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Do HH, Prasad P, Maag A, Alsadoon A (2019) Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst Appl 118:272–299CrossRef Do HH, Prasad P, Maag A, Alsadoon A (2019) Deep learning for aspect-based sentiment analysis: a comparative review. Expert Syst Appl 118:272–299CrossRef
2.
Zurück zum Zitat Taboada M, Brooke J, Tofiloski M, Voll K, Stede M (2011) Lexicon-based methods for sentiment analysis. Comput Linguist 37(2):267–307CrossRef Taboada M, Brooke J, Tofiloski M, Voll K, Stede M (2011) Lexicon-based methods for sentiment analysis. Comput Linguist 37(2):267–307CrossRef
3.
Zurück zum Zitat Xu G, Yu Z, Yao H, Li F, Meng Y, Wu X (2019) Chinese text sentiment analysis based on extended sentiment dictionary. IEEE Access 7:43749–43762CrossRef Xu G, Yu Z, Yao H, Li F, Meng Y, Wu X (2019) Chinese text sentiment analysis based on extended sentiment dictionary. IEEE Access 7:43749–43762CrossRef
4.
Zurück zum Zitat Manurung R, et al. (2008) Machine learning-based sentiment analysis of automatic indonesian translations of english movie reviews. In: Proceedings of the International Conference on Advanced Computational Intelligence and Its Applications (ICACIA), pp. 1–6. Citeseer Manurung R, et al. (2008) Machine learning-based sentiment analysis of automatic indonesian translations of english movie reviews. In: Proceedings of the International Conference on Advanced Computational Intelligence and Its Applications (ICACIA), pp. 1–6. Citeseer
5.
Zurück zum Zitat Cai Y, Yang K, Huang D, Zhou Z, Lei X, Xie H, Wong T-L (2019) A hybrid model for opinion mining based on domain sentiment dictionary. Int J Mach Learn Cybern 10(8):2131–2142CrossRef Cai Y, Yang K, Huang D, Zhou Z, Lei X, Xie H, Wong T-L (2019) A hybrid model for opinion mining based on domain sentiment dictionary. Int J Mach Learn Cybern 10(8):2131–2142CrossRef
6.
Zurück zum Zitat Basiri ME, Nemati S, Abdar M, Cambria E, Acharya UR (2021) Abcdm: An attention-based bidirectional cnn-rnn deep model for sentiment analysis. Future Gener Comput Syst 115:279–294CrossRef Basiri ME, Nemati S, Abdar M, Cambria E, Acharya UR (2021) Abcdm: An attention-based bidirectional cnn-rnn deep model for sentiment analysis. Future Gener Comput Syst 115:279–294CrossRef
7.
Zurück zum Zitat Ma R, Wang K, Qiu T, Sangaiah AK, Lin D, Liaqat HB (2019) Feature-based compositing memory networks for aspect-based sentiment classification in social internet of things. Future Gener Comput Syst 92:879–888CrossRef Ma R, Wang K, Qiu T, Sangaiah AK, Lin D, Liaqat HB (2019) Feature-based compositing memory networks for aspect-based sentiment classification in social internet of things. Future Gener Comput Syst 92:879–888CrossRef
8.
Zurück zum Zitat Guo X, Zhang G, Wang S, Chen Q (2020) Multi-way matching based fine-grained sentiment analysis for user reviews. Neural Comput Appl 32(10):5409–5423CrossRef Guo X, Zhang G, Wang S, Chen Q (2020) Multi-way matching based fine-grained sentiment analysis for user reviews. Neural Comput Appl 32(10):5409–5423CrossRef
9.
Zurück zum Zitat Nguyen HL, Vu DT, Jung JJ (2020) Knowledge graph fusion for smart systems: a survey. Inf Fusion 61:56–70CrossRef Nguyen HL, Vu DT, Jung JJ (2020) Knowledge graph fusion for smart systems: a survey. Inf Fusion 61:56–70CrossRef
10.
Zurück zum Zitat Fares M, Moufarrej A, Jreij E, Tekli J, Grosky W (2019) Unsupervised word-level affect analysis and propagation in a lexical knowledge graph. Knowledge-Based Syst 165:432–459CrossRef Fares M, Moufarrej A, Jreij E, Tekli J, Grosky W (2019) Unsupervised word-level affect analysis and propagation in a lexical knowledge graph. Knowledge-Based Syst 165:432–459CrossRef
11.
Zurück zum Zitat Unanue IJ, Borzeshi EZ, Piccardi M (2017) Recurrent neural networks with specialized word embeddings for health-domain named-entity recognition. J Biomed Inf 76:102–109CrossRef Unanue IJ, Borzeshi EZ, Piccardi M (2017) Recurrent neural networks with specialized word embeddings for health-domain named-entity recognition. J Biomed Inf 76:102–109CrossRef
12.
Zurück zum Zitat Zheng S, Hao Y, Lu D, Bao H, Xu J, Hao H, Xu B (2017) Joint entity and relation extraction based on a hybrid neural network. Neurocomputing 257:59–66CrossRef Zheng S, Hao Y, Lu D, Bao H, Xu J, Hao H, Xu B (2017) Joint entity and relation extraction based on a hybrid neural network. Neurocomputing 257:59–66CrossRef
13.
Zurück zum Zitat Zheng S, Wang F, Bao H, Hao Y, Zhou P, Xu B (2017) Joint extraction of entities and relations based on a novel tagging scheme. arXiv preprint arXiv:1706.05075 Zheng S, Wang F, Bao H, Hao Y, Zhou P, Xu B (2017) Joint extraction of entities and relations based on a novel tagging scheme. arXiv preprint arXiv:​1706.​05075
14.
Zurück zum Zitat Saedi C, Branco A, Rodrigues J, Silva J (2018) Wordnet embeddings. In: Proceedings of the Third Workshop on Representation Learning for NLP, pp. 122–131 Saedi C, Branco A, Rodrigues J, Silva J (2018) Wordnet embeddings. In: Proceedings of the Third Workshop on Representation Learning for NLP, pp. 122–131
15.
Zurück zum Zitat Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pp. 1247–1250 Bollacker K, Evans C, Paritosh P, Sturge T, Taylor J (2008) Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, pp. 1247–1250
16.
Zurück zum Zitat Lassila O, Swick RR et al. (1998) Resource description framework (rdf) model and syntax specification Lassila O, Swick RR et al. (1998) Resource description framework (rdf) model and syntax specification
17.
Zurück zum Zitat Jia Y, Qi Y, Shang H, Jiang R, Li A (2018) A practical approach to constructing a knowledge graph for cybersecurity. Engineering 4(1):53–60CrossRef Jia Y, Qi Y, Shang H, Jiang R, Li A (2018) A practical approach to constructing a knowledge graph for cybersecurity. Engineering 4(1):53–60CrossRef
18.
Zurück zum Zitat Xie C, Yu B, Zeng Z, Yang Y, Liu Q (2020) Multilayer internet-of-things middleware based on knowledge graph. IEEE Internet Things J 8(4):2635–2648CrossRef Xie C, Yu B, Zeng Z, Yang Y, Liu Q (2020) Multilayer internet-of-things middleware based on knowledge graph. IEEE Internet Things J 8(4):2635–2648CrossRef
19.
Zurück zum Zitat Qiu L, Zhang H (2017) Review of development and construction of Uyghur knowledge graph. In: 2017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC), vol. 1, pp. 894–897 . IEEE Qiu L, Zhang H (2017) Review of development and construction of Uyghur knowledge graph. In: 2017 IEEE International Conference on Computational Science and Engineering (CSE) and IEEE International Conference on Embedded and Ubiquitous Computing (EUC), vol. 1, pp. 894–897 . IEEE
20.
Zurück zum Zitat Zhou J, Huang JX, Hu QV, He L (2020) Sk-gcn: modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification. Knowledge-Based Syst 205:106292CrossRef Zhou J, Huang JX, Hu QV, He L (2020) Sk-gcn: modeling syntax and knowledge via graph convolutional network for aspect-level sentiment classification. Knowledge-Based Syst 205:106292CrossRef
21.
Zurück zum Zitat Al-Khatib K, Hou Y, Wachsmuth H, Jochim C, Bonin F, Stein B (2020) End-to-end argumentation knowledge graph construction. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 7367–7374 Al-Khatib K, Hou Y, Wachsmuth H, Jochim C, Bonin F, Stein B (2020) End-to-end argumentation knowledge graph construction. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 34, pp. 7367–7374
22.
Zurück zum Zitat Huang X, Zhang J, Li D, Li P (2019) Knowledge graph embedding based question answering. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 105–113 Huang X, Zhang J, Li D, Li P (2019) Knowledge graph embedding based question answering. In: Proceedings of the Twelfth ACM International Conference on Web Search and Data Mining, pp. 105–113
23.
Zurück zum Zitat Dietz L, Kotov A, Meij E (2018) Utilizing knowledge graphs for text-centric information retrieval. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, pp. 1387–1390 Dietz L, Kotov A, Meij E (2018) Utilizing knowledge graphs for text-centric information retrieval. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, pp. 1387–1390
24.
Zurück zum Zitat Zhao Y, Xiang L, Zhu J, Zhang J, Zhou Y, Zong C (2020) Knowledge graph enhanced neural machine translation via multi-task learning on sub-entity granularity. In: Proceedings of the 28th International Conference on Computational Linguistics, pp. 4495–4505 Zhao Y, Xiang L, Zhu J, Zhang J, Zhou Y, Zong C (2020) Knowledge graph enhanced neural machine translation via multi-task learning on sub-entity granularity. In: Proceedings of the 28th International Conference on Computational Linguistics, pp. 4495–4505
25.
Zurück zum Zitat Kanimozhi U, Manjula D (2017) A crf based machine learning approach for biomedical named entity recognition. In: 2017 Second International Conference on Recent Trends and Challenges in Computational Models (ICRTCCM), pp. 335–342 . IEEE Kanimozhi U, Manjula D (2017) A crf based machine learning approach for biomedical named entity recognition. In: 2017 Second International Conference on Recent Trends and Challenges in Computational Models (ICRTCCM), pp. 335–342 . IEEE
26.
Zurück zum Zitat MAK, RS, Bijaksana MA, Huda AF (2019) Person entity recognition for the Indonesian qur‘an translation with the approach hidden Markov model-viterbi. Procedia Comput Sci, 157, 214–220 MAK, RS, Bijaksana MA, Huda AF (2019) Person entity recognition for the Indonesian qur‘an translation with the approach hidden Markov model-viterbi. Procedia Comput Sci, 157, 214–220
27.
Zurück zum Zitat Lample G, Ballesteros M, Subramanian S, Kawakami K, Dyer C (2016) Neural architectures for named entity recognition. arXiv preprint arXiv:1603.01360 Lample G, Ballesteros M, Subramanian S, Kawakami K, Dyer C (2016) Neural architectures for named entity recognition. arXiv preprint arXiv:​1603.​01360
28.
Zurück zum Zitat Chiu JP, Nichols E (2016) Named entity recognition with bidirectional lstm-cnns. Trans Assoc Comput Linguist 4:357–370CrossRef Chiu JP, Nichols E (2016) Named entity recognition with bidirectional lstm-cnns. Trans Assoc Comput Linguist 4:357–370CrossRef
29.
Zurück zum Zitat Wang D, Peng N, Duh K (2017) A multi-task learning approach to adapting bilingual word embeddings for cross-lingual named entity recognition. In: Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pp. 383–388 Wang D, Peng N, Duh K (2017) A multi-task learning approach to adapting bilingual word embeddings for cross-lingual named entity recognition. In: Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 2: Short Papers), pp. 383–388
30.
Zurück zum Zitat Hasegawa T, Sekine S, Grishman R (2004) Discovering relations among named entities from large corpora. In: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL-04), pp. 415–422 Hasegawa T, Sekine S, Grishman R (2004) Discovering relations among named entities from large corpora. In: Proceedings of the 42nd Annual Meeting of the Association for Computational Linguistics (ACL-04), pp. 415–422
31.
Zurück zum Zitat Zeng D, Liu K, Lai S, Zhou G, Zhao J (2014) Relation classification via convolutional deep neural network. In: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pp. 2335–2344 Zeng D, Liu K, Lai S, Zhou G, Zhao J (2014) Relation classification via convolutional deep neural network. In: Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers, pp. 2335–2344
32.
Zurück zum Zitat Sun T, Zhang C, Ji Y, Hu Z (2019) Reinforcement learning for distantly supervised relation extraction. IEEE Access 7:98023–98033CrossRef Sun T, Zhang C, Ji Y, Hu Z (2019) Reinforcement learning for distantly supervised relation extraction. IEEE Access 7:98023–98033CrossRef
33.
Zurück zum Zitat Qu J, Ouyang D, Hua W, Ye Y, Li X (2018) Distant supervision for neural relation extraction integrated with word attention and property features. Neural Netw 100:59–69CrossRef Qu J, Ouyang D, Hua W, Ye Y, Li X (2018) Distant supervision for neural relation extraction integrated with word attention and property features. Neural Netw 100:59–69CrossRef
34.
Zurück zum Zitat Sun C, Yang Z, Wang L, Zhang Y, Lin H, Wang J, Yang L, Xu K, Zhang Y (2018) Hierarchical recurrent convolutional neural network for chemical-protein relation extraction from biomedical literature. In: 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 765–766 . IEEE Sun C, Yang Z, Wang L, Zhang Y, Lin H, Wang J, Yang L, Xu K, Zhang Y (2018) Hierarchical recurrent convolutional neural network for chemical-protein relation extraction from biomedical literature. In: 2018 IEEE International Conference on Bioinformatics and Biomedicine (BIBM), pp. 765–766 . IEEE
35.
Zurück zum Zitat Li P, Mao K (2019) Knowledge-oriented convolutional neural network for causal relation extraction from natural language texts. Expert Syst Appl 115:512–523CrossRef Li P, Mao K (2019) Knowledge-oriented convolutional neural network for causal relation extraction from natural language texts. Expert Syst Appl 115:512–523CrossRef
36.
Zurück zum Zitat Katiyar A, Cardie C (2017) Going out on a limb: Joint extraction of entity mentions and relations without dependency trees. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 917–928 Katiyar A, Cardie C (2017) Going out on a limb: Joint extraction of entity mentions and relations without dependency trees. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 917–928
37.
Zurück zum Zitat Ekman P (1992) An argument for basic emotions. Cogn Emot 6(3–4):169–200CrossRef Ekman P (1992) An argument for basic emotions. Cogn Emot 6(3–4):169–200CrossRef
38.
Zurück zum Zitat Cambria E, Poria S, Bajpai R, Schuller B (2016) Senticnet 4: A semantic resource for sentiment analysis based on conceptual primitives. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 2666–2677 Cambria E, Poria S, Bajpai R, Schuller B (2016) Senticnet 4: A semantic resource for sentiment analysis based on conceptual primitives. In: Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pp. 2666–2677
39.
Zurück zum Zitat Wang W, Pan SJ, Dahlmeier D, Xiao X (2017) Coupled multi-layer attentions for co-extraction of aspect and opinion terms. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 31 Wang W, Pan SJ, Dahlmeier D, Xiao X (2017) Coupled multi-layer attentions for co-extraction of aspect and opinion terms. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 31
40.
Zurück zum Zitat Qin Y, Shen G-W, Zhao W-B, Chen Y-P, Yu M, Jin X (2019) A network security entity recognition method based on feature template and cnn-bilstm-crf. Front Inf Technol Electron Eng 20(6):872–884CrossRef Qin Y, Shen G-W, Zhao W-B, Chen Y-P, Yu M, Jin X (2019) A network security entity recognition method based on feature template and cnn-bilstm-crf. Front Inf Technol Electron Eng 20(6):872–884CrossRef
42.
Zurück zum Zitat Fan Z, Wu Z, Dai X, Huang S, Chen J (2019) Target-oriented opinion words extraction with target-fused neural sequence labeling. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 1 (Long and Short Papers), pp. 2509–2518 Fan Z, Wu Z, Dai X, Huang S, Chen J (2019) Target-oriented opinion words extraction with target-fused neural sequence labeling. In: Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Vol. 1 (Long and Short Papers), pp. 2509–2518
43.
Zurück zum Zitat He R, Lee WS, Ng HT, Dahlmeier D (2018) Exploiting document knowledge for aspect-level sentiment classification. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) He R, Lee WS, Ng HT, Dahlmeier D (2018) Exploiting document knowledge for aspect-level sentiment classification. In: Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Metadaten
Titel
SKG-Learning: a deep learning model for sentiment knowledge graph construction in social networks
verfasst von
Bo Zhang
Yue Hu
Duo Xu
Maozhen Li
Meizi Li
Publikationsdatum
25.02.2022
Verlag
Springer London
Erschienen in
Neural Computing and Applications / Ausgabe 13/2022
Print ISSN: 0941-0643
Elektronische ISSN: 1433-3058
DOI
https://doi.org/10.1007/s00521-022-07028-4

Weitere Artikel der Ausgabe 13/2022

Neural Computing and Applications 13/2022 Zur Ausgabe

Premium Partner