Skip to main content
Top
Published in: Mobile Networks and Applications 6/2021

10-11-2021

TA-BiLSTM: An Interpretable Topic-Aware Model for Misleading Information Detection in Mobile Social Networks

Authors: Shuyu Chang, Rui Wang, Haiping Huang, Jian Luo

Published in: Mobile Networks and Applications | Issue 6/2021

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

As essential information acquisition tools in our lives, mobile social networks have brought us great convenience for communication. However, misleading information such as spam emails, clickbait links, and false health information appears everywhere in mobile social networks. Prior studies have adopted various approaches to detecting this information but ignored global semantic features of the corpus and lacked interpretability. In this paper, we propose a novel end-to-end model called Topic-Aware BiLSTM (TA-BiLSTM) to handle the problems above. We firstly design a neural topic model for mining global semantic patterns, which encodes word relatedness into topic embeddings. Simultaneously, a detection model extracts local hidden states from text content with LSTM layers. Then, the model fuses those global and local representations with the Topic-Aware attention mechanism and performs misleading information detection. Experiments on three real datasets prove that the TA-BiLSTM could generate more coherent topics and improve the detecting performance jointly. Furthermore, case study and visualization demonstrate that the proposed TA-BiLSTM could discover latent topics and help in enhancing interpretability.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Show more products
Literature
1.
go back to reference Agrawal A (2016) Clickbait Detection Using Deep Learning. In: 2016 2nd International Conference on Next Generation Computing Technologies (NGCT). IEEE, pp 268–272 Agrawal A (2016) Clickbait Detection Using Deep Learning. In: 2016 2nd International Conference on Next Generation Computing Technologies (NGCT). IEEE, pp 268–272
2.
go back to reference Biyani P, Tsioutsiouliklis K, Blackmer J (2016) 8 Amazing Secrets for Getting More Clicks: Detecting Clickbaits in News Streams Using Article Informality. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 30 Biyani P, Tsioutsiouliklis K, Blackmer J (2016) 8 Amazing Secrets for Getting More Clicks: Detecting Clickbaits in News Streams Using Article Informality. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol 30
3.
go back to reference Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3 (Jan):993–1022MATH Blei DM, Ng AY, Jordan MI (2003) Latent dirichlet allocation. J Mach Learn Res 3 (Jan):993–1022MATH
4.
go back to reference Bojanowski P, Grave E, Joulin A, Mikolov T (2017) Enriching word vectors with subword information. Transa Assoc Comput Linguist 5:135–146CrossRef Bojanowski P, Grave E, Joulin A, Mikolov T (2017) Enriching word vectors with subword information. Transa Assoc Comput Linguist 5:135–146CrossRef
6.
go back to reference Breiman L, Friedman J, Stone CJ, Olshen RA (1984) Classification and Regression Trees. CRC press Breiman L, Friedman J, Stone CJ, Olshen RA (1984) Classification and Regression Trees. CRC press
7.
go back to reference Chakraborty A, Paranjape B, Kakarla S, Ganguly N (2016) Stop clickbait: Detecting and preventing clickbaits in online news media. In: 2016 IEEE/ACM International conference on advances in social networks analysis and mining (ASONAM). IEEE, pp. 9–16 Chakraborty A, Paranjape B, Kakarla S, Ganguly N (2016) Stop clickbait: Detecting and preventing clickbaits in online news media. In: 2016 IEEE/ACM International conference on advances in social networks analysis and mining (ASONAM). IEEE, pp. 9–16
8.
go back to reference Chang CC, Lin CJ (2011) LIBSVM: A library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):1–27CrossRef Chang CC, Lin CJ (2011) LIBSVM: A library for support vector machines. ACM Trans Intell Syst Technol (TIST) 2(3):1–27CrossRef
9.
go back to reference Cormack GV (2007) TREC 2007 Spam Track Overview. In: In The Sixteenth Text RETrieval Conference (TREC 2007). Proceedings Cormack GV (2007) TREC 2007 Spam Track Overview. In: In The Sixteenth Text RETrieval Conference (TREC 2007). Proceedings
10.
go back to reference Elhadad MK, Li KF, Gebali F (2020) Detecting Misleading Information on COVID-19. IEEE Access 8:165201–165215 Elhadad MK, Li KF, Gebali F (2020) Detecting Misleading Information on COVID-19. IEEE Access 8:165201–165215
12.
go back to reference Gao H, Qin X, Barroso RJD, Hussain W, Xu Y, Yin Y (2020) Collaborative Learning-based Industrial IoT API Recommendation for Software-defined Devices. The Implicit Knowledge Discovery Perspective. IEEE Transactions on Emerging Topics in Computational Intelligence Gao H, Qin X, Barroso RJD, Hussain W, Xu Y, Yin Y (2020) Collaborative Learning-based Industrial IoT API Recommendation for Software-defined Devices. The Implicit Knowledge Discovery Perspective. IEEE Transactions on Emerging Topics in Computational Intelligence
13.
go back to reference Gao H, Huang W, Duan Y (2021) The Cloud-edge-based Dynamic Reconfiguration to Service Workflow for Mobile Ecommerce Environments: A QoS Prediction Perspective. ACM Trans Internet Technol (TOIT) 21(1):1–23CrossRef Gao H, Huang W, Duan Y (2021) The Cloud-edge-based Dynamic Reconfiguration to Service Workflow for Mobile Ecommerce Environments: A QoS Prediction Perspective. ACM Trans Internet Technol (TOIT) 21(1):1–23CrossRef
14.
go back to reference Grave E, Bojanowski P, Gupta P, Joulin A, Mikolov T (2018) Learning word vectors for 157 languages. in: Proceedings of the eleventh international conference on language resources and evaluation (LREC 2018). European Language Resources Association (ELRA) Grave E, Bojanowski P, Gupta P, Joulin A, Mikolov T (2018) Learning word vectors for 157 languages. in: Proceedings of the eleventh international conference on language resources and evaluation (LREC 2018). European Language Resources Association (ELRA)
15.
go back to reference Gretton A, Borgwardt KM, Rasch MJ, Schölkopf B, Smola A (2012) A kernel Two-Sample test. J Mach Learn Res 13(25):723–773MathSciNetMATH Gretton A, Borgwardt KM, Rasch MJ, Schölkopf B, Smola A (2012) A kernel Two-Sample test. J Mach Learn Res 13(25):723–773MathSciNetMATH
16.
go back to reference Gui L, Jia L, Zhou J, Xu R, He Y (2020) Multi-Task Learning with mutual learning for joint sentiment classification and topic detection. IEEE Trans Knowl Data Eng:1–1 Gui L, Jia L, Zhou J, Xu R, He Y (2020) Multi-Task Learning with mutual learning for joint sentiment classification and topic detection. IEEE Trans Knowl Data Eng:1–1
17.
go back to reference Hai-Tao Z, Jin-Yuan C, Yao X, Sangaiah AK, Jiang Y, Zhao CZ (2018) Clickbait convolutional neural network. Symmetry 10(5):138CrossRef Hai-Tao Z, Jin-Yuan C, Yao X, Sangaiah AK, Jiang Y, Zhao CZ (2018) Clickbait convolutional neural network. Symmetry 10(5):138CrossRef
18.
go back to reference Han X, Li B, Wang Z (2019) An attention-based neural framework for uncertainty identification on social media texts. Tsinghua Sci Technol 25(1):117–126CrossRef Han X, Li B, Wang Z (2019) An attention-based neural framework for uncertainty identification on social media texts. Tsinghua Sci Technol 25(1):117–126CrossRef
19.
go back to reference Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef Hochreiter S, Schmidhuber J (1997) Long short-term memory. Neural Comput 9(8):1735–1780CrossRef
20.
go back to reference Hu X, Wang R, Zhou D, Xiong Y (2020) Neural topic modeling with cycle-consistent adversarial training. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 9018–9030 Hu X, Wang R, Zhou D, Xiong Y (2020) Neural topic modeling with cycle-consistent adversarial training. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 9018–9030
21.
go back to reference Huang Y, Xu H, Gao H, Ma X, Hussain W (2021) Ssur: an approach to optimizing virtual machine allocation strategy based on user requirements for cloud data center. IEEE Trans Green Commun Netw 5(2):670–681CrossRef Huang Y, Xu H, Gao H, Ma X, Hussain W (2021) Ssur: an approach to optimizing virtual machine allocation strategy based on user requirements for cloud data center. IEEE Trans Green Commun Netw 5(2):670–681CrossRef
22.
go back to reference Jain G, Sharma M, Agarwal B (2019) Spam detection in social media using convolutional and long short term memory neural network. Ann Math Artif Intell 85(1):21–44CrossRef Jain G, Sharma M, Agarwal B (2019) Spam detection in social media using convolutional and long short term memory neural network. Ann Math Artif Intell 85(1):21–44CrossRef
23.
go back to reference Kumar V, Khattar D, Gairola S, Kumar Lal Y, Varma V (2018) Identifying Clickbait: A Multi-Strategy Approach Using Neural Networks. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, pp 1225–1228 Kumar V, Khattar D, Gairola S, Kumar Lal Y, Varma V (2018) Identifying Clickbait: A Multi-Strategy Approach Using Neural Networks. In: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval, pp 1225–1228
24.
go back to reference Lafferty J, Lebanon G (2002) Information Diffusion Kernels. In: Proceedings of the 15th International Conference on Neural Information Processing Systems, pp 391–398 Lafferty J, Lebanon G (2002) Information Diffusion Kernels. In: Proceedings of the 15th International Conference on Neural Information Processing Systems, pp 391–398
25.
go back to reference Li G, Peng S, Wang C, Niu J, Yuan Y (2018) An energy-efficient data collection scheme using denoising autoencoder in wireless sensor networks. Tsinghua Sci Technol 24(1):86–96CrossRef Li G, Peng S, Wang C, Niu J, Yuan Y (2018) An energy-efficient data collection scheme using denoising autoencoder in wireless sensor networks. Tsinghua Sci Technol 24(1):86–96CrossRef
26.
go back to reference Liu L, Lu Y, Luo Y, Zhang R, Itti L, Lu J (2016) Detecting “Smart” Spammers on Social Network: A Topic Model Approach. In: Proceedings of the NAACL Student Research Workshop, pp 45–50 Liu L, Lu Y, Luo Y, Zhang R, Itti L, Lu J (2016) Detecting “Smart” Spammers on Social Network: A Topic Model Approach. In: Proceedings of the NAACL Student Research Workshop, pp 45–50
27.
go back to reference Luong MT, Pham H, Manning CD (2015) Effective Approaches to Attention-based Neural Machine Translation. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp 1412–1421 Luong MT, Pham H, Manning CD (2015) Effective Approaches to Attention-based Neural Machine Translation. In: Proceedings of the 2015 Conference on Empirical Methods in Natural Language Processing, pp 1412–1421
28.
go back to reference Metsis V, Androutsopoulos I, Paliouras G (2006) Spam filtering with naive Bayes-Which naive bayes? In: CEAS, vol 17, pp 28–69. Mountain View, CA Metsis V, Androutsopoulos I, Paliouras G (2006) Spam filtering with naive Bayes-Which naive bayes? In: CEAS, vol 17, pp 28–69. Mountain View, CA
29.
go back to reference Miao Y, Yu L, Blunsom P (2016) Neural variational inference for text processing. In: International Conference on Machine Learning. PMLR, pp 1727–1736 Miao Y, Yu L, Blunsom P (2016) Neural variational inference for text processing. In: International Conference on Machine Learning. PMLR, pp 1727–1736
30.
go back to reference Mikolov T, Sutskever I, Chen K, Corrado G, Dean J (2013) Distributed Representations of Words and Phrases and their Compositionality. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, vol 2, pp 3111–3119 Mikolov T, Sutskever I, Chen K, Corrado G, Dean J (2013) Distributed Representations of Words and Phrases and their Compositionality. In: Proceedings of the 26th International Conference on Neural Information Processing Systems, vol 2, pp 3111–3119
31.
go back to reference Nan F, Ding R, Nallapati R, Xiang B (2019) Topic modeling with wasserstein autoencoders. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics. Florence, Italy, pp 6345–6381 Nan F, Ding R, Nallapati R, Xiang B (2019) Topic modeling with wasserstein autoencoders. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics. Florence, Italy, pp 6345–6381
32.
go back to reference Pennington J, Socher R, Manning CD (2014) GloVe: Global Vectors for Word Representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 1532–1543 Pennington J, Socher R, Manning CD (2014) GloVe: Global Vectors for Word Representation. In: Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 1532–1543
33.
go back to reference Potthast M, Gollub T, Komlossy K, Schuster S, Wiegmann M, Fernandez EPG, Hagen M, Stein B (2018) Crowdsourcing a large corpus of clickbait on twitter. In: Proceedings of the 27th International Conference on Computational Linguistics, pp 1498–1507 Potthast M, Gollub T, Komlossy K, Schuster S, Wiegmann M, Fernandez EPG, Hagen M, Stein B (2018) Crowdsourcing a large corpus of clickbait on twitter. In: Proceedings of the 27th International Conference on Computational Linguistics, pp 1498–1507
34.
go back to reference Röder M, Both A, Hinneburg A (2015) Exploring the Space of Topic Coherence Measures. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp 399–408 Röder M, Both A, Hinneburg A (2015) Exploring the Space of Topic Coherence Measures. In: Proceedings of the Eighth ACM International Conference on Web Search and Data Mining, pp 399–408
35.
go back to reference Song L, Lau RYK, Kwok RCW, Mirkovski K, Dou W (2017) Who are the spoilers in social media marketing? Incremental learning of latent semantics for social spam detection. Electron Commerce Res 17(1):51–81CrossRef Song L, Lau RYK, Kwok RCW, Mirkovski K, Dou W (2017) Who are the spoilers in social media marketing? Incremental learning of latent semantics for social spam detection. Electron Commerce Res 17(1):51–81CrossRef
36.
go back to reference Srivastava A, Sutton C (2017) Autoencoding variational inference for topic models. In: International Conference on Learning Representations Srivastava A, Sutton C (2017) Autoencoding variational inference for topic models. In: International Conference on Learning Representations
37.
go back to reference Tolstikhin I, Bousquet O, Gelly S, Schoelkopf B (2018) Wasserstein Auto-Encoders. In: International Conference on Learning Representations Tolstikhin I, Bousquet O, Gelly S, Schoelkopf B (2018) Wasserstein Auto-Encoders. In: International Conference on Learning Representations
38.
go back to reference Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Polosukhin I (2017) Attention is All you Need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp 6000–6010 Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN, Kaiser Polosukhin I (2017) Attention is All you Need. In: Proceedings of the 31st International Conference on Neural Information Processing Systems, pp 6000–6010
39.
go back to reference Villani C (2003) Topics in Optimal Transportation, vol 58. American Mathematical Society Villani C (2003) Topics in Optimal Transportation, vol 58. American Mathematical Society
40.
go back to reference Wallach HM, Mimno D, McCallum A (2009) Rethinking LDA: Why Priors Matter. In: Proceedings of the 22nd International Conference on Neural Information Processing Systems, pp 1973–1981 Wallach HM, Mimno D, McCallum A (2009) Rethinking LDA: Why Priors Matter. In: Proceedings of the 22nd International Conference on Neural Information Processing Systems, pp 1973–1981
41.
go back to reference Wang C, Wang B (2020) An End-to-end Topic-Enhanced Self-Attention Network for Social Emotion Classification. In: Proceedings of The Web Conference, vol 2020, pp 2210–2219 Wang C, Wang B (2020) An End-to-end Topic-Enhanced Self-Attention Network for Social Emotion Classification. In: Proceedings of The Web Conference, vol 2020, pp 2210–2219
42.
go back to reference Wang R, Deyu Z, He Y (2019a) Open Event Extraction from Online Text using a Generative Adversarial Network. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp 282–291 Wang R, Deyu Z, He Y (2019a) Open Event Extraction from Online Text using a Generative Adversarial Network. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP), pp 282–291
43.
go back to reference Wang R, Zhou D, He Y (2019b) ATM: Adversarial-Neural Topic Model. Inf Process Manag 56(6):102098 Wang R, Zhou D, He Y (2019b) ATM: Adversarial-Neural Topic Model. Inf Process Manag 56(6):102098
44.
go back to reference Wang R, Hu X, Zhou D, He Y, Xiong Y, Ye C, Xu H (2020) Neural topic modeling with bidirectional adversarial training. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics. Online, pp 340–350 Wang R, Hu X, Zhou D, He Y, Xiong Y, Ye C, Xu H (2020) Neural topic modeling with bidirectional adversarial training. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics. Online, pp 340–350
45.
go back to reference Wang Y, Huang M, Zhu X, Zhao L (2016) Attention-based LSTM for Aspect-level Sentiment Classification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp 606–615 Wang Y, Huang M, Zhu X, Zhao L (2016) Attention-based LSTM for Aspect-level Sentiment Classification. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, pp 606–615
46.
go back to reference Yang X, Zhou S, Cao M (2020) An approach to alleviate the sparsity problem of hybrid collaborative filtering based recommendations: The product-attribute perspective from user reviews. Mob Netw Appl 25(2) Yang X, Zhou S, Cao M (2020) An approach to alleviate the sparsity problem of hybrid collaborative filtering based recommendations: The product-attribute perspective from user reviews. Mob Netw Appl 25(2)
47.
go back to reference Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 1480–1489 Yang Z, Yang D, Dyer C, He X, Smola A, Hovy E (2016) Hierarchical attention networks for document classification. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp 1480–1489
48.
go back to reference Yin Y, Cao Z, Xu Y, Gao H, Li R, Mai Z (2020) Qos Prediction for Service Recommendation With Features Learning in Mobile Edge Computing Environment. IEEE Trans Cogn Commun Netw 6(4):1136–1145CrossRef Yin Y, Cao Z, Xu Y, Gao H, Li R, Mai Z (2020) Qos Prediction for Service Recommendation With Features Learning in Mobile Edge Computing Environment. IEEE Trans Cogn Commun Netw 6(4):1136–1145CrossRef
49.
go back to reference Zhou D, Hu X, Wang R (2020) Neural topic modeling by incorporating document relationship graph. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 3790–3796 Zhou D, Hu X, Wang R (2020) Neural topic modeling by incorporating document relationship graph. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp 3790–3796
50.
go back to reference Zhu Y, Zhang W, Chen Y, Gao H (2019) A novel approach to workload prediction using attention-based lstm encoder-decoder network in cloud environment. EURASIP J Wirel Commun Netw 2019(1):1–18CrossRef Zhu Y, Zhang W, Chen Y, Gao H (2019) A novel approach to workload prediction using attention-based lstm encoder-decoder network in cloud environment. EURASIP J Wirel Commun Netw 2019(1):1–18CrossRef
Metadata
Title
TA-BiLSTM: An Interpretable Topic-Aware Model for Misleading Information Detection in Mobile Social Networks
Authors
Shuyu Chang
Rui Wang
Haiping Huang
Jian Luo
Publication date
10-11-2021
Publisher
Springer US
Published in
Mobile Networks and Applications / Issue 6/2021
Print ISSN: 1383-469X
Electronic ISSN: 1572-8153
DOI
https://doi.org/10.1007/s11036-021-01847-w

Other articles of this Issue 6/2021

Mobile Networks and Applications 6/2021 Go to the issue