Skip to main content
Top
Published in: Optical Memory and Neural Networks 1/2024

01-03-2024

Multi-Modal Co-Attention Capsule Network for Fake News Detection

Authors: Chunyan Yin, Yongheng Chen

Published in: Optical Memory and Neural Networks | Issue 1/2024

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Most of the existing fake news identification models mainly focused on exploiting multi-modal features to enhanced performance recently. This paper proposes Multi-modal Co-Attention Capsules Network (MCCN) for fake news detection, which consists mainly of feature extraction layer, feature fusion layer and classification layer. Feature extraction layer achieves the features building of users’ profiles, multi-modal source news and comments. Feature fusion layer adopts a dual parallel Cross-Modal Co-Attentional to fuse multi-modal interactions between source news text and its attached image, Hierarchical Co-Attention to fuse the interactions among user information, source news content and comments. Classification layer adopts capsules network to realize false information identification. Experimental results on three widely used large-scale datasets show that MCCN can achieve the excellent performance by comparing with other baselines.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literature
1.
go back to reference Ma, J., Gao, W., Wei, Z.Y., Lu, Y.M., and Wong, K.F., Detect rumors using time series of social context information on microblogging websites, in Proceedings of ACM on CIKM, 2015, pp. 1751–1754. Ma, J., Gao, W., Wei, Z.Y., Lu, Y.M., and Wong, K.F., Detect rumors using time series of social context information on microblogging websites, in Proceedings of ACM on CIKM, 2015, pp. 1751–1754.
2.
go back to reference Liu, X.M., Armineh, N., Li, Q.Z., Rui, F., and Sameena, S., Real-time rumor debunking on twitter, in Proceedings of ACM on CIKM, 2015, pp. 867–1870. Liu, X.M., Armineh, N., Li, Q.Z., Rui, F., and Sameena, S., Real-time rumor debunking on twitter, in Proceedings of ACM on CIKM, 2015, pp. 867–1870.
3.
go back to reference Ma, J., Gao, W., and Wong, K.F., Detect rumors in microblog posts using propagation structure via kernel learning, in Proceeding of the ACL, 2017. Ma, J., Gao, W., and Wong, K.F., Detect rumors in microblog posts using propagation structure via kernel learning, in Proceeding of the ACL, 2017.
4.
go back to reference Liu, Y. and Wu, Y.F., Early detection of fake news on social media through propagation path classification with recurrent and convolutional networks, in AAAI on Artificial Intelligence, 2018, pp. 254–261. Liu, Y. and Wu, Y.F., Early detection of fake news on social media through propagation path classification with recurrent and convolutional networks, in AAAI on Artificial Intelligence, 2018, pp. 254–261.
5.
go back to reference Yin, C.Y., Chen, Y.H., and Zuo, W.L., Multi-task deep neural networks for joint sarcasm detection and sentiment analysis, Pattern Recognit. Image Anal., 2021, no. 31, pp. 103–108. Yin, C.Y., Chen, Y.H., and Zuo, W.L., Multi-task deep neural networks for joint sarcasm detection and sentiment analysis, Pattern Recognit. Image Anal., 2021, no. 31, pp. 103–108.
6.
go back to reference Chen, Y.H., Yin, C.Y., and Zuo, W.L., Multi-task learning for stance and early rumor detection, Opt. Mem. Neural Networks, 2021, no. 30, pp. 131–139. Chen, Y.H., Yin, C.Y., and Zuo, W.L., Multi-task learning for stance and early rumor detection, Opt. Mem. Neural Networks, 2021, no. 30, pp. 131–139.
7.
go back to reference Bian, T., Xiao, X., and Xu, T., Rumor detection on social media with bi-directional graph convolutional networks, AAAI Artif. Intell., 2020, no. 34, pp. 549–556. Bian, T., Xiao, X., and Xu, T., Rumor detection on social media with bi-directional graph convolutional networks, AAAI Artif. Intell., 2020, no. 34, pp. 549–556.
8.
go back to reference Tu, K.F., Chen, C., Hou, C.Y., Yuan, J., Li, J.D., and Yuan, X.J., Rumor2vec: A rumor detection framework with joint text and propagation structure representation learning, Inf. Sci., 2021, no. 560, pp. 137–151. Tu, K.F., Chen, C., Hou, C.Y., Yuan, J., Li, J.D., and Yuan, X.J., Rumor2vec: A rumor detection framework with joint text and propagation structure representation learning, Inf. Sci., 2021, no. 560, pp. 137–151.
9.
go back to reference Xu, S.Z., Liu, X.D., Ma, K., Dong, F.M., Xiang, S.Z., and Bing, C.H., Rumor detection on microblogs using dual-grained feature via graph neural networks, AAAI Artif. Intell., 2021, pp. 205–216.CrossRef Xu, S.Z., Liu, X.D., Ma, K., Dong, F.M., Xiang, S.Z., and Bing, C.H., Rumor detection on microblogs using dual-grained feature via graph neural networks, AAAI Artif. Intell., 2021, pp. 205–216.CrossRef
10.
go back to reference Bi, B., Wang, Y., Zhang, H., et al., Microblog-HAN: A micro-blog rumor detection model based on heterogeneous graph attention network, PLoS One, 2022, vol. 17, no. 4, pp. 1–18.CrossRef Bi, B., Wang, Y., Zhang, H., et al., Microblog-HAN: A micro-blog rumor detection model based on heterogeneous graph attention network, PLoS One, 2022, vol. 17, no. 4, pp. 1–18.CrossRef
11.
go back to reference Yang, P., Leng, J.C., Zhao, G.Z., and Li, W.J., Rumor detection driven by graph attention capsule network on dynamic propagation structures, J. Supercomput., 2022, pp. 1–22. Yang, P., Leng, J.C., Zhao, G.Z., and Li, W.J., Rumor detection driven by graph attention capsule network on dynamic propagation structures, J. Supercomput., 2022, pp. 1–22.
12.
go back to reference Cao, J., Peng, Q., Qiang, S., Yang, T.Y., Guo, J., and Li, J.T., Exploring the role of visual content in fake news detection, Disinformation, Misinformation, and Fake News in Social Media, 2020, pp. 141–161.CrossRef Cao, J., Peng, Q., Qiang, S., Yang, T.Y., Guo, J., and Li, J.T., Exploring the role of visual content in fake news detection, Disinformation, Misinformation, and Fake News in Social Media, 2020, pp. 141–161.CrossRef
13.
go back to reference Singhal, S., Kabra, A., Sharma, M., Shah, R.R., Chakraborty, T., and Kumaraguru, P., Spotfake+: A multimodal framework for fake news detection via transfer learning, AAAI Artif. Intell., 2020, vol. 34, no. 10, pp. 3915–13916. Singhal, S., Kabra, A., Sharma, M., Shah, R.R., Chakraborty, T., and Kumaraguru, P., Spotfake+: A multimodal framework for fake news detection via transfer learning, AAAI Artif. Intell., 2020, vol. 34, no. 10, pp. 3915–13916.
14.
go back to reference Wang, Y., Qian, S., Hu, J., Fang, Q., and Xu, C., Fake news detection via knowledge-driven multimodal graph convolutional networks, in Proceedings of ICMR, 2020, pp. 540–547. Wang, Y., Qian, S., Hu, J., Fang, Q., and Xu, C., Fake news detection via knowledge-driven multimodal graph convolutional networks, in Proceedings of ICMR, 2020, pp. 540–547.
15.
go back to reference Sheng, Q.S., Hu, J., and Fang, Q., Knowledge-aware multi-modal adaptive graph convolutional networks for fake news detection, ACM Trans. Multimedia Comput., Commun., Appl., 2021, vol. 17, no. 3, pp. 1–23. Sheng, Q.S., Hu, J., and Fang, Q., Knowledge-aware multi-modal adaptive graph convolutional networks for fake news detection, ACM Trans. Multimedia Comput., Commun., Appl., 2021, vol. 17, no. 3, pp. 1–23.
16.
go back to reference Zhou, H., Ma, T., Rong, H., et al., MDMN: Multi-task and domain adaptation based multi-modal network for early rumor detection, Expert Syst. Appl., 2022, no. 195, pp. 1–11. Zhou, H., Ma, T., Rong, H., et al., MDMN: Multi-task and domain adaptation based multi-modal network for early rumor detection, Expert Syst. Appl., 2022, no. 195, pp. 1–11.
17.
go back to reference Shu, K., Zhou, X.Y., Wang, S.H., Reza, Z., and Liu, H., The role of user profiles for fake news detection, in Proceedings of IEEE ACM Conference on ASONAM, 2019, pp. 436–439. Shu, K., Zhou, X.Y., Wang, S.H., Reza, Z., and Liu, H., The role of user profiles for fake news detection, in Proceedings of IEEE ACM Conference on ASONAM, 2019, pp. 436–439.
18.
go back to reference Shu, K., Sliva, A., Wang, S., Tang, J., and Liu, H., Fake news detection on social media: A data mining perspective, ACM SIGKDD Explor. Newsl., 2017, vol. 19, no. 1, pp. 22–36.CrossRef Shu, K., Sliva, A., Wang, S., Tang, J., and Liu, H., Fake news detection on social media: A data mining perspective, ACM SIGKDD Explor. Newsl., 2017, vol. 19, no. 1, pp. 22–36.CrossRef
19.
go back to reference Liu, Y.H., Jin, X.L., Shen, H., Peng, B., and Cheng, X., A survey on rumor identification over social media, Chin. J. Comput., 2018, vol. 41, no. 7, pp. 1536–1558. Liu, Y.H., Jin, X.L., Shen, H., Peng, B., and Cheng, X., A survey on rumor identification over social media, Chin. J. Comput., 2018, vol. 41, no. 7, pp. 1536–1558.
20.
go back to reference Hamilton, W.L., Ying, R., and Leskovec, J., Inductive representation learning on large graphs, in Proceedings of Conference on NIPS, 2017, pp. 1025–1035. Hamilton, W.L., Ying, R., and Leskovec, J., Inductive representation learning on large graphs, in Proceedings of Conference on NIPS, 2017, pp. 1025–1035.
21.
go back to reference Devlin, J., Chang, M.W., Lee, K., and Toutanova, K., BERT: Pre-training of deep bidirectional transformers for language understandingm in Proceedings of Conference of the Association for Computational Linguistics on Human Language Technologies, 2019, pp. 4171–4186. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K., BERT: Pre-training of deep bidirectional transformers for language understandingm in Proceedings of Conference of the Association for Computational Linguistics on Human Language Technologies, 2019, pp. 4171–4186.
22.
go back to reference Cho, K., Merrienboer, B., Gulcehre, C., Bougares, F., et al., Learning phrase tepresentations using RNN encoder-decoder for statistical machine translation, in Proceedings of Conference on EMNLP, 2014, pp. 1724–1734. Cho, K., Merrienboer, B., Gulcehre, C., Bougares, F., et al., Learning phrase tepresentations using RNN encoder-decoder for statistical machine translation, in Proceedings of Conference on EMNLP, 2014, pp. 1724–1734.
23.
go back to reference Vaswani, A., Shazeer, N., Parmar, N., et al., Attention is all you need, in Proceedings of Conference on NIPS, 2017, pp. 5998–6008. Vaswani, A., Shazeer, N., Parmar, N., et al., Attention is all you need, in Proceedings of Conference on NIPS, 2017, pp. 5998–6008.
24.
go back to reference Yang, M., Zhao, W., Ye, J., Lei, Z.Y., Zhao, Z., and Zhang, S., Investigating capsule networks with dynamic routing for text classification, in Proceedings of Conference on EMNLP, 2018, pp. 3110–3119. Yang, M., Zhao, W., Ye, J., Lei, Z.Y., Zhao, Z., and Zhang, S., Investigating capsule networks with dynamic routing for text classification, in Proceedings of Conference on EMNLP, 2018, pp. 3110–3119.
25.
go back to reference Sabour, S., Frosst, N., and Hinton, G.E., Dynamic routing between capsules, in Proceedings of Conference on NIPS, 2017, pp. 3856–3866. Sabour, S., Frosst, N., and Hinton, G.E., Dynamic routing between capsules, in Proceedings of Conference on NIPS, 2017, pp. 3856–3866.
26.
go back to reference Jin, Z.W., Cao, J., Guo, H., Zhang, Y.D., and Luo, J., Multimodal fusion with recurrent neural networks for rumor detection on microblogs, in Proceedings of ACM on Multimedia, 2017, pp. 795–816. Jin, Z.W., Cao, J., Guo, H., Zhang, Y.D., and Luo, J., Multimodal fusion with recurrent neural networks for rumor detection on microblogs, in Proceedings of ACM on Multimedia, 2017, pp. 795–816.
27.
go back to reference Zubiaga, A., Liakata, M., and Procter, R., Exploiting context for rumour detection in social media, in Conference on Social Informatics, 2017, pp. 109–123. Zubiaga, A., Liakata, M., and Procter, R., Exploiting context for rumour detection in social media, in Conference on Social Informatics, 2017, pp. 109–123.
28.
go back to reference Khattar, D., Goud, J.S., Gupta, M., and Varma, V., MVAE: Multimodal variational autoencoder for fake news detection, in WWW Conference, 2019, pp. 2915–2921. Khattar, D., Goud, J.S., Gupta, M., and Varma, V., MVAE: Multimodal variational autoencoder for fake news detection, in WWW Conference, 2019, pp. 2915–2921.
29.
go back to reference Yu, F., Liu, Q., Wu, S., Wang, L., and Tan, T., A Convolutional approach for misinformation identification, in Proceedings of IJCAI, 2017, pp. 3901–3907. Yu, F., Liu, Q., Wu, S., Wang, L., and Tan, T., A Convolutional approach for misinformation identification, in Proceedings of IJCAI, 2017, pp. 3901–3907.
30.
go back to reference Yao, L., Mao, C.S., and Luo, Y., Graph convolutional networks for text classification, in AAAI on Artificial Intelligence, 2019, pp. 7370–7377. Yao, L., Mao, C.S., and Luo, Y., Graph convolutional networks for text classification, in AAAI on Artificial Intelligence, 2019, pp. 7370–7377.
31.
go back to reference Wang, Y., Ma, F., Jin, Z., Yuan, Y., Xun, G., Jha, K., et al., Eann: Event adversarial neural networks for multi-modal fake news detection, in Proceedings of ACM SIGKDD on KDD, 2018, pp. 49–857 Wang, Y., Ma, F., Jin, Z., Yuan, Y., Xun, G., Jha, K., et al., Eann: Event adversarial neural networks for multi-modal fake news detection, in Proceedings of ACM SIGKDD on KDD, 2018, pp. 49–857
32.
go back to reference Zhou, X., Wu, J., and Zafarani, R., SAFE: Similarity-aware multi-modal fake news detection, in Proceedings of ACM SIGKDD on KDD, 2020, pp. 354–367. Zhou, X., Wu, J., and Zafarani, R., SAFE: Similarity-aware multi-modal fake news detection, in Proceedings of ACM SIGKDD on KDD, 2020, pp. 354–367.
33.
go back to reference Saracco, F., Clemente, D.R., Gabrielli, A., and Squartini, T., Randomizing bipartite networks: The case of the World Trade Web, Sci. Rep., 2016, vol. 5, no. 10595, pp. 1–18. Saracco, F., Clemente, D.R., Gabrielli, A., and Squartini, T., Randomizing bipartite networks: The case of the World Trade Web, Sci. Rep., 2016, vol. 5, no. 10595, pp. 1–18.
Metadata
Title
Multi-Modal Co-Attention Capsule Network for Fake News Detection
Authors
Chunyan Yin
Yongheng Chen
Publication date
01-03-2024
Publisher
Pleiades Publishing
Published in
Optical Memory and Neural Networks / Issue 1/2024
Print ISSN: 1060-992X
Electronic ISSN: 1934-7898
DOI
https://doi.org/10.3103/S1060992X24010041

Other articles of this Issue 1/2024

Optical Memory and Neural Networks 1/2024 Go to the issue

Premium Partner