Top

Multimedia Systems

Published in:

07-07-2022 | Regular Paper

Combating multimodal fake news on social media: methods, datasets, and future perspective

Authors: Sakshini Hangloo, Bhavna Arora

Published in: Multimedia Systems | Issue 6/2022

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

The growth in the use of social media platforms such as Facebook and Twitter over the past decade has significantly facilitated and improved the way people communicate with each other. However, the information that is available and shared online is not always credible. These platforms provide a fertile ground for the rapid propagation of breaking news along with other misleading information. The enormous amounts of fake news present online have the potential to trigger serious problems at an individual level and in society at large. Detecting whether the given information is fake or not is a challenging problem and the traits of social media makes the task even more complicated as it eases the generation and spread of content to the masses leading to an enormous volume of content to analyze. The multimedia nature of fake news on online platforms has not been explored fully. This survey presents a comprehensive overview of the state-of-the-art techniques for combating fake news on online media with the prime focus on deep learning (DL) techniques keeping multimodality under consideration. Apart from this, various DL frameworks, pre-trained models, and transfer learning approaches are also underlined. As till date, there are only limited multimodal datasets that are available for this task, the paper highlights various data collection strategies that can be used along with a comparative analysis of available multimodal fake news datasets. The paper also highlights and discusses various open areas and challenges in this direction.

previous article Breast density measurement methods on mammograms: a review

next article Multi-attribute object detection benchmark for smart city

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

S. Singhania, N. Fernandez, and S. Rao, “3HAN: A Deep Neural Network for Fake News Detection Sneha,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 10635 LNCS, no. October, pp. 118–125, 2017, https://doi.org/10.1007/978-3-319-70096-0_59.

H. Ahmed, I. Traore, and S. Saad, “Detection of Online Fake News Using N-Gram Analysis and Machine Learning Techniques,” First Int. Conf. Intelligent, Secur. Dependable Syst. Distrib. Cloud Environ., vol. 10618, pp. 169–181, 2017, https://doi.org/10.1007/978-3-319-69155-8.

H. Karimi and J. Tang, “Learning hierarchical discourse-level structure for fake news detection,” NAACL HLT 2019 - 2019 Conf. North Am. Chapter Assoc. Comput. Linguist. Hum. Lang. Technol. - Proc. Conf., vol. 1, pp. 3432–3442, 2019, https://doi.org/10.18653/v1/n19-1347.

Zeng, J., Zhang, Y., Ma, X.: Fake news detection for epidemic emergencies via deep correlations between text and images. Sustain. Cities Soc. 66, 102652 (2021). https://doi.org/10.1016/j.scs.2020.102652CrossRef

R. Oshikawa, J. Qian, and W. Y. Wang, “A survey on natural language processing for fake news detection,” Lr. 2020 - 12th Int. Conf. Lang. Resour. Eval. Conf. Proc., pp. 6086–6093, 2020.

S. Yoon et al., “Detecting incongruity between news headline and body text via a deep hierarchical encoder,” 33rd AAAI Conf. Artif. Intell. AAAI 2019, 31st Innov. Appl. Artif. Intell. Conf. IAAI 2019 9th AAAI Symp. Educ. Adv. Artif. Intell. EAAI 2019, pp. 791–800, 2019, https://doi.org/10.1609/aaai.v33i01.3301791.

Bodaghi, A., Oliveira, J.: The characteristics of rumor spreaders on Twitter: a quantitative analysis on real data. Comput. Commun. 160, 674–687 (2020). https://doi.org/10.1016/j.comcom.2020.07.017CrossRef

S. Kwon, M. Cha, K. Jung, W. Chen, and Y. Wang, “Prominent features of rumor propagation in online social media,” Proc. - IEEE Int. Conf. Data Mining, ICDM, pp. 1103–1108, 2013, https://doi.org/10.1109/ICDM.2013.61.

Rath, B., Gao, W., Ma, J., Srivastava, J.: From Retweet to Believability: Utilizing Trust to Identify Rumor Spreaders on Twitter. Soc. Netw. Anal. Min. 8(1), 179–186 (2018). https://doi.org/10.1007/s13278-018-0540-zCrossRef

10.

K. Shu, H. R. Bernard, and H. Liu, “Studying Fake News via Network Analysis: Detection and Mitigation,” no. January, pp. 43–65, 2019, https://doi.org/10.1007/978-3-319-94105-9_3.

11.

Wu, Z., Pi, D., Chen, J., Xie, M., Cao, J.: Rumor detection based on propagation graph neural network with attention mechanism. Expert Syst. Appl. 158, 113595 (2020). https://doi.org/10.1016/j.eswa.2020.113595CrossRef

12.

Zubiaga, A., et al.: Analysing how people orient to and spread rumours in social media by looking at conversational threads. PLoS ONE 11(3), 1–29 (2016). https://doi.org/10.1371/journal.pone.0150989CrossRef

13.

K. Shu, S. Wang, and H. Liu, “Understanding User Profiles on Social Media for Fake News Detection,” Proc.—IEEE 1st Conf. Multimed. Inf. Process. Retrieval, MIPR 2018, pp. 430–435, Jun. 2018, https://doi.org/10.1109/MIPR.2018.00092.

14.

K. Shu, X. Zhou, S. Wang, R. Zafarani, and H. Liu, “The role of user profiles for fake news detection,” Proc. 2019 IEEE/ACM Int. Conf. Adv. Soc. Networks Anal. Mining, ASONAM 2019, pp. 436–439, 2019, doi: https://doi.org/10.1145/3341161.3342927.

15.

Y. Wang et al., “EANN: Event adversarial neural networks for multi-modal fake news detection,” Proc. ACM SIGKDD Int. Conf. Knowl. Discov. Data Min., pp. 849–857, Jul. 2018, https://doi.org/10.1145/3219819.3219903.

16.

H. Zhang, Q. Fang, S. Qian, and C. Xu, “Multi-modal knowledge-aware event memory network for social media rumor detection,” MM 2019 - Proc. 27th ACM Int. Conf. Multimed., pp. 1942–1951, Oct. 2019, https://doi.org/10.1145/3343031.3350850.

17.

J. Ma et al., “Detecting rumors from microblogs with recurrent neural networks,” IJCAI Int. Jt. Conf. Artif. Intell., vol. 2016-Janua, pp. 3818–3824, 2016.

18.

K. Popat, S. Mukherjee, A. Yates, and G. Weikum, “Declare: Debunking fake news and false claims using evidence-aware deep learning,” Proc. 2018 Conf. Empir. Methods Nat. Lang. Process. EMNLP 2018, pp. 22–32, 2020, https://doi.org/10.18653/v1/d18-1003.

19.

L. Hu et al., “Compare to the knowledge: Graph neural fake news detection with external knowledge,” ACL-IJCNLP 2021 - 59th Annu. Meet. Assoc. Comput. Linguist. 11th Int. Jt. Conf. Nat. Lang. Process. Proc. Conf., pp. 754–763, 2021, https://doi.org/10.18653/v1/2021.acl-long.62.

20.

J. Ma, W. Gao, Z. Wei, Y. Lu, and K. F. Wong, “Detect rumors using time series of social context information on microblogging websites,” Int. Conf. Inf. Knowl. Manag. Proc., vol. 19–23-Oct-, no. October, pp. 1751–1754, 2015, https://doi.org/10.1145/2806416.2806607.

21.

Jiang, J., Wen, S., Yu, S., Xiang, Y., Zhou, W.: Rumor Source Identification in Social Networks with Time-Varying Topology. IEEE Trans. Dependable Secur. Comput. 15(1), 166–179 (2018). https://doi.org/10.1109/TDSC.2016.2522436CrossRef

22.

Kwon, S., Cha, M., Jung, K.: Rumor detection over varying time windows. PLoS ONE 12(1), 1–19 (2017). https://doi.org/10.1371/journal.pone.0168344CrossRef

23.

N. Ruchansky, S. Seo, and Y. Liu, “CSI: A hybrid deep model for fake news detection,” Int. Conf. Inf. Knowl. Manag. Proc., vol. Part F1318, pp. 797–806, Nov. 2017, https://doi.org/10.1145/3132847.3132877.

24.

Shin, J., Jian, L., Driscoll, K., Bar, F.F.F.: The diffusion of misinformation on social media: Temporal pattern, message, and source. Comput. Human Behav. 83, 278–287 (2018). https://doi.org/10.1016/j.chb.2018.02.008CrossRef

25.

Z. Jin, J. Cao, H. Guo, Y. Zhang, and J. Luo, “Multimodal fusion with recurrent neural networks for rumor detection on microblogs,” MM 2017 - Proc. 2017 ACM Multimed. Conf., pp. 795–816, Oct. 2017, https://doi.org/10.1145/3123266.3123454.

26.

S. Qian, J. Wang, J. Hu, Q. Fang, and C. Xu, “Hierarchical Multi-modal Contextual Attention Network for Fake News Detection,” SIGIR 2021 - Proc. 44th Int. ACM SIGIR Conf. Res. Dev. Inf. Retr., no. 1, pp. 153–162, 2021, https://doi.org/10.1145/3404835.3462871.

27.

D. Khattar, M. Gupta, J. S. Goud, and V. Varma, “MvaE: Multimodal variational autoencoder for fake news detection,” Web Conf. 2019 - Proc. World Wide Web Conf. WWW 2019, no. May, pp. 2915–2921, May 2019, https://doi.org/10.1145/3308558.3313552.

28.

S. Singhal, R. R. Shah, T. Chakraborty, P. Kumaraguru, and S. Satoh, “SpotFake: A multi-modal framework for fake news detection,” Proc.—2019 IEEE 5th Int. Conf. Multimed. Big Data, BigMM 2019, pp. 39–47, Sep. 2019, https://doi.org/10.1109/BigMM.2019.00-44.

29.

Shah, D., Zaman, T.: Finding rumor sources on random trees. Oper. Res. 64(3), 736–755 (2016). https://doi.org/10.1287/opre.2015.1455MathSciNetCrossRefMATH

30.

Shelke, S., Attar, V.: Source detection of rumor in social network—a review. Online Soc. Netw Media 9, 30–42 (2019). https://doi.org/10.1016/j.osnem.2018.12.001CrossRef

31.

D. Kr, “On Rumor Source Detection and Its,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 1, no. 840, pp. 110–119, 2017, doi: https://doi.org/10.1007/978-3-319-54472-4.

32.

Sam Spencer and R. Srikant, “Maximum likelihood rumor source detection in a star network.”

33.

Xu, F., Sheng, V.S., Wang, M.: Near real-time topic-driven rumor detection in source microblogs. Knowledge-Based Syst. 207, 106391 (2020). https://doi.org/10.1016/j.knosys.2020.106391CrossRef

34.

K. Popat, S. Mukherjee, J. Strötgen, and G. Weikum, “Where the truth lies: Explaining the credibility of emerging claims on the web and social media,” 26th Int. World Wide Web Conf. 2017, WWW 2017 Companion, pp. 1003–1012, 2017, https://doi.org/10.1145/3041021.3055133.

35.

C. Cai, L. Li, and D. Zeng, “Detecting social bots by jointly modeling deep behavior and content information,” Int. Conf. Inf. Knowl. Manag. Proc., vol. Part F1318, pp. 1995–1998, 2017, https://doi.org/10.1145/3132847.3133050.

36.

M. Orabi, D. Mouheb, Z. Al Aghbari, and I. Kamel, “Detection of Bots in Social Media: A Systematic Review,” Inf. Process. Manag., vol. 57, no. 4, p. 102250, 2020, https://doi.org/10.1016/j.ipm.2020.102250.

37.

Kudugunta, S., Ferrara, E.: Deep neural networks for bot detection. Inf. Sci. (Ny) 467, 312–322 (2018). https://doi.org/10.1016/j.ins.2018.08.019CrossRef

38.

G. Gorrell, K. Bontcheva, L. Derczynski, E. Kochkina, M. Liakata, and A. Zubiaga, “RumourEval 2019: Determining rumour veracity and support for rumours,” arXiv, pp. 69–76, 2018.

39.

G. Gorrell et al., “SemEval-2019 Task 7: RumourEval, Determining Rumour Veracity and Support for Rumours,” pp. 845–854, 2019, https://doi.org/10.18653/v1/s19-2147.

40.

W. Ferreira and A. Vlachos, “Emergent: A novel data-set for stance classification,” 2016 Conf. North Am. Chapter Assoc. Comput. Linguist. Hum. Lang. Technol. NAACL HLT 2016 - Proc. Conf., no. 1, pp. 1163–1168, 2016, https://doi.org/10.18653/v1/n16-1138.

41.

J. Ma, W. Gao, and K. F. Wong, “Detect Rumor and Stance Jointly by Neural Multi-task Learning,” Web Conf. 2018 - Companion World Wide Web Conf. WWW 2018, pp. 585–593, 2018, https://doi.org/10.1145/3184558.3188729.

42.

S. Dungs, A. Aker, N. Fuhr, and K. Bontcheva, “Can Rumour Stance Alone Predict Veracity?,” Proc. 27th Int. Conf. Comput. Linguist., pp. 3360–3370, 2018, [Online]. https://aclweb.org/anthology/papers/C/C18/C18-1284/.

43.

S. M. Mohammad, P. Sobhani, and S. Kiritchenko, “Stance and sentiment in Tweets,” ACM Trans. Internet Technol., vol. 17, no. 3, 2017, https://doi.org/10.1145/3003433.

44.

Rubin, V.L., Chen, Y., Conroy, N.J.: Deception detection for news: Three types of fakes. Proc. Assoc. Inf. Sci. Technol. 52(1), 1–4 (2015). https://doi.org/10.1002/pra2.2015.145052010083CrossRef

45.

F. Yang, X. Yu, Y. Liu, and M. Yang, “Automatic detection of rumor on Sina Weibo,” Proc. ACM SIGKDD Int. Conf. Knowl. Discov. Data Min., 2012, https://doi.org/10.1145/2350190.2350203.

46.

Boididou, C., Papadopoulos, S., Zampoglou, M., Apostolidis, L., Papadopoulou, O., Kompatsiaris, Y.: Detection and visualization of misleading content on Twitter. Int. J. Multimed. Inf. Retr. 7(1), 71–86 (2018). https://doi.org/10.1007/s13735-017-0143-xCrossRef

47.

Boididou, C., et al.: Verifying information with multimedia content on twitter: a comparative study of automated approaches. Multimed. Tools Appl. 77(12), 15545–15571 (2018). https://doi.org/10.1007/s11042-017-5132-9CrossRef

48.

Kakol, M., Nielek, R., Wierzbicki, A.: Understanding and predicting Web content credibility using the Content Credibility Corpus. Inf. Process. Manag. 53(5), 1043–1061 (2017). https://doi.org/10.1016/j.ipm.2017.04.003CrossRef

49.

M. Potthast, J. Kiesel, K. Reinartz, J. Bevendorff, and B. Stein, “A stylometric inquiry into hyperpartisan and fake news,” ACL 2018—56th Annu. Meet. Assoc. Comput. Linguist. Proc. Conf. (Long Pap., vol. 1, pp. 231–240, 2018, https://doi.org/10.18653/v1/p18-1022.

50.

P. Qi, J. Cao, T. Yang, J. Guo, and J. Li, “Exploiting multi-domain visual information for fake news detection,” Proc. - IEEE Int. Conf. Data Mining, ICDM, vol. 2019-Novem, pp. 518–527, 2019, https://doi.org/10.1109/ICDM.2019.00062.

51.

X. Zhou and R. Zafarani, “Network-based fake news detection: a pattern-driven approach,” arXiv, 2019, https://doi.org/10.1145/3373464.3373473.

52.

Fire, M., Kagan, D., Elyashar, A., Elovici, Y.: Friend or foe? Fake profile identification in online social networks. Soc. Netw. Anal. Min. 4(1), 1–23 (2014). https://doi.org/10.1007/s13278-014-0194-4CrossRef

53.

M. Del Vicario, W. Quattrociocchi, A. Scala, and F. Zollo, “Polarization and fake news: Early warning of potential misinformation targets,” arXiv, vol. 13, no. 2, 2018, https://doi.org/10.1145/3316809.

54.

K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” 3rd Int. Conf. Learn. Represent. ICLR 2015—Conf. Track Proc., pp. 1–14, 2015.

55.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 2016-Decem, pp. 770–778, 2016, https://doi.org/10.1109/CVPR.2016.90.

56.

C. Szegedy et al., “Going deeper with convolutions,” Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., vol. 07–12-June, pp. 1–9, 2015, https://doi.org/10.1109/CVPR.2015.7298594.

57.

J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” NAACL HLT 2019 - 2019 Conf. North Am. Chapter Assoc. Comput. Linguist. Hum. Lang. Technol.—Proc. Conf., vol. 1, no. Mlm, pp. 4171–4186, 2019.

58.

Z. Yang, Z. Dai, Y. Yang, J. Carbonell, R. Salakhutdinov, and Q. V. Le, “XLNet: Generalized autoregressive pretraining for language understanding,” Adv. Neural Inf. Process. Syst., vol. 32, no. NeurIPS, pp. 1–18, 2019.

59.

Jin, Z., et al.: Novel visual and statistical image features for microblogs news verification. IEEE Trans. Multimed. 19(3), 598–608 (2017). https://doi.org/10.1109/TMM.2016.2617078CrossRef

60.

K. Shu, A. Sliva, S. Wang, J. Tang, and H. Liu, “Fake news detection on social media: A data mining perspective,” arXiv, vol. 19, no. 1, pp. 22–36, 2017, https://doi.org/10.1145/3137597.3137600.

61.

A. Zubiaga, A. Aker, K. Bontcheva, M. Liakata, and R. Procter, “Detection and resolution of rumours in social media: A survey,” arXiv, vol. 51, no. 2, 2017.

62.

J. Cao, J. Guo, X. Li, Z. Jin, H. Guo, and J. Li, “Automatic Rumor Detection on Microblogs: A Survey,” vol. 1, no. c, pp. 1–14, 2018, [Online]. http://arxiv.org/abs/1807.03505.

63.

Tolosana, R., Vera-Rodriguez, R., Fierrez, J., Morales, A., Ortega-Garcia, J.: Deepfakes and beyond: A Survey of face manipulation and fake detection. Inf. Fusion 64, 131–148 (2020). https://doi.org/10.1016/j.inffus.2020.06.014CrossRef

64.

P. Meel and D. K. Vishwakarma, “Fake news, rumor, information pollution in social media and web: A contemporary survey of state-of-the-arts, challenges and opportunities,” Expert Syst. Appl., vol. 153, 2020, https://doi.org/10.1016/j.eswa.2019.112986.

65.

M. R. Islam, S. Liu, X. Wang, and G. Xu, “Deep learning for misinformation detection on online social networks: a survey and new perspectives,” Soc. Netw. Anal. Min., vol. 10, no. 1, 2020, doi: https://doi.org/10.1007/s13278-020-00696-x.

66.

X. Zhou and R. Zafarani, “A Survey of Fake News: Fundamental Theories, Detection Methods, and Opportunities,” ACM Comput. Surv., vol. 53, no. 5, 2020, https://doi.org/10.1145/3395046.

67.

Zhang, X., Ghorbani, A.A.: An overview of online fake news: characterization, detection, and discussion. Inf. Process. Manag. 57(2), 1–26 (2020). https://doi.org/10.1016/j.ipm.2019.03.004CrossRef

68.

Shu, K., et al.: “Combating disinformation in a social media age”, Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 10(6), 1–23 (2020). https://doi.org/10.1002/widm.1385CrossRef

69.

Kandasamy, N., Murugasamy, K.: Detecting and filtering rumor in social media using news media event. Concurr. Comput. Pract. Exp. 33(20), 1–10 (2021). https://doi.org/10.1002/cpe.6329CrossRef

70.

D’Ulizia, A., Caschera, M.C., Ferri, F., Grifoni, P.: Fake news detection: A survey of evaluation datasets. PeerJ Comput. Sci. 7, 1–34 (2021). https://doi.org/10.7717/PEERJ-CS.518CrossRef

71.

“fake news - Explore - Google Trends.” https://trends.google.com/trends/explore?date=2011-04-16 2021–04–16&q=fake news (accessed Jan. 04, 2022).

72.

S. Hangloo and B. Arora, “Fake News Detection Tools and Methods—A Review,” arXiv, Nov. 2021, [Online]. http://arxiv.org/abs/2112.11185.

73.

“How is Facebook addressing false information through independent fact-checkers? | Facebook Help Centre.” https://www.facebook.com/help/1952307158131536 (accessed Jan. 04, 2022).

74.

“Updating our approach to misleading information.” https://blog.twitter.com/en_us/topics/product/2020/updating-our-approach-to-misleading-information (accessed Jan. 04, 2022).

75.

“Introducing Birdwatch, a community-based approach to misinformation.” https://blog.twitter.com/en_us/topics/product/2021/introducing-birdwatch-a-community-based-approach-to-misinformation (accessed Jan. 04, 2022).

76.

H. Ahmed, I. Traore, and S. Saad, “Detection of Online Fake News Using N-Gram Analysis and Machine Learning Techniques,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 10618 LNCS, pp. 127–138, 2017, https://doi.org/10.1007/978-3-319-69155-8_9.

77.

Zhou, X., Jain, A., Phoha, V.V., Zafarani, R.: Fake news early detection. Digit. Threat. Res. Pract. 1(2), 1–25 (2020). https://doi.org/10.1145/3377478CrossRef

78.

Tuna, T., et al.: User characterization for online social networks. Soc. Netw. Anal. Min. 6(1), 1–28 (2016). https://doi.org/10.1007/s13278-016-0412-3CrossRef

79.

P. Rosso and L. C. Cagnina, “Deception Detection and Opinion Spam,” pp. 155–171, 2017, https://doi.org/10.1007/978-3-319-55394-8_8.

80.

M. Hardalov, I. Koychev, and N. Preslav, “In Search of Credible News,” Int. Conf. Artif. Intell. Methodol. Syst. Appl., pp. 172–180, 2016, https://doi.org/10.1007/978-3-319-44748-3_29.

81.

P. Galán-García, J. G. de la Puerta, C. L. Gómez, I. Santos, and P. G. Bringas, “Supervised Machine Learning for the Detection of Troll Profiles in Twitter Social Network: Application to a Real Case of Cyberbullying Patxi,” Log. J. IGPL, pp. 42–53, 2016, https://doi.org/10.1007/978-3-319-01854-6.

82.

O. Ajao, D. Bhowmik, and S. Zargari, “Fake news identification on Twitter with hybrid CNN and RNN models,” ACM Int. Conf. Proceeding Ser., pp. 226–230, Jul. 2018, doi: https://doi.org/10.1145/3217804.3217917.

83.

Umer, M., Imtiaz, Z., Ullah, S., Mehmood, A., Choi, G.S., On, B.W.: Fake news stance detection using deep learning architecture (CNN-LSTM). IEEE Access 8, 156695–156706 (2020). https://doi.org/10.1109/ACCESS.2020.3019735CrossRef

84.

Kaliyar, R.K., Goswami, A., Narang, P., Sinha, S.: FNDNet—A deep convolutional neural network for fake news detection. Cogn. Syst. Res. 61, 32–44 (2020). https://doi.org/10.1016/j.cogsys.2019.12.005CrossRef

85.

Y. Liu and Y. B. Wu, “Early Detection of Fake News on Social Media Through Propagation Path Classification with Recurrent and Convolutional Networks,” pp. 354–361.

86.

O. Varol, E. Ferrara, F. Menczer, and A. Flammini, “Early detection of promoted campaigns on social media,” EPJ Data Sci., vol. 6, no. 1, 2017, https://doi.org/10.1140/epjds/s13688-017-0111-y.

87.

Faustini, P.H.A., Covões, T.F.: Fake news detection in multiple platforms and languages. Expert Syst. Appl. 158, 113503 (2020). https://doi.org/10.1016/j.eswa.2020.113503CrossRef

88.

G. B. Guacho, S. Abdali, N. Shah, and E. E. Papalexakis, “Semi-supervised content-based detection of misinformation via tensor embeddings,” Proc. 2018 IEEE/ACM Int. Conf. Adv. Soc. Networks Anal. Mining, ASONAM 2018, no. January, pp. 322–325, 2018, https://doi.org/10.1109/ASONAM.2018.8508241.

89.

Boididou, C., et al.: Verifying Multimedia Use at MediaEval 2016. CEUR Workshop Proc. 1739, 4–6 (2016)

90.

P. Zhou, H. Xintong, V. I. Morariu, and L. S. Davis, “Learning Rich Features for Image Manipulation Detection,” Proc. IEEE Conf. Comput. Vis. Pattern Recognit., pp. 1053–1061, 2018, [Online]. Available: http://openaccess.thecvf.com/content_cvpr_2018/papers/Zhou_Learning_Rich_Features_CVPR_2018_paper.pdf%0A, http://dl.acm.org/citation.cfm?doid=3133956.3134027.

91.

Song, C., Ning, N., Zhang, Y., Wu, B.: A multimodal fake news detection model based on crossmodal attention residual and multichannel convolutional neural networks. Inf. Process. Manag. 58(1), 102437 (2021). https://doi.org/10.1016/j.ipm.2020.102437CrossRef

92.

Ying, L., Yu, H., Wang, J., Ji, Y., Qian, S.: Multi-level Multi-modal Cross-attention Network for Fake News Detection. IEEE Access 9, 132363–132373 (2021). https://doi.org/10.1109/ACCESS.2021.3114093CrossRef

93.

A. Silva, L. Luo, S. Karunasekera, and C. Leckie, “Embracing Domain Differences in Fake News: Cross-domain Fake News Detection using Multi-modal Data,” 2021, [Online]. http://arxiv.org/abs/2102.06314.

94.

A. Giachanou, G. Zhang, and P. Rosso, “Multimodal multi-image fake news detection,” Proc. - 2020 IEEE 7th Int. Conf. Data Sci. Adv. Anal. DSAA 2020, pp. 647–654, 2020, https://doi.org/10.1109/DSAA49011.2020.00091.

95.

S. Singhal, A. Kabra, M. Sharma, R. R. Shah, T. Chakraborty, and P. Kumaraguru, “SpotFake+: A multimodal framework for fake news detection via transfer learning (student abstract),” AAAI 2020 - 34th AAAI Conf. Artif. Intell., pp. 13915–13916, 2020, https://doi.org/10.1609/aaai.v34i10.7230.

96.

Ying, L., Yu, H.U.I., Wang, J., Ji, Y., Qian, S.: Fake news detection via multi-modal topic memory network. IEEE Access 9, 132818–132829 (2021). https://doi.org/10.1109/ACCESS.2021.3113981CrossRef

97.

X. Z. B, J. Wu, and R. Zafarani, “SAFE : Similarity-Aware Multi-modal Fake,” pp. 354–367, 2020, https://doi.org/10.1007/978-3-030-47436-2.

98.

L. Cui, S. Wang, and D. Lee, “Same: Sentiment-aware multi-modal embedding for detecting fake news,” Proc. 2019 IEEE/ACM Int. Conf. Adv. Soc. Networks Anal. Mining, ASONAM 2019, pp. 41–48, Aug. 2019, https://doi.org/10.1145/3341161.3342894.

99.

S. Qian, J. U. N. Hu, Q. Fang, and C. Xu, “Knowledge-aware Multi-modal Adaptive Graph Convolutional Networks for Fake News Detection,” ACM Trans. Multimed. Comput. Commun. Appl., vol. 17, no. 3, 2021, https://doi.org/10.1145/3451215.

100.

Y. Yang et al., “TI-CNN: Convolutional neural networks for fake news detection,” arXiv, 2018, [Online]. http://arxiv.org/abs/1806.00749.

101.

H. Guo, J. Cao, Y. Zhang, J. Guo, and J. Li, “Rumor detection with hierarchical social attention network,” Int. Conf. Inf. Knowl. Manag. Proc., pp. 943–952, Oct. 2018, doi: https://doi.org/10.1145/3269206.3271709.

102.

C. Shao, G. L. Ciampaglia, O. Varol, K. C. Yang, A. Flammini, and F. Menczer, “The spread of low-credibility content by social bots,” Nat. Commun., vol. 9, no. 1, 2018, https://doi.org/10.1038/s41467-018-06930-7.

103.

T. N. Nguyen, C. Li, and C. Niederée, “On early-stage debunking rumors on twitter: Leveraging the wisdom of weak learners,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 10540 LNCS, pp. 141–158, 2017, https://doi.org/10.1007/978-3-319-67256-4_13.

104.

S. Ahmed, K. Hinkelmann, and F. Corradini, “Combining machine learning with knowledge engineering to detect fake news in social networks - A survey,” CEUR Workshop Proc., vol. 2350, 2019.

105.

E. Ortega-fernández, G. Padilla-castillo, S. L. Carcelén-garcía, and M. Arias-oliva, “fact checking agencies and processes to fight against fake news,” pp. 219–228, 2020.

106.

W. Y. Wang, “‘Liar, liar pants on fire’: A new benchmark dataset for fake news detection,” ACL 2017 - 55th Annu. Meet. Assoc. Comput. Linguist. Proc. Conf. (Long Pap., vol. 2, pp. 422–426, 2017, https://doi.org/10.18653/v1/P17-2067.

107.

A. Zubiaga, M. Liakata, R. Procter, G. Wong Sak Hoi, and P. Tolmie, “Analysing how people orient to and spread rumours in social media by looking at conversational threads,” PLoS One, vol. 11, no. 3, pp. 1–29, 2016, https://doi.org/10.1371/journal.pone.0150989.

108.

Hakak, S., Alazab, M., Khan, S., Gadekallu, T.R., Maddikunta, P.K.R., Khan, W.Z.: An ensemble machine learning approach through effective feature extraction to classify fake news. Futur. Gener. Comput. Syst. 117, 47–58 (2021). https://doi.org/10.1016/j.future.2020.11.022CrossRef

109.

F. Monti, F. Frasca, D. Eynard, D. Mannion, and M. M. Bronstein, “Fake News Detection on Social Media using Geometric Deep Learning,” arXiv, pp. 1–15, Feb. 2019, [Online]. http://arxiv.org/abs/1902.06673.

110.

Meel, P., Vishwakarma, D.K.: HAN, image captioning, and forensics ensemble multimodal fake news detection. Inf. Sci. (Ny) 567, 23–41 (2021). https://doi.org/10.1016/j.ins.2021.03.037MathSciNetCrossRef

111.

P. Meel and D. K. Vishwakarma, “Multi-modal Fusion using Fine-tuned Self- attention and Transfer Learning for Veracity Analysis of Web Information.”

112.

V. H. Nguyen, K. Sugiyama, P. Nakov, and M. Y. Kan, “FANG: Leveraging Social Context for Fake News Detection Using Graph Representation,” Int. Conf. Inf. Knowl. Manag. Proc., pp. 1165–1174, 2020, https://doi.org/10.1145/3340531.3412046.

113.

Wang, Z., Guo, Y.: Rumor events detection enhanced by encoding sentimental information into time series division and word representations. Neurocomputing 397, 224–243 (2020). https://doi.org/10.1016/j.neucom.2020.01.095CrossRef

114.

S. Singhal, “SpotFake : A Multi-modal Framework for Fake News Detection,” 2015.

115.

J. Z. Pan, S. Pavlova, C. Li, N. Li, Y. Li, and J. Liu, “Content based fake news detection using knowledge graphs,” Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 11136 LNCS, pp. 669–683, 2018, https://doi.org/10.1007/978-3-030-00671-6_39.

116.

C. Boididou, S. Papadopoulos, L. Apostolidis, and Y. Kompatsiaris, “Learning to detect misleading content on Twitter,” ICMR 2017 - Proc. 2017 ACM Int. Conf. Multimed. Retr., pp. 278–286, 2017, https://doi.org/10.1145/3078971.3078979.

117.

K. Zhou, C. Shu, B. Li, and J. H. Lau, “Evaluating Event Credibility on Twitter,” NAACL HLT 2019 - 2019 Conf. North Am. Chapter Assoc. Comput. Linguist. Hum. Lang. Technol. - Proc. Conf., vol. 1, pp. 1614–1623, 2019, https://doi.org/10.18653/v1/n19-1163.

118.

K. Shu, S. Wang, and H. Liu, “Beyond news contents: The role of social context for fake news detection,” arXiv, no. i, pp. 312–320, 2019, https://doi.org/10.1145/3289600.3290994.

119.

K. Shu, H. Russell Bernard, and H. Liu, “Studying fake news via network analysis: Detection and mitigation,” arXiv, pp. 836–837, 2018, https://doi.org/10.1007/978-3-319-94105-9_3.

120.

Shu, K., Mahudeswaran, D., Wang, S., Lee, D., Liu, H.: FakeNewsNet: a data repository with news content, social context, and spatiotemporal information for studying fake news on social media. Big Data 8(3), 171–188 (2020). https://doi.org/10.1089/big.2020.0062CrossRef

121.

Y. Dou, K. Shu, C. Xia, P. S. Yu, and L. Sun, “User Preference-aware Fake News Detection,” SIGIR ’21 Proc. 44th Int. ACM SIGIR Conf. Res. Dev. Inf. Retr., pp. 2051–2055, 2021, https://doi.org/10.1145/XXXXXX.XXXXXX.

122.

J. Ma, W. Gao, and K. F. Wong, “Rumor detection on twitter with tree-structured recursive neural networks,” ACL 2018 - 56th Annu. Meet. Assoc. Comput. Linguist. Proc. Conf. (Long Pap., vol. 1, pp. 1980–1989, 2018, https://doi.org/10.18653/v1/p18-1184.

123.

Q. You, L. Cao, H. Jin, and J. Luo, “Robust visual-textual sentiment analysis: When attention meets tree-structured recursive neural networks,” MM 2016 - Proc. 2016 ACM Multimed. Conf., pp. 1008–1017, 2016, https://doi.org/10.1145/2964284.2964288.

124.

Nasir, J.A., Khan, O.S., Varlamis, I.: Fake news detection: A hybrid CNN-RNN based deep learning approach. Int. J. Inf. Manag. Data Insights 1(1), 100007 (2021). https://doi.org/10.1016/j.jjimei.2020.100007CrossRef

125.

Kim, E., Cho, S.: Exposing fake faces through deep neural networks combining content and trace feature extractors. IEEE Access 9, 123493–123503 (2021). https://doi.org/10.1109/ACCESS.2021.3110859CrossRef

126.

“The mostly complete chart of Neural Networks, explained | by Andrew Tch | Towards Data Science.” https://towardsdatascience.com/the-mostly-complete-chart-of-neural-networks-explained-3fb6f2367464 (accessed Apr. 18, 2022).

127.

A. Vaswani et al., “Attention is all you need,” Adv. Neural Inf. Process. Syst., vol. 2017-Decem, no. Nips, pp. 5999–6009, 2017.

128.

Yu, H.U.I., et al.: Multi-level multi-modal cross-attention network for fake news detection. IEEE Access 9, 132363–132373 (2021). https://doi.org/10.1109/ACCESS.2021.3114093CrossRef

129.

Y. Wu, P. Zhan, Y. Zhang, L. Wang, and Z. Xu, Multimodal fusion with co-attention networks for fake news detection, pp. 2560–2569, 2021, https://doi.org/10.18653/v1/2021.findings-acl.226.

130.

Jindal, S., Sood, R., Singh, R., Vatsa, M., Chakraborty, T.: NewsBag: a multimodal benchmark dataset for fake news detection. CEUR Workshop Proc. 2560, 138–145 (2020)

131.

J. Feng et al., “Generative adversarial networks based on collaborative learning and attention mechanism for hyperspectral image classification,” Remote Sens., vol. 12, no. 7, 2020, https://doi.org/10.3390/RS12071149.

132.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet Classification with Deep Convolutional Neural Networks,” Adv. Neural Inf. Process. Syst., pp. 1097–1105, 2012, https://doi.org/10.1145/3383972.3383975.

133.

C. Wang, P. Nulty, and D. Lillis, “A Comparative Study on Word Embeddings in Deep Learning for Text Classification,” PervasiveHealth Pervasive Comput. Technol. Healthc., no. December, pp. 37–46, 2020, https://doi.org/10.1145/3443279.3443304.

134.

Y. Qi, D. S. Sachan, M. Felix, S. J. Padmanabhan, and G. Neubig, “When and why are pre-trainedword embeddings useful for neural machine translation?,” NAACL HLT 2018 - 2018 Conf. North Am. Chapter Assoc. Comput. Linguist. Hum. Lang. Technol. - Proc. Conf., vol. 2, pp. 529–535, 2018, https://doi.org/10.18653/v1/n18-2084.

135.

Y. Liu et al., “RoBERTa: A Robustly Optimized BERT Pretraining Approach,” no. 1, 2019, [Online].: http://arxiv.org/abs/1907.11692.

136.

Z. Lan, M. Chen, S. Goodman, K. Gimpel, P. Sharma, and R. Soricut, “ALBERT: A Lite BERT for Self-supervised Learning of Language Representations,” pp. 1–16, 2019, [Online]. http://arxiv.org/abs/1909.11942.

137.

Lahat, D., Adalı, T., Jutten, C., Multimodal, C.J.: Multimodal data fusion: an overview of methods, challenges and prospects. Inst. Electr. Electron. Eng. 103(9), 1449–1477 (2015). https://doi.org/10.1109/JPROC.2015.2460697ïCrossRef

138.

P. Le and I. Titov, “Improving Entity Linking by Modeling Latent Relations between Mentions,” in Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), Apr. 2018, vol. 1, pp. 1595–1604, https://doi.org/10.18653/v1/P18-1148.

139.

D. Milne and I. H. Witten, “Learning to Link with Wikipedia,” 2008.

140.

L. Chen, J. Liang, C. Xie, and Y. Xiao, “Short text entity linking with fine-grained topics,” Int. Conf. Inf. Knowl. Manag. Proc., pp. 457–466, Oct. 2018, https://doi.org/10.1145/3269206.3271809.

141.

F. Suchanek et al., “Yago : A Core of Semantic Knowledge Unifying WordNet and Wikipedia,” 2007.

142.

Hoffart, J., Suchanek, F.M., Berberich, K., Weikum, G.: YAGO2: A spatially and temporally enhanced knowledge base from Wikipedia. Artif. Intell. 194, 28–61 (2013). https://doi.org/10.1016/j.artint.2012.06.001MathSciNetCrossRefMATH

143.

W. Wu, H. Li, H. Wang, and K. Q. Zhu, “Probase: A Probabilistic Taxonomy for Text Understanding,” 2012, Accessed: Dec. 16, 2021. [Online]. http://research.microsoft.com/.

144.

C. Boididou et al., “Verifying Multimedia Use at MediaEval 2015,” Accessed: Apr. 18, 2022. [Online]. https://github.com/MKLab-ITI/image-verification-corpus/.

145.

L. Derczynski et al., “SemEval-2017 Task 8: RumourEval: Determining rumour veracity and support for rumours,” Apr. 2017, Accessed: Dec. 30, 2021. [Online]. https://arxiv.org/abs/1704.05972v1.

146.

Bondielli, A., Marcelloni, F.: A survey on fake news and rumour detection techniques. Inf. Sci. (Ny) 497, 38–55 (2019). https://doi.org/10.1016/j.ins.2019.05.035CrossRef

Title: Combating multimodal fake news on social media: methods, datasets, and future perspective
Authors: Sakshini Hangloo
Bhavna Arora
Publication date: 07-07-2022
Publisher: Springer Berlin Heidelberg
Published in: Multimedia Systems / Issue 6/2022
Print ISSN: 0942-4962
Electronic ISSN: 1432-1882
DOI: https://doi.org/10.1007/s00530-022-00966-y

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Other articles of this Issue 6/2022

A hybrid algorithm for underwater image restoration based on color correction and image sharpening

Improved SSD using deep multi-scale attention spatial–temporal features for action recognition

Micro-expression recognition based on SqueezeNet and C3D

Multimedia image and video retrieval based on an improved HMM

Data-driven personalisation of television content: a survey

Combining semantic and linguistic representations for media recommendation