Skip to main content
Top

2023 | OriginalPaper | Chapter

11. Fact Checking Chatbot: A Misinformation Intervention for Instant Messaging Apps and an Analysis of Trust in the Fact Checkers

Authors : Gionnieve Lim, Simon T. Perrault

Published in: Mobile Communication and Online Falsehoods in Asia

Publisher: Springer Netherlands

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In Singapore, there has been a rise in misinformation on mobile instant messaging services (MIMS). MIMS support both small peer-to-peer networks and large groups. Misinformation in the former may spread due to recipients’ trust in the sender while in the latter, misinformation can directly reach a wide audience. The encryption of MIMS makes it difficult to address misinformation directly. As such, chatbots have become an alternative solution where users can disclose their chat content directly to fact checking services. To understand how effective fact checking chatbots are as an intervention and how trust in three different fact checkers (i.e., Government, News Outlets, and Artificial Intelligence) may affect this trust, we conducted a within-subjects experiment with 527 Singapore residents. We found mixed results for the fact checkers but support for the chatbot intervention overall. We also found a striking contradiction between participants’ trust in the fact checkers and their behaviour towards them. Specifically, those who reported a high level of trust in the government performed worse and tended to follow the fact checking tool less when it was endorsed by the government.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
Non-Halal food do not follow the dietary observances of Islamic law and Muslims are prohibited from consuming them.
 
2
TGM Research (https://​tgmresearch.​com/​) was engaged for the recruitment of participants.
 
3
Multiple responses made by the same participant (identified by their participant identification number) were removed.
 
4
Responses in which the participant gave identical answers to each series of questions in the experiment were removed.
 
6
Repeated measures ANOVA assumes sphericity by default, which is the condition that the variances of the differences between all possible pairs of a given within-subject independent variable are equal. If the assumption of sphericity is violated, we might end up with inflated F-scores and Greenhouse–Geisser corrections are applied to produce a more valid F-score.
 
7
When performing post hoc analysis, we encounter the multiple comparisons problem. When using simultaneous statistical tests, each test has a potential to produce an effect, leading to Type I errors (incorrectly rejecting the null hypothesis, and thus incorrectly accepting an effect that is not there). To counter this issue, we use Bonferroni corrections, in which the p-value is multiplied by the number of pairwise comparisons to be made.
 
8
Friedman test is an alternative to repeated measures ANOVA which does not require normally distributed data, and is suitable for interval data, e.g., discrete scales like a Likert scale.
 
9
Wilcoxon signed-rank test is an alternative to paired t-tests, which does not require normally distributed data, and is suitable for interval data. The Bonferroni correction is applied to prevent the multiple comparisons problem as explained in footnote 7.
 
Literature
go back to reference de Freitas Melo, P., Vieira, C. C., Garimella, K., de Melo, P. O. S. V., & Benevenuto, F. (2020). Can WhatsApp counter misinformation by limiting message forwarding? In H. Cherifi, S. Gaito, J. F. Mendes, E. Moro, & L. M. Rocha (Eds.), Complex networks and their applications VIII (Vol. 881, pp. 372–384). Springer International Publishing. https://doi.org/10.1007/978-3-030-36687-2_31 de Freitas Melo, P., Vieira, C. C., Garimella, K., de Melo, P. O. S. V., & Benevenuto, F. (2020). Can WhatsApp counter misinformation by limiting message forwarding? In H. Cherifi, S. Gaito, J. F. Mendes, E. Moro, & L. M. Rocha (Eds.), Complex networks and their applications VIII (Vol. 881, pp. 372–384). Springer International Publishing. https://​doi.​org/​10.​1007/​978-3-030-36687-2_​31
go back to reference Gao, M., Xiao, Z., Karahalios, K., & Fu, W.-T. (2018). To label or not to label: The effect of stance and credibility labels on readers’ selection and perception of news articles. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW). https://doi.org/10.1145/3274324 Gao, M., Xiao, Z., Karahalios, K., & Fu, W.-T. (2018). To label or not to label: The effect of stance and credibility labels on readers’ selection and perception of news articles. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW). https://​doi.​org/​10.​1145/​3274324
go back to reference Gunson, N., Sieińska, W., Yu, Y., Garcia, D. H., Part, J. L., Dondrup, C., & Lemon, O. (2021). Coronabot: A conversational AI system for tackling misinformation. In Proceedings of the Conference on Information Technology for Social Good (pp. 265–270). Association for Computing Machinery. https://doi.org/10.1145/3462203.3475874 Gunson, N., Sieińska, W., Yu, Y., Garcia, D. H., Part, J. L., Dondrup, C., & Lemon, O. (2021). Coronabot: A conversational AI system for tackling misinformation. In Proceedings of the Conference on Information Technology for Social Good (pp. 265–270). Association for Computing Machinery. https://​doi.​org/​10.​1145/​3462203.​3475874
go back to reference Hovland, C. I., Janis, I. L., & Kelley, H. H. (1953). Communication and persuasion: Psychological studies of opinion change. Yale University Press. Hovland, C. I., Janis, I. L., & Kelley, H. H. (1953). Communication and persuasion: Psychological studies of opinion change. Yale University Press.
go back to reference Lim, G., & Perrault, S. T. (2021). Local perceptions and practices of news sharing and fake news. In Companion publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing (pp. 117–120). Association for Computing Machinery. https://doi.org/10.1145/3462204.3481767 Lim, G., & Perrault, S. T. (2021). Local perceptions and practices of news sharing and fake news. In Companion publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing (pp. 117–120). Association for Computing Machinery. https://​doi.​org/​10.​1145/​3462204.​3481767
go back to reference Nguyen, A. T., Kharosekar, A., Krishnan, S., Krishnan, S., Tate, E., Wallace, B. C., & Lease, M. (2018). Believe it or not: Designing a human-AI partnership for mixed-initiative fact-checking. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (pp. 189–199). Association for Computing Machinery. https://doi.org/10.1145/3242587.3242666 Nguyen, A. T., Kharosekar, A., Krishnan, S., Krishnan, S., Tate, E., Wallace, B. C., & Lease, M. (2018). Believe it or not: Designing a human-AI partnership for mixed-initiative fact-checking. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (pp. 189–199). Association for Computing Machinery. https://​doi.​org/​10.​1145/​3242587.​3242666
go back to reference Pecher, B., Srba, I., Moro, R., Tomlein, M., & Bielikova, M. (2020). FireAnt: Claim-based medical misinformation detection and monitoring. Machine Learning and Knowledge Discovery in Databases. In Applied Data Science and Demo Track: European Conference, ECML PKDD 2020, Ghent, Belgium, September 14–18, 2020, Proceedings, Part V (pp. 555–559). Springer-Verlag. https://doi.org/10.1007/978-3-030-67670-4_38 Pecher, B., Srba, I., Moro, R., Tomlein, M., & Bielikova, M. (2020). FireAnt: Claim-based medical misinformation detection and monitoring. Machine Learning and Knowledge Discovery in Databases. In Applied Data Science and Demo Track: European Conference, ECML PKDD 2020, Ghent, Belgium, September 14–18, 2020, Proceedings, Part V (pp. 555–559). Springer-Verlag. https://​doi.​org/​10.​1007/​978-3-030-67670-4_​38
go back to reference Roque, G., Cavalcanti, A., Nascimento, J., Souza, R., & Queiroz, S. (2021). BotCovid: Development and evaluation of a chatbot to combat misinformation about COVID-19 in Brazil. In 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 2506–2511). https://doi.org/10.1109/SMC52423.2021.9658693 Roque, G., Cavalcanti, A., Nascimento, J., Souza, R., & Queiroz, S. (2021). BotCovid: Development and evaluation of a chatbot to combat misinformation about COVID-19 in Brazil. In 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 2506–2511). https://​doi.​org/​10.​1109/​SMC52423.​2021.​9658693
go back to reference Yu, S., & Han, K.-H. (2018). Silent chatbot agent amplifies continued-influence effect on misinformation. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–6). Association for Computing Machinery. https://doi.org/10.1145/3170427.3180290 Yu, S., & Han, K.-H. (2018). Silent chatbot agent amplifies continued-influence effect on misinformation. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–6). Association for Computing Machinery. https://​doi.​org/​10.​1145/​3170427.​3180290
Metadata
Title
Fact Checking Chatbot: A Misinformation Intervention for Instant Messaging Apps and an Analysis of Trust in the Fact Checkers
Authors
Gionnieve Lim
Simon T. Perrault
Copyright Year
2023
Publisher
Springer Netherlands
DOI
https://doi.org/10.1007/978-94-024-2225-2_11