Skip to main content

2023 | OriginalPaper | Buchkapitel

11. Fact Checking Chatbot: A Misinformation Intervention for Instant Messaging Apps and an Analysis of Trust in the Fact Checkers

verfasst von : Gionnieve Lim, Simon T. Perrault

Erschienen in: Mobile Communication and Online Falsehoods in Asia

Verlag: Springer Netherlands

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In Singapore, there has been a rise in misinformation on mobile instant messaging services (MIMS). MIMS support both small peer-to-peer networks and large groups. Misinformation in the former may spread due to recipients’ trust in the sender while in the latter, misinformation can directly reach a wide audience. The encryption of MIMS makes it difficult to address misinformation directly. As such, chatbots have become an alternative solution where users can disclose their chat content directly to fact checking services. To understand how effective fact checking chatbots are as an intervention and how trust in three different fact checkers (i.e., Government, News Outlets, and Artificial Intelligence) may affect this trust, we conducted a within-subjects experiment with 527 Singapore residents. We found mixed results for the fact checkers but support for the chatbot intervention overall. We also found a striking contradiction between participants’ trust in the fact checkers and their behaviour towards them. Specifically, those who reported a high level of trust in the government performed worse and tended to follow the fact checking tool less when it was endorsed by the government.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
1
Non-Halal food do not follow the dietary observances of Islamic law and Muslims are prohibited from consuming them.
 
2
TGM Research (https://​tgmresearch.​com/​) was engaged for the recruitment of participants.
 
3
Multiple responses made by the same participant (identified by their participant identification number) were removed.
 
4
Responses in which the participant gave identical answers to each series of questions in the experiment were removed.
 
6
Repeated measures ANOVA assumes sphericity by default, which is the condition that the variances of the differences between all possible pairs of a given within-subject independent variable are equal. If the assumption of sphericity is violated, we might end up with inflated F-scores and Greenhouse–Geisser corrections are applied to produce a more valid F-score.
 
7
When performing post hoc analysis, we encounter the multiple comparisons problem. When using simultaneous statistical tests, each test has a potential to produce an effect, leading to Type I errors (incorrectly rejecting the null hypothesis, and thus incorrectly accepting an effect that is not there). To counter this issue, we use Bonferroni corrections, in which the p-value is multiplied by the number of pairwise comparisons to be made.
 
8
Friedman test is an alternative to repeated measures ANOVA which does not require normally distributed data, and is suitable for interval data, e.g., discrete scales like a Likert scale.
 
9
Wilcoxon signed-rank test is an alternative to paired t-tests, which does not require normally distributed data, and is suitable for interval data. The Bonferroni correction is applied to prevent the multiple comparisons problem as explained in footnote 7.
 
Literatur
Zurück zum Zitat de Freitas Melo, P., Vieira, C. C., Garimella, K., de Melo, P. O. S. V., & Benevenuto, F. (2020). Can WhatsApp counter misinformation by limiting message forwarding? In H. Cherifi, S. Gaito, J. F. Mendes, E. Moro, & L. M. Rocha (Eds.), Complex networks and their applications VIII (Vol. 881, pp. 372–384). Springer International Publishing. https://doi.org/10.1007/978-3-030-36687-2_31 de Freitas Melo, P., Vieira, C. C., Garimella, K., de Melo, P. O. S. V., & Benevenuto, F. (2020). Can WhatsApp counter misinformation by limiting message forwarding? In H. Cherifi, S. Gaito, J. F. Mendes, E. Moro, & L. M. Rocha (Eds.), Complex networks and their applications VIII (Vol. 881, pp. 372–384). Springer International Publishing. https://​doi.​org/​10.​1007/​978-3-030-36687-2_​31
Zurück zum Zitat Della Vedova, M. L., Tacchini, E., Moret, S., Ballarin, G., DiPierro, M., & de Alfaro, L. (2018). Automatic online fake news detection combining content and social signals. In 2018 22nd Conference of Open Innovations Association (FRUCT) (pp. 272–279). https://doi.org/10.23919/FRUCT.2018.8468301 Della Vedova, M. L., Tacchini, E., Moret, S., Ballarin, G., DiPierro, M., & de Alfaro, L. (2018). Automatic online fake news detection combining content and social signals. In 2018 22nd Conference of Open Innovations Association (FRUCT) (pp. 272–279). https://​doi.​org/​10.​23919/​FRUCT.​2018.​8468301
Zurück zum Zitat Gao, M., Xiao, Z., Karahalios, K., & Fu, W.-T. (2018). To label or not to label: The effect of stance and credibility labels on readers’ selection and perception of news articles. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW). https://doi.org/10.1145/3274324 Gao, M., Xiao, Z., Karahalios, K., & Fu, W.-T. (2018). To label or not to label: The effect of stance and credibility labels on readers’ selection and perception of news articles. Proceedings of the ACM on Human-Computer Interaction, 2(CSCW). https://​doi.​org/​10.​1145/​3274324
Zurück zum Zitat Gunson, N., Sieińska, W., Yu, Y., Garcia, D. H., Part, J. L., Dondrup, C., & Lemon, O. (2021). Coronabot: A conversational AI system for tackling misinformation. In Proceedings of the Conference on Information Technology for Social Good (pp. 265–270). Association for Computing Machinery. https://doi.org/10.1145/3462203.3475874 Gunson, N., Sieińska, W., Yu, Y., Garcia, D. H., Part, J. L., Dondrup, C., & Lemon, O. (2021). Coronabot: A conversational AI system for tackling misinformation. In Proceedings of the Conference on Information Technology for Social Good (pp. 265–270). Association for Computing Machinery. https://​doi.​org/​10.​1145/​3462203.​3475874
Zurück zum Zitat Hovland, C. I., Janis, I. L., & Kelley, H. H. (1953). Communication and persuasion: Psychological studies of opinion change. Yale University Press. Hovland, C. I., Janis, I. L., & Kelley, H. H. (1953). Communication and persuasion: Psychological studies of opinion change. Yale University Press.
Zurück zum Zitat Lim, G., & Perrault, S. T. (2021). Local perceptions and practices of news sharing and fake news. In Companion publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing (pp. 117–120). Association for Computing Machinery. https://doi.org/10.1145/3462204.3481767 Lim, G., & Perrault, S. T. (2021). Local perceptions and practices of news sharing and fake news. In Companion publication of the 2021 Conference on Computer Supported Cooperative Work and Social Computing (pp. 117–120). Association for Computing Machinery. https://​doi.​org/​10.​1145/​3462204.​3481767
Zurück zum Zitat Nguyen, A. T., Kharosekar, A., Krishnan, S., Krishnan, S., Tate, E., Wallace, B. C., & Lease, M. (2018). Believe it or not: Designing a human-AI partnership for mixed-initiative fact-checking. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (pp. 189–199). Association for Computing Machinery. https://doi.org/10.1145/3242587.3242666 Nguyen, A. T., Kharosekar, A., Krishnan, S., Krishnan, S., Tate, E., Wallace, B. C., & Lease, M. (2018). Believe it or not: Designing a human-AI partnership for mixed-initiative fact-checking. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (pp. 189–199). Association for Computing Machinery. https://​doi.​org/​10.​1145/​3242587.​3242666
Zurück zum Zitat Pecher, B., Srba, I., Moro, R., Tomlein, M., & Bielikova, M. (2020). FireAnt: Claim-based medical misinformation detection and monitoring. Machine Learning and Knowledge Discovery in Databases. In Applied Data Science and Demo Track: European Conference, ECML PKDD 2020, Ghent, Belgium, September 14–18, 2020, Proceedings, Part V (pp. 555–559). Springer-Verlag. https://doi.org/10.1007/978-3-030-67670-4_38 Pecher, B., Srba, I., Moro, R., Tomlein, M., & Bielikova, M. (2020). FireAnt: Claim-based medical misinformation detection and monitoring. Machine Learning and Knowledge Discovery in Databases. In Applied Data Science and Demo Track: European Conference, ECML PKDD 2020, Ghent, Belgium, September 14–18, 2020, Proceedings, Part V (pp. 555–559). Springer-Verlag. https://​doi.​org/​10.​1007/​978-3-030-67670-4_​38
Zurück zum Zitat Pellegrino, P. (2018). “Don’t break those norms.” WhatsApp socio-technical practices in light of contextual integrity and technology affordances. DigitCult—Scientific Journal on Digital Cultures, 3(1), 73–88. https://doi.org/10.4399/97888255159098 Pellegrino, P. (2018). “Don’t break those norms.” WhatsApp socio-technical practices in light of contextual integrity and technology affordances. DigitCult—Scientific Journal on Digital Cultures, 3(1), 73–88. https://​doi.​org/​10.​4399/​97888255159098
Zurück zum Zitat Roque, G., Cavalcanti, A., Nascimento, J., Souza, R., & Queiroz, S. (2021). BotCovid: Development and evaluation of a chatbot to combat misinformation about COVID-19 in Brazil. In 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 2506–2511). https://doi.org/10.1109/SMC52423.2021.9658693 Roque, G., Cavalcanti, A., Nascimento, J., Souza, R., & Queiroz, S. (2021). BotCovid: Development and evaluation of a chatbot to combat misinformation about COVID-19 in Brazil. In 2021 IEEE International Conference on Systems, Man, and Cybernetics (SMC) (pp. 2506–2511). https://​doi.​org/​10.​1109/​SMC52423.​2021.​9658693
Zurück zum Zitat Yu, S., & Han, K.-H. (2018). Silent chatbot agent amplifies continued-influence effect on misinformation. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–6). Association for Computing Machinery. https://doi.org/10.1145/3170427.3180290 Yu, S., & Han, K.-H. (2018). Silent chatbot agent amplifies continued-influence effect on misinformation. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (pp. 1–6). Association for Computing Machinery. https://​doi.​org/​10.​1145/​3170427.​3180290
Metadaten
Titel
Fact Checking Chatbot: A Misinformation Intervention for Instant Messaging Apps and an Analysis of Trust in the Fact Checkers
verfasst von
Gionnieve Lim
Simon T. Perrault
Copyright-Jahr
2023
Verlag
Springer Netherlands
DOI
https://doi.org/10.1007/978-94-024-2225-2_11