Skip to main content
Top

2022 | OriginalPaper | Chapter

Graph-based Retrieval for Claim Verification over Cross-document Evidence

Authors : Misael Mongiovì, Aldo Gangemi

Published in: Complex Networks & Their Applications X

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Verifying the veracity of claims requires reasoning over a large knowledge base, often in the form of corpora of trustworthy sources. A common approach consists in retrieving short portions of relevant text from the reference documents and giving them as input to a natural language inference module that determines whether the claim can be inferred or contradicted from them. This approach, however, struggles when multiple pieces of evidence need to be collected and combined from different documents, since the single documents are often barely related to the target claim and hence they are left out by the retrieval module. We conjecture that a graph-based approach can be beneficial to identify fragmented evidence. We tested this hypothesis by building, over the whole corpus, a large graph that interconnects text portions by means of mentioned entities and exploiting such a graph for identifying candidate sets of evidence from multiple sources. Our experiments show that leveraging on a graph structure is beneficial in identifying a reasonably small portion of passages related to a claim.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
2
The computation was performed on a machine with 16 CPUs, 16 GB of RAM and a GPU NVIDIA Quadro P2200.
 
3
“I Love You but I Must Drive Off This Cliff Now”.
 
Literature
1.
go back to reference Thorne, J., Vlachos, A., Christodoulopoulos, C., Mittal, A.: FEVER: a large-scale dataset for fact extraction and VERification. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 809–819. New Orleans, Louisiana, Association for Computational Linguistics (June 2018) Thorne, J., Vlachos, A., Christodoulopoulos, C., Mittal, A.: FEVER: a large-scale dataset for fact extraction and VERification. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), pp. 809–819. New Orleans, Louisiana, Association for Computational Linguistics (June 2018)
2.
go back to reference Thorne, J., Vlachos, A.: Automated fact checking: Task formulations, methods and future directions. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 3346–3359 (2018) Thorne, J., Vlachos, A.: Automated fact checking: Task formulations, methods and future directions. In: Proceedings of the 27th International Conference on Computational Linguistics, pp. 3346–3359 (2018)
3.
go back to reference Vosoughi, S., Roy, D., Aral, S.: The spread of true and false news online. Science 359(6380), 1146–1151 (2018)CrossRef Vosoughi, S., Roy, D., Aral, S.: The spread of true and false news online. Science 359(6380), 1146–1151 (2018)CrossRef
4.
go back to reference Zhou, J.: Gear: graph-based evidence aggregating and reasoning for fact verification. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 892–901 (2019) Zhou, J.: Gear: graph-based evidence aggregating and reasoning for fact verification. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, pp. 892–901 (2019)
5.
go back to reference Zhong, W.: Reasoning over semantic-level graph for fact checking. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 6170–6180 (2020) Zhong, W.: Reasoning over semantic-level graph for fact checking. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 6170–6180 (2020)
6.
go back to reference Yoneda, T., Mitchell, J., Welbl, J., Stenetorp, P., Riedel, S.: UCL machine reading group: four factor framework for fact finding (HexaF). In: Proceedings of the First Workshop on Fact Extraction and VERification (FEVER), pp. 97–102. Brussels, Belgium, Association for Computational Linguistics (November 2018) Yoneda, T., Mitchell, J., Welbl, J., Stenetorp, P., Riedel, S.: UCL machine reading group: four factor framework for fact finding (HexaF). In: Proceedings of the First Workshop on Fact Extraction and VERification (FEVER), pp. 97–102. Brussels, Belgium, Association for Computational Linguistics (November 2018)
7.
go back to reference Soleimani, A., Monz, C., Worring, M.: BERT for evidence retrieval and claim verification. Adv. Inf. Retrieval 12036, 359–366 (2020) Soleimani, A., Monz, C., Worring, M.: BERT for evidence retrieval and claim verification. Adv. Inf. Retrieval 12036, 359–366 (2020)
8.
go back to reference Nie, Y., Chen, H., Bansal, M.: Combining fact extraction and verification with neural semantic matching networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 6859–6866 (July 2019). Number: 01 Nie, Y., Chen, H., Bansal, M.: Combining fact extraction and verification with neural semantic matching networks. In: Proceedings of the AAAI Conference on Artificial Intelligence, vol. 33, no. 01, pp. 6859–6866 (July 2019). Number: 01
9.
go back to reference Ma, J., Gao, W., Joty, S., Wong, K.F.: Sentence-level evidence embedding for claim verification with hierarchical attention networks. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019), pp. 2561–2571 (August 2019) Ma, J., Gao, W., Joty, S., Wong, K.F.: Sentence-level evidence embedding for claim verification with hierarchical attention networks. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL 2019), pp. 2561–2571 (August 2019)
10.
go back to reference Liu, Z., Xiong, C., Sun, M., Liu, Z.: Fine-grained fact verification with kernel graph attention network. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 7342–7351 (2020) Liu, Z., Xiong, C., Sun, M., Liu, Z.: Fine-grained fact verification with kernel graph attention network. In: Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pp. 7342–7351 (2020)
11.
go back to reference Hanselowski, A.: UKP-athene: multi-sentence textual entailment for claim verification. In: Proceedings of the First Workshop on Fact Extraction and VERification (FEVER), pp. 103–108. Brussels, Belgium, Association for Computational Linguistics (November 2018) Hanselowski, A.: UKP-athene: multi-sentence textual entailment for claim verification. In: Proceedings of the First Workshop on Fact Extraction and VERification (FEVER), pp. 103–108. Brussels, Belgium, Association for Computational Linguistics (November 2018)
13.
go back to reference Wu, L., Petroni, F., Josifoski, M., Riedel, S., Zettlemoyer, L.: Scalable zero-shot entity linking with dense entity retrieval. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 6397–6407 (2020) Wu, L., Petroni, F., Josifoski, M., Riedel, S., Zettlemoyer, L.: Scalable zero-shot entity linking with dense entity retrieval. In: Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pp. 6397–6407 (2020)
14.
go back to reference Fillmore, C.J., Baker, C.F.: Frame semantics for text understanding. In: Proceedings of WordNet and Other Lexical Resources Workshop, NAACL, vol. 6 (2001) Fillmore, C.J., Baker, C.F.: Frame semantics for text understanding. In: Proceedings of WordNet and Other Lexical Resources Workshop, NAACL, vol. 6 (2001)
17.
go back to reference Chen, Q., Zhu, X., Ling, Z., Wei, S., Jiang, H., Inkpen, D.: Enhanced LSTM for natural language inference. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1657–1668 (2017) Chen, Q., Zhu, X., Ling, Z., Wei, S., Jiang, H., Inkpen, D.: Enhanced LSTM for natural language inference. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pp. 1657–1668 (2017)
18.
go back to reference Chang, W.C., Yu, F.X., Chang, Y.W., Yang, Y., Kumar, S.: Pre-training Tasks for Embedding-based Large-scale Retrieval. arXiv:2002.03932 (February 2020) Chang, W.C., Yu, F.X., Chang, Y.W., Yang, Y., Kumar, S.: Pre-training Tasks for Embedding-based Large-scale Retrieval. arXiv:​2002.​03932 (February 2020)
19.
go back to reference Samarinas, C., Hsu, W., Lee, M.L.: Latent retrieval for large-scale fact-checking and question answering with NLI training. In: 2020 IEEE 32nd International Conference on Tools with Artificial Intelligence (ICTAI), pp. 941–948 (November 2020). ISSN: 2375–0197 Samarinas, C., Hsu, W., Lee, M.L.: Latent retrieval for large-scale fact-checking and question answering with NLI training. In: 2020 IEEE 32nd International Conference on Tools with Artificial Intelligence (ICTAI), pp. 941–948 (November 2020). ISSN: 2375–0197
20.
go back to reference Lee, K., Chang, M.-W., Toutanova, K.: Latent Retrieval for Weakly Supervised Open Domain Question Answering. arXiv:1906.00300 (June 2019) Lee, K., Chang, M.-W., Toutanova, K.: Latent Retrieval for Weakly Supervised Open Domain Question Answering. arXiv:​1906.​00300 (June 2019)
Metadata
Title
Graph-based Retrieval for Claim Verification over Cross-document Evidence
Authors
Misael Mongiovì
Aldo Gangemi
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-030-93413-2_41

Premium Partner