Skip to main content

25.01.2024 | Research

KIMedQA: towards building knowledge-enhanced medical QA models

verfasst von: Aizan Zafar, Sovan Kumar Sahoo, Deeksha Varshney, Amitava Das, Asif Ekbal

Erschienen in: Journal of Intelligent Information Systems

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Medical question-answering systems require the ability to extract accurate, concise, and comprehensive answers. They will better comprehend the complex text and produce helpful answers if they can reason on the explicit constraints described in the question’s textual context and the implicit, pertinent knowledge of the medical world. Integrating Knowledge Graphs (KG) with Language Models (LMs) is a common approach to incorporating structured information sources. However, effectively combining and reasoning over KG representations and language context remains an open question. To address this, we propose the Knowledge Infused Medical Question Answering system (KIMedQA), which employs two techniques viz. relevant knowledge graph selection and pruning of the large-scale graph to handle Vector Space Inconsistent (VSI) and Excessive Knowledge Information (EKI). The representation of the query and context are then combined with the pruned knowledge network using a pre-trained language model to generate an informed answer. Finally, we demonstrate through in-depth empirical evaluation that our suggested strategy provides cutting-edge outcomes on two benchmark datasets, namely MASH-QA and COVID-QA. We also compared our results to ChatGPT, a robust and very powerful generative model, and discovered that our model outperforms ChatGPT according to the F1 Score and human evaluation metrics such as adequacy.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Fußnoten
Literatur
Zurück zum Zitat Bollacker, K., Evans, C., Paritosh, P., et al. (2008). Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. https://doi.org/10.1145/1376616.1376746 Bollacker, K., Evans, C., Paritosh, P., et al. (2008). Freebase: a collaboratively created graph database for structuring human knowledge. In: Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data. https://​doi.​org/​10.​1145/​1376616.​1376746
Zurück zum Zitat Cao, Y., Hou, L., Li, J., et al. (2018). Joint representation learning of cross-lingual words and entities via attentive distant supervision. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. https://doi.org/10.18653/v1/D18-1021 Cao, Y., Hou, L., Li, J., et al. (2018). Joint representation learning of cross-lingual words and entities via attentive distant supervision. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. https://​doi.​org/​10.​18653/​v1/​D18-1021
Zurück zum Zitat Chen, D., Fisch, A., Weston, J., et al. (2017). Reading wikipedia to answer open-domain questions. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). https://doi.org/10.18653/v1/P17-1171 Chen, D., Fisch, A., Weston, J., et al. (2017). Reading wikipedia to answer open-domain questions. In: Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers). https://​doi.​org/​10.​18653/​v1/​P17-1171
Zurück zum Zitat Kursuncu, U., Gaur, M., Sheth, A. (2020). Knowledge infused learning (k-il): Towards deep incorporation of knowledge in deep learning. Proceedings of the AAAI 2020 Spring Symposium on Combining Machine Learning and Knowledge Engineering in Practice (AAAI-MAKE). https://doi.org/10.48550/arXiv.1912.00512 Kursuncu, U., Gaur, M., Sheth, A. (2020). Knowledge infused learning (k-il): Towards deep incorporation of knowledge in deep learning. Proceedings of the AAAI 2020 Spring Symposium on Combining Machine Learning and Knowledge Engineering in Practice (AAAI-MAKE). https://​doi.​org/​10.​48550/​arXiv.​1912.​00512
Zurück zum Zitat Lin, B.Y., Chen, X., Chen, J., et al. (2019). Kagnet: Knowledge-aware graph networks for commonsense reasoning. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)https://doi.org/10.18653/v1/D19-1282 Lin, B.Y., Chen, X., Chen, J., et al. (2019). Kagnet: Knowledge-aware graph networks for commonsense reasoning. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)https://​doi.​org/​10.​18653/​v1/​D19-1282
Zurück zum Zitat Nentidis, A., Katsimpras, G., Vandorou, E., et al. (2022). Overview of bioasq 2022: The tenth bioasq challenge on large-scale biomedical semantic indexing and question answering. In: Experimental IR Meets Multilinguality, Multimodality, and Interaction: 13th International Conference of the CLEF Association, CLEF 2022, Bologna, Italy, September 5–8, 2022, Proceedings. Springer. https://doi.org/10.1007/978-3-031-13643-6_22 Nentidis, A., Katsimpras, G., Vandorou, E., et al. (2022). Overview of bioasq 2022: The tenth bioasq challenge on large-scale biomedical semantic indexing and question answering. In: Experimental IR Meets Multilinguality, Multimodality, and Interaction: 13th International Conference of the CLEF Association, CLEF 2022, Bologna, Italy, September 5–8, 2022, Proceedings. Springer. https://​doi.​org/​10.​1007/​978-3-031-13643-6_​22
Zurück zum Zitat Pampari, A., Raghavan, P., Liang, J., et al. (2018). emrqa: A large corpus for question answering on electronic medical records. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP). https://doi.org/10.18653/v1/D18-1258 Pampari, A., Raghavan, P., Liang, J., et al. (2018). emrqa: A large corpus for question answering on electronic medical records. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP). https://​doi.​org/​10.​18653/​v1/​D18-1258
Zurück zum Zitat Petroni, F., Rocktäschel, T., Lewis, P., et al. (2019). Language models as knowledge bases? In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). https://doi.org/10.18653/v1/D19-1250 Petroni, F., Rocktäschel, T., Lewis, P., et al. (2019). Language models as knowledge bases? In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). https://​doi.​org/​10.​18653/​v1/​D19-1250
Zurück zum Zitat Savenkov, D., Agichtein, E. (2016). When a knowledge base is not enough: Question answering over knowledge bases with external text data. In: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. https://doi.org/10.1145/2911451.2911536 Savenkov, D., Agichtein, E. (2016). When a knowledge base is not enough: Question answering over knowledge bases with external text data. In: Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. https://​doi.​org/​10.​1145/​2911451.​2911536
Zurück zum Zitat Suster, S., Daelemans, W. (2018). Clicr: a dataset of clinical case reports for machine reading comprehension. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. https://doi.org/10.18653/v1/N18-1140 Suster, S., Daelemans, W. (2018). Clicr: a dataset of clinical case reports for machine reading comprehension. In: Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. https://​doi.​org/​10.​18653/​v1/​N18-1140
Zurück zum Zitat Toutanova, K., Chen, D., Pantel, P., et al. (2015). Representing text for joint embedding of text and knowledge bases. In: Proceedings of the 2015 conference on Empirical Methods in Natural Language Processing (EMNLP). https://doi.org/10.18653/v1/D15-1174 Toutanova, K., Chen, D., Pantel, P., et al. (2015). Representing text for joint embedding of text and knowledge bases. In: Proceedings of the 2015 conference on Empirical Methods in Natural Language Processing (EMNLP). https://​doi.​org/​10.​18653/​v1/​D15-1174
Zurück zum Zitat Wang, Z., Ng, P., Ma, X., et al. (2019). Multi-passage bert: A globally normalized bert model for open-domain question answering. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). https://doi.org/10.18653/v1/D19-1599 Wang, Z., Ng, P., Ma, X., et al. (2019). Multi-passage bert: A globally normalized bert model for open-domain question answering. In: Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). https://​doi.​org/​10.​18653/​v1/​D19-1599
Zurück zum Zitat Yasunaga, M., Ren, H., Bosselut, A., et al. (2021). Qa-gnn: Reasoning with language models and knowledge graphs for question answering. In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. https://doi.org/10.18653/v1/2021.naacl-main.45 Yasunaga, M., Ren, H., Bosselut, A., et al. (2021). Qa-gnn: Reasoning with language models and knowledge graphs for question answering. In: Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. https://​doi.​org/​10.​18653/​v1/​2021.​naacl-main.​45
Zurück zum Zitat Zhang, Y., Qi, P., Manning, C.D. (2018). Graph convolution over pruned dependency trees improves relation extraction. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP). https://doi.org/10.18653/v1/D18-1244 Zhang, Y., Qi, P., Manning, C.D. (2018). Graph convolution over pruned dependency trees improves relation extraction. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing (EMNLP). https://​doi.​org/​10.​18653/​v1/​D18-1244
Zurück zum Zitat Zhu, Y., Kiros, R., Zemel, R., et al. (2015). Aligning books and movies: Towards story-like visual explanations by watching movies and reading books. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), https://doi.org/10.1109/ICCV.2015.11 Zhu, Y., Kiros, R., Zemel, R., et al. (2015). Aligning books and movies: Towards story-like visual explanations by watching movies and reading books. In: Proceedings of the IEEE International Conference on Computer Vision (ICCV), https://​doi.​org/​10.​1109/​ICCV.​2015.​11
Metadaten
Titel
KIMedQA: towards building knowledge-enhanced medical QA models
verfasst von
Aizan Zafar
Sovan Kumar Sahoo
Deeksha Varshney
Amitava Das
Asif Ekbal
Publikationsdatum
25.01.2024
Verlag
Springer US
Erschienen in
Journal of Intelligent Information Systems
Print ISSN: 0925-9902
Elektronische ISSN: 1573-7675
DOI
https://doi.org/10.1007/s10844-024-00844-1