Skip to main content

22.01.2024 | Research

A novel technique using graph neural networks and relevance scoring to improve the performance of knowledge graph-based question answering systems

verfasst von: Sincy V. Thambi, P. C. Reghu Raj

Erschienen in: Journal of Intelligent Information Systems

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

A Knowledge Graph-based Question Answering (KGQA) system attempts to answer a given natural language question using a knowledge graph (KG) rather than from text data. The current KGQA methods attempt to determine whether there is an explicit relationship between the entities in the question and a well-structured relationship between them in the KG. However, such strategies are difficult to build and train, limiting their consistency and versatility. The use of language models such as BERT has aided in the advancement of natural language question answering. In this paper, we present a novel Graph Neural Network(GNN) based approach with relevance scoring for improving KGQA. GNNs use the weight of nodes and edges to influence the information propagation while updating the node features in the network. The suggested method comprises subgraph construction, weighing of nodes and edges, and pruning processes to obtain meaningful answers. BERT-based GNN is used to build subgraph node embeddings. We tested the influence of weighting for both nodes and edges and observed that the system performs better for weighted graphs than unweighted graphs. Additionally, we experimented with several GNN convolutional layers and obtainined improved results by combining GENeralised Graph Convolution (GENConv) with node weights for simple questions. Extensive testing on benchmark datasets confirmed the effectiveness of the proposed model in comparison to state-of-the-art KGQA systems.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Bordes, A., Usunier, N., et al. (2015). Large–scale simple question answering with memory networks. CoRR abs/1506.02075. arXiv:1506.02075 Bordes, A., Usunier, N., et al. (2015). Large–scale simple question answering with memory networks. CoRR abs/1506.02075. arXiv:​1506.​02075
Zurück zum Zitat Daniel, J., & James, M. (2019). Speech and Language Processing: An Introduction to Natural Language Processing. Computational Linguistics and Speech Recognition. 3rd Edition Draft. Prentice Hall, New Jersey., Chapter 25 Daniel, J., & James, M. (2019). Speech and Language Processing: An Introduction to Natural Language Processing. Computational Linguistics and Speech Recognition. 3rd Edition Draft. Prentice Hall, New Jersey., Chapter 25
Zurück zum Zitat Hamilton, W. L. (2020). Graph representation learning. Synthesis Lectures on Artificial Intelligence and Machine Learning, 14(3), 1–159.CrossRef Hamilton, W. L. (2020). Graph representation learning. Synthesis Lectures on Artificial Intelligence and Machine Learning, 14(3), 1–159.CrossRef
Zurück zum Zitat He, G., Lan, Y., et al. (2021). Improving multi-hop knowledge base question answering by learning intermediate supervision signals. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining. Association for Computing Machinery, WSDM ’21, p 553–561, https://doi.org/10.1145/3437963.3441753 He, G., Lan, Y., et al. (2021). Improving multi-hop knowledge base question answering by learning intermediate supervision signals. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining. Association for Computing Machinery, WSDM ’21, p 553–561, https://​doi.​org/​10.​1145/​3437963.​3441753
Zurück zum Zitat Kingma, D. P., & Ba, J. (2015). Adam: A method for stochastic optimization. In Y. Bengio & Y. LeCun (Eds.), 3rd International Conference on Learning Representations. ICLR. Kingma, D. P., & Ba, J. (2015). Adam: A method for stochastic optimization. In Y. Bengio & Y. LeCun (Eds.), 3rd International Conference on Learning Representations. ICLR.
Zurück zum Zitat Kwok, C. C. T., Etzioni, O., & Weld, D. S. (2001). Scaling question answering to the web. In: Proceedings of the 10th International Conference on World Wide Web. Association for Computing Machinery, New York, NY, USA, WWW ’01, p 150–161, https://doi.org/10.1145/371920.371973 Kwok, C. C. T., Etzioni, O., & Weld, D. S. (2001). Scaling question answering to the web. In: Proceedings of the 10th International Conference on World Wide Web. Association for Computing Machinery, New York, NY, USA, WWW ’01, p 150–161, https://​doi.​org/​10.​1145/​371920.​371973
Zurück zum Zitat Qiu, Y., Wang, Y., Jin, X., et al. (2020) Stepwise reasoning for multi-relation question answering over knowledge graph with weak supervision. In: Proceedings of the 13th International Conference on Web Search and Data Mining. Association for Computing Machinery, pp. 474–482, https://doi.org/10.1145/3336191.3371812 Qiu, Y., Wang, Y., Jin, X., et al. (2020) Stepwise reasoning for multi-relation question answering over knowledge graph with weak supervision. In: Proceedings of the 13th International Conference on Web Search and Data Mining. Association for Computing Machinery, pp. 474–482, https://​doi.​org/​10.​1145/​3336191.​3371812
Zurück zum Zitat Shi, Y., Huang, Z., et al. (2020). Masked label prediction: Unified massage passing model for semi-supervised classification. CoRR abs/2009.03509. arXiv:2009.03509 Shi, Y., Huang, Z., et al. (2020). Masked label prediction: Unified massage passing model for semi-supervised classification. CoRR abs/2009.03509. arXiv:​2009.​03509
Zurück zum Zitat Unger, C., Bühmann, L., Lehmann, J., et al. (2012). Template-based question answering over rdf data. In: Proceedings of the 21st International Conference on World Wide Web. Association for Computing Machinery, New York, NY, USA, WWW ’12, p 639–648, https://doi.org/10.1145/2187836.2187923 Unger, C., Bühmann, L., Lehmann, J., et al. (2012). Template-based question answering over rdf data. In: Proceedings of the 21st International Conference on World Wide Web. Association for Computing Machinery, New York, NY, USA, WWW ’12, p 639–648, https://​doi.​org/​10.​1145/​2187836.​2187923
Zurück zum Zitat Xie, M., Hao, C., & Zhang, P. (2022). A sequential flow control framework for multi-hop knowledge base question answering. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, pp. 8450–8460, https://doi.org/10.18653/v1/2022.emnlp-main.578 Xie, M., Hao, C., & Zhang, P. (2022). A sequential flow control framework for multi-hop knowledge base question answering. In: Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing. Association for Computational Linguistics, pp. 8450–8460, https://​doi.​org/​10.​18653/​v1/​2022.​emnlp-main.​578
Metadaten
Titel
A novel technique using graph neural networks and relevance scoring to improve the performance of knowledge graph-based question answering systems
verfasst von
Sincy V. Thambi
P. C. Reghu Raj
Publikationsdatum
22.01.2024
Verlag
Springer US
Erschienen in
Journal of Intelligent Information Systems
Print ISSN: 0925-9902
Elektronische ISSN: 1573-7675
DOI
https://doi.org/10.1007/s10844-023-00839-4