Skip to main content

19.03.2024 | Research

Knowledge-aware adaptive graph network for commonsense question answering

verfasst von: Long Kang, Xiaoge Li, Xiaochun An

Erschienen in: Journal of Intelligent Information Systems

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Commonsense Question Answering (CQA) aims to select the correct answers to common knowledge questions. Most existing approaches focus on integrating external knowledge graph (KG) representations with question context representations to facilitate reasoning. However, the approaches cannot effectively select the correct answer due to (i) the incomplete reasoning chains when using knowledge graphs as external knowledge, and (ii) the insufficient understanding of semantic information of the question during the reasoning process. Here we propose a novel model, KA-AGN. First, we utilize a joint representation of dependency parse trees and language models to describe QA pairs. Next, we introduce question semantic information as nodes into a knowledge subgraph and compute the correlations between nodes using adaptive graph networks. Finally, bidirectional attention and graph pruning are employed to update the question representation and the knowledge subgraph representation. To evaluate the performance of our method, we conducted experiments on two widely used benchmark datasets: CommonsenseQA and OpenBookQA. The ablation experiment results demonstrate the effectiveness of the adaptive graph network in enhancing reasoning chains, while showing the ability of the joint representation of dependency parse trees and language models to correctly understand question semantics. Our code is publicly available at https://​github.​com/​agfsghfdhg/​KAAGN-main.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Abujabal, A., Yahya, M., Riedewald, M., et al. (2017). Automated template generation for question answering over knowledge graphs. In: proceedings of the 26th international conference on world wide web. International World Wide Web Conferences Steering Committee, 1191–1200. https://doi.org/10.1145/3038912.3052583. Abujabal, A., Yahya, M., Riedewald, M., et al. (2017). Automated template generation for question answering over knowledge graphs. In: proceedings of the 26th international conference on world wide web. International World Wide Web Conferences Steering Committee, 1191–1200. https://​doi.​org/​10.​1145/​3038912.​3052583.
Zurück zum Zitat Das, R., Godbole, A., Naik, A., et al. (2022). Knowledge base question answering by case-based reasoning over subgraphs. In: Chaudhuri K, Jegelka S, Song L, et al. (eds) proceedings of the 39th international conference on machine learning, Proceedings of Machine Learning Research, 4777–4793. https://proceedings.mlr.press/v162/das22a.html. Das, R., Godbole, A., Naik, A., et al. (2022). Knowledge base question answering by case-based reasoning over subgraphs. In: Chaudhuri K, Jegelka S, Song L, et al. (eds) proceedings of the 39th international conference on machine learning, Proceedings of Machine Learning Research, 4777–4793. https://​proceedings.​mlr.​press/​v162/​das22a.​html.
Zurück zum Zitat Ding, J., Hu, W., Xu, Q., et al. (2019). Leveraging frequent query substructures to generate formal queries for complex question answering. In: Inui K, Jiang J, Ng V, et al. (eds) proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 2614–2622. https://doi.org/10.18653/v1/D19-1263. Ding, J., Hu, W., Xu, Q., et al. (2019). Leveraging frequent query substructures to generate formal queries for complex question answering. In: Inui K, Jiang J, Ng V, et al. (eds) proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 2614–2622. https://​doi.​org/​10.​18653/​v1/​D19-1263.
Zurück zum Zitat Dong, J., Zhang, Q., Huang, X., et al. (2023). Hierarchy-aware multi-hop question answering over knowledge graphs. In: proceedings of the ACM web conference 2023. Association for Computing Machinery, New York, NY, USA, WWW ’23, 2519–2527. https://doi.org/10.1145/3543507.3583376. Dong, J., Zhang, Q., Huang, X., et al. (2023). Hierarchy-aware multi-hop question answering over knowledge graphs. In: proceedings of the ACM web conference 2023. Association for Computing Machinery, New York, NY, USA, WWW ’23, 2519–2527. https://​doi.​org/​10.​1145/​3543507.​3583376.
Zurück zum Zitat Feng, Y., Chen, X., Lin, B.Y., et al. (2020). Scalable multi-hop relational reasoning for knowledge-aware question answering. In: proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Online, 1295–1309. https://doi.org/10.18653/v1/2020.emnlp-main.99. Feng, Y., Chen, X., Lin, B.Y., et al. (2020). Scalable multi-hop relational reasoning for knowledge-aware question answering. In: proceedings of the 2020 conference on empirical methods in natural language processing (EMNLP). Association for Computational Linguistics, Online, 1295–1309. https://​doi.​org/​10.​18653/​v1/​2020.​emnlp-main.​99.
Zurück zum Zitat He, G., Lan, Y., Jiang, J., et al. (2021). Improving multi-hop knowledge base question answering by learning intermediate supervision signals. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining. Association for Computing Machinery, WSDM ’21,553–561. https://doi.org/10.1145/3437963.3441753. He, G., Lan, Y., Jiang, J., et al. (2021). Improving multi-hop knowledge base question answering by learning intermediate supervision signals. In: Proceedings of the 14th ACM International Conference on Web Search and Data Mining. Association for Computing Machinery, WSDM ’21,553–561. https://​doi.​org/​10.​1145/​3437963.​3441753.
Zurück zum Zitat Liang, S., Wei, W., Mao, XL., et al. (2022b) BiSyn-GAT+: bi-syntax aware graph attention network for aspect-based sentiment analysis. In: findings of the association for computational linguistics: ACL 2022. Association for Computational Linguistics, Dublin, Ireland, 1835–1848. https://doi.org/10.18653/v1/2022.findings-acl.144. Liang, S., Wei, W., Mao, XL., et al. (2022b) BiSyn-GAT+: bi-syntax aware graph attention network for aspect-based sentiment analysis. In: findings of the association for computational linguistics: ACL 2022. Association for Computational Linguistics, Dublin, Ireland, 1835–1848. https://​doi.​org/​10.​18653/​v1/​2022.​findings-acl.​144.
Zurück zum Zitat Lin, B.Y., Chen, X., Chen, J., et al. (2019). KagNet: knowledge-aware graph networks for commonsense reasoning. In: proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 2829–2839. https://doi.org/10.18653/v1/D19-1282. Lin, B.Y., Chen, X., Chen, J., et al. (2019). KagNet: knowledge-aware graph networks for commonsense reasoning. In: proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics, Hong Kong, China, 2829–2839. https://​doi.​org/​10.​18653/​v1/​D19-1282.
Zurück zum Zitat Mihaylov, T., Clark, P., Khot, T., et al. (2018). Can a suit of armor conduct electricity? a new dataset for open book question answering. In: proceedings of the 2018 conference on empirical methods in natural language processing. Association for Computational Linguistics, Brussels, Belgium, 2381–2391. https://doi.org/10.18653/v1/D18-1260. Mihaylov, T., Clark, P., Khot, T., et al. (2018). Can a suit of armor conduct electricity? a new dataset for open book question answering. In: proceedings of the 2018 conference on empirical methods in natural language processing. Association for Computational Linguistics, Brussels, Belgium, 2381–2391. https://​doi.​org/​10.​18653/​v1/​D18-1260.
Zurück zum Zitat Qiao, Z., Ye, W., Zhang, T., et al. (2022). Exploiting hybrid semantics of relation paths for multi-hop question answering over knowledge graphs. In: proceedings of the 29th international conference on computational linguistics. International Committee on Computational Linguistics, 1813–1822. https://aclanthology.org/2022.coling-1.156. Qiao, Z., Ye, W., Zhang, T., et al. (2022). Exploiting hybrid semantics of relation paths for multi-hop question answering over knowledge graphs. In: proceedings of the 29th international conference on computational linguistics. International Committee on Computational Linguistics, 1813–1822. https://​aclanthology.​org/​2022.​coling-1.​156.
Zurück zum Zitat Saxena, A., Tripathi, A., & Talukdar, P. (2020). Improving multi-hop question answering over knowledge graphs using knowledge base embeddings. In: proceedings of the 58th annual meeting of the association for computational linguistics. Association for Computational Linguistics, Online, 4498–4507. https://doi.org/10.18653/v1/2020.acl-main.412. Saxena, A., Tripathi, A., & Talukdar, P. (2020). Improving multi-hop question answering over knowledge graphs using knowledge base embeddings. In: proceedings of the 58th annual meeting of the association for computational linguistics. Association for Computational Linguistics, Online, 4498–4507. https://​doi.​org/​10.​18653/​v1/​2020.​acl-main.​412.
Zurück zum Zitat Shen, T., Geng, X., Qin, T., et al. (2019). Multi-task learning for conversational question answering over a large-scale knowledge base. In: proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics, 2442–2451. https://doi.org/10.18653/v1/D19-1248. Shen, T., Geng, X., Qin, T., et al. (2019). Multi-task learning for conversational question answering over a large-scale knowledge base. In: proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics, 2442–2451. https://​doi.​org/​10.​18653/​v1/​D19-1248.
Zurück zum Zitat Sun, H., Bedrax-Weiss, T., & Cohen, W. (2019a). PullNet: open domain question answering with iterative retrieval on knowledge bases and text. In: proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics, 2380–2390. https://doi.org/10.18653/v1/D19-1242. Sun, H., Bedrax-Weiss, T., & Cohen, W. (2019a). PullNet: open domain question answering with iterative retrieval on knowledge bases and text. In: proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics, 2380–2390. https://​doi.​org/​10.​18653/​v1/​D19-1242.
Zurück zum Zitat Sun, K., Zhang, R., Mensah, S., et al. (2019b). Aspect-level sentiment analysis via convolution over dependency tree. In: proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics, 5679–5688. https://doi.org/10.18653/v1/D19-1569. Sun, K., Zhang, R., Mensah, S., et al. (2019b). Aspect-level sentiment analysis via convolution over dependency tree. In: proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing (EMNLP-IJCNLP). Association for Computational Linguistics, 5679–5688. https://​doi.​org/​10.​18653/​v1/​D19-1569.
Zurück zum Zitat Sun, Y., Shi, Q., Qi, L., et al. (2022). JointLK: joint reasoning with language models and knowledge graphs for commonsense question answering. In: proceedings of the 2022 conference of the north american chapter of the association for computational linguistics: human language technologies. Association for Computational Linguistics, 5049–5060. https://doi.org/10.18653/v1/2022.naacl-main.372. Sun, Y., Shi, Q., Qi, L., et al. (2022). JointLK: joint reasoning with language models and knowledge graphs for commonsense question answering. In: proceedings of the 2022 conference of the north american chapter of the association for computational linguistics: human language technologies. Association for Computational Linguistics, 5049–5060. https://​doi.​org/​10.​18653/​v1/​2022.​naacl-main.​372.
Zurück zum Zitat Talmor, A., Herzig, J., Lourie, N., et al. (2019). CommonsenseQA: a question answering challenge targeting commonsense knowledge. In: proceedings of the 2019 conference of the north american chapter of the association for computational linguistics: human language technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, 4149–4158. https://doi.org/10.18653/v1/N19-1421. Talmor, A., Herzig, J., Lourie, N., et al. (2019). CommonsenseQA: a question answering challenge targeting commonsense knowledge. In: proceedings of the 2019 conference of the north american chapter of the association for computational linguistics: human language technologies, Volume 1 (Long and Short Papers). Association for Computational Linguistics, 4149–4158. https://​doi.​org/​10.​18653/​v1/​N19-1421.
Zurück zum Zitat Xiong, W., Yu, M., Chang, S., et al. (2019) Improving question answering over incomplete KBs with knowledge-aware reader. In: proceedings of the 57th annual meeting of the association for computational linguistics. Association for Computational Linguistics, Florence, Italy, 4258–4264. https://doi.org/10.18653/v1/P19-1417. Xiong, W., Yu, M., Chang, S., et al. (2019) Improving question answering over incomplete KBs with knowledge-aware reader. In: proceedings of the 57th annual meeting of the association for computational linguistics. Association for Computational Linguistics, Florence, Italy, 4258–4264. https://​doi.​org/​10.​18653/​v1/​P19-1417.
Zurück zum Zitat Yasunaga, M., Ren, H., Bosselut, A., et al. (2021). QA-GNN: reasoning with language models and knowledge graphs for question answering. In: proceedings of the 2021 conference of the north american chapter of the association for computational linguistics: human language technologies. Association for Computational Linguistics, Online, 535–546. https://doi.org/10.18653/v1/2021.naacl-main.45. Yasunaga, M., Ren, H., Bosselut, A., et al. (2021). QA-GNN: reasoning with language models and knowledge graphs for question answering. In: proceedings of the 2021 conference of the north american chapter of the association for computational linguistics: human language technologies. Association for Computational Linguistics, Online, 535–546. https://​doi.​org/​10.​18653/​v1/​2021.​naacl-main.​45.
Zurück zum Zitat Zhang, M., Zhang, R., Zou, L., et al. (2021). NAMER: a node-based multitasking framework for multi-hop knowledge base question answering. In: proceedings of the 2021 conference of the north american chapter of the association for computational linguistics: human language technologies: demonstrations. Association for Computational Linguistics, Online, 18–25. https://doi.org/10.18653/v1/2021.naacl-demos.3. Zhang, M., Zhang, R., Zou, L., et al. (2021). NAMER: a node-based multitasking framework for multi-hop knowledge base question answering. In: proceedings of the 2021 conference of the north american chapter of the association for computational linguistics: human language technologies: demonstrations. Association for Computational Linguistics, Online, 18–25. https://​doi.​org/​10.​18653/​v1/​2021.​naacl-demos.​3.
Zurück zum Zitat Zhuang, L., Wayne, L., Ya, S., et al. (2021) A robustly optimized BERT pre-training approach with post-training. In: proceedings of the 20th Chinese National conference on computational linguistics. Chinese Information Processing Society of China, 1218–1227. https://aclanthology.org/2021.ccl-1.108. Zhuang, L., Wayne, L., Ya, S., et al. (2021) A robustly optimized BERT pre-training approach with post-training. In: proceedings of the 20th Chinese National conference on computational linguistics. Chinese Information Processing Society of China, 1218–1227. https://​aclanthology.​org/​2021.​ccl-1.​108.
Metadaten
Titel
Knowledge-aware adaptive graph network for commonsense question answering
verfasst von
Long Kang
Xiaoge Li
Xiaochun An
Publikationsdatum
19.03.2024
Verlag
Springer US
Erschienen in
Journal of Intelligent Information Systems
Print ISSN: 0925-9902
Elektronische ISSN: 1573-7675
DOI
https://doi.org/10.1007/s10844-024-00854-z