Skip to main content

02.02.2024 | Research

Semantic-enhanced reasoning question answering over temporal knowledge graphs

Erschienen in: Journal of Intelligent Information Systems

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Question Answering Over Temporal Knowledge Graphs (TKGQA) is an important topic in question answering. TKGQA focuses on accurately understanding questions involving temporal constraints and retrieving accurate answers from knowledge graphs. In previous research, the hierarchical structure of question contexts and the constraints imposed by temporal information on different sentence components have been overlooked. In this paper, we propose a framework called “Semantic-Enhanced Reasoning Question Answering” (SERQA) to tackle this problem. First, we adopt a pretrained language model (LM) to obtain the question relation representation vector. Then, we leverage syntactic information from the constituent tree and dependency tree, in combination with Masked Self-Attention (MSA), to enhance temporal constraint features. Finally, we integrate the temporal constraint features into the question relation representation using an information fusion function for answer prediction. Experimental results demonstrate that SERQA achieves better performance on the CRONQUESTIONS and ImConstrainedQuestions datasets. In comparison with existing temporal KGQA methods, our model exhibits outstanding performance in comprehending temporal constraint questions. The ablation experiments verified the effectiveness of combining the constituent tree and the dependency tree with MSA in question answering.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Abujabal, A., Yahya, M., Riedewald, M., et al., (2017). Automated Template Generation for Question Answering over Knowledge Graphs. In: Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, WWW ’17, 1191–1200. https://doi.org/10.1145/3038912.3052583 Abujabal, A., Yahya, M., Riedewald, M., et al., (2017). Automated Template Generation for Question Answering over Knowledge Graphs. In: Proceedings of the 26th International Conference on World Wide Web. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, WWW ’17, 1191–1200. https://​doi.​org/​10.​1145/​3038912.​3052583
Zurück zum Zitat Bast, H., Haussmann, E. (2015). More accurate question answering on freebase. In: Proceedings of the 24th ACM international on conference on information and knowledge management. Association for Computing Machinery, New York, USA, CIKM ’15, 1431–1440. https://doi.org/10.1145/2806416.2806472 Bast, H., Haussmann, E. (2015). More accurate question answering on freebase. In: Proceedings of the 24th ACM international on conference on information and knowledge management. Association for Computing Machinery, New York, USA, CIKM ’15, 1431–1440. https://​doi.​org/​10.​1145/​2806416.​2806472
Zurück zum Zitat Berant, J., Chou, A.K., Frostig, R., et al., (2013). Semantic parsing on freebase from question-answer pairs. In: Conference on empirical methods in natural language processing Berant, J., Chou, A.K., Frostig, R., et al., (2013). Semantic parsing on freebase from question-answer pairs. In: Conference on empirical methods in natural language processing
Zurück zum Zitat Bordes, A., Usunier, N., Garcia-Duran, A., et al., (2013). Translating embeddings for modeling multi-relational data. In: Advances in neural information processing systems, vol 26. Curran Associates, Inc. Bordes, A., Usunier, N., Garcia-Duran, A., et al., (2013). Translating embeddings for modeling multi-relational data. In: Advances in neural information processing systems, vol 26. Curran Associates, Inc.
Zurück zum Zitat Das, R., Zaheer, M., Thai, D., et al., (2021). Case-based Reasoning for Natural Language Queries over Knowledge Bases. In: Proceedings of the 2021 conference on empirical methods in natural language processing. Association for Computational Linguistics, Online and Punta Cana, Dominican Republic, 9594–9611. https://doi.org/10.18653/v1/2021.emnlp-main.755 Das, R., Zaheer, M., Thai, D., et al., (2021). Case-based Reasoning for Natural Language Queries over Knowledge Bases. In: Proceedings of the 2021 conference on empirical methods in natural language processing. Association for Computational Linguistics, Online and Punta Cana, Dominican Republic, 9594–9611. https://​doi.​org/​10.​18653/​v1/​2021.​emnlp-main.​755
Zurück zum Zitat Dasgupta SS, Ray SN, Talukdar P (2018). HyTE: Hyperplane-based temporally aware knowledge graph embedding. In: Proceedings of the 2018 conference on empirical methods in natural language processing. Association for Computational Linguistics, Brussels, Belgium, 2001–2011, https://doi.org/10.18653/v1/D18-1225 Dasgupta SS, Ray SN, Talukdar P (2018). HyTE: Hyperplane-based temporally aware knowledge graph embedding. In: Proceedings of the 2018 conference on empirical methods in natural language processing. Association for Computational Linguistics, Brussels, Belgium, 2001–2011, https://​doi.​org/​10.​18653/​v1/​D18-1225
Zurück zum Zitat Fensel, D., Şimşek, U., Angele, K., et al., (2020). Introduction: What Is a Knowledge Graph? In: Fensel D, Şimşek U, Angele K, et al., (eds) Knowledge Graphs: Methodology, Tools and Selected Use Cases. Springer International Publishing, Cham, 1–10. https://doi.org/10.1007/978-3-030-37439-6_1 Fensel, D., Şimşek, U., Angele, K., et al., (2020). Introduction: What Is a Knowledge Graph? In: Fensel D, Şimşek U, Angele K, et al., (eds) Knowledge Graphs: Methodology, Tools and Selected Use Cases. Springer International Publishing, Cham, 1–10. https://​doi.​org/​10.​1007/​978-3-030-37439-6_​1
Zurück zum Zitat García-Durán, A., Dumančić, S., Niepert, M. (2018). Learning sequence encoders for temporal knowledge graph completion. In: Proceedings of the 2018 conference on empirical methods in natural language processing. Association for Computational Linguistics, Brussels, Belgium, 4816–4821. https://doi.org/10.18653/v1/D18-1516 García-Durán, A., Dumančić, S., Niepert, M. (2018). Learning sequence encoders for temporal knowledge graph completion. In: Proceedings of the 2018 conference on empirical methods in natural language processing. Association for Computational Linguistics, Brussels, Belgium, 4816–4821. https://​doi.​org/​10.​18653/​v1/​D18-1516
Zurück zum Zitat He, G., Lan, Y., Jiang, J., et al. (2021). Improving multi-hop knowledge base question answering by learning intermediate supervision signals. In: Proceedings of the 14th ACM international conference on web search and data mining. Association for Computing Machinery, New York, USA, WSDM ’21, 553–561, https://doi.org/10.1145/3437963.3441753 He, G., Lan, Y., Jiang, J., et al. (2021). Improving multi-hop knowledge base question answering by learning intermediate supervision signals. In: Proceedings of the 14th ACM international conference on web search and data mining. Association for Computing Machinery, New York, USA, WSDM ’21, 553–561, https://​doi.​org/​10.​1145/​3437963.​3441753
Zurück zum Zitat Jia, Z., Abujabal, A., Saha Roy, R., et al., (2018a). TempQuestions: A Benchmark for Temporal Question Answering. In: Companion proceedings of the the WebConference 2018. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, WWW ’18, 1057–1062. https://doi.org/10.1145/3184558.3191536 Jia, Z., Abujabal, A., Saha Roy, R., et al., (2018a). TempQuestions: A Benchmark for Temporal Question Answering. In: Companion proceedings of the the WebConference 2018. International World Wide Web Conferences Steering Committee, Republic and Canton of Geneva, CHE, WWW ’18, 1057–1062. https://​doi.​org/​10.​1145/​3184558.​3191536
Zurück zum Zitat Jia, Z., Abujabal, A., Saha Roy, R., et al., (2018b). TEQUILA: Temporal Question Answering over Knowledge Bases. In: Proceedings of the 27th ACM international conference on information and knowledge management. Association for Computing Machinery, New York, USA, CIKM ’18, 1807–1810. https://doi.org/10.1145/3269206.3269247 Jia, Z., Abujabal, A., Saha Roy, R., et al., (2018b). TEQUILA: Temporal Question Answering over Knowledge Bases. In: Proceedings of the 27th ACM international conference on information and knowledge management. Association for Computing Machinery, New York, USA, CIKM ’18, 1807–1810. https://​doi.​org/​10.​1145/​3269206.​3269247
Zurück zum Zitat Jia, Z., Pramanik, S., Saha Roy, R. et al. (2021). Complex temporal question answering on knowledge graphs. In: Proceedings of the 30th ACM international conference on information & knowledge management. Association for Computing Machinery, New York, USA, CIKM ’21, 792–802. https://doi.org/10.1145/3459637.3482416 Jia, Z., Pramanik, S., Saha Roy, R. et al. (2021). Complex temporal question answering on knowledge graphs. In: Proceedings of the 30th ACM international conference on information & knowledge management. Association for Computing Machinery, New York, USA, CIKM ’21, 792–802. https://​doi.​org/​10.​1145/​3459637.​3482416
Zurück zum Zitat Jiang, T., Liu, T., Ge, T. et al. (2016). Towards time-aware knowledge graph completion. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers. The COLING 2016 Organizing Committee, Osaka, Japan, 1715–1724 Jiang, T., Liu, T., Ge, T. et al. (2016). Towards time-aware knowledge graph completion. In: Proceedings of COLING 2016, the 26th international conference on computational linguistics: technical papers. The COLING 2016 Organizing Committee, Osaka, Japan, 1715–1724
Zurück zum Zitat Kingma, D.P., Ba, J. (2015). Adam: A method for stochastic optimization. In: Bengio Y, LeCun Y (eds) 3rd International conference on learning representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings Kingma, D.P., Ba, J. (2015). Adam: A method for stochastic optimization. In: Bengio Y, LeCun Y (eds) 3rd International conference on learning representations, ICLR 2015, San Diego, CA, USA, May 7-9, 2015, Conference Track Proceedings
Zurück zum Zitat Lacroix, T., Obozinski, G., Usunier, N. (2019). Tensor decompositions for temporal knowledge base completion. In: International Conference on Learning Representations Lacroix, T., Obozinski, G., Usunier, N. (2019). Tensor decompositions for temporal knowledge base completion. In: International Conference on Learning Representations
Zurück zum Zitat Lan, Y., Jiang, J. (2020). Query graph generation for answering multi-hop complex questions from knowledge bases. In: Proceedings of the 58th annual meeting of the association for computational linguistics. Association for Computational Linguistics, Online, 969–974. https://doi.org/10.18653/v1/2020.acl-main.91 Lan, Y., Jiang, J. (2020). Query graph generation for answering multi-hop complex questions from knowledge bases. In: Proceedings of the 58th annual meeting of the association for computational linguistics. Association for Computational Linguistics, Online, 969–974. https://​doi.​org/​10.​18653/​v1/​2020.​acl-main.​91
Zurück zum Zitat Lan, Y., He, G., Jiang, J., et al. (2021). A survey on complex knowledge base question answering: Methods, challenges and solutions. In: Proceedings of the thirtieth international joint conference on artificial intelligence. International Joint Conferences on Artificial Intelligence Organization, Montreal, Canada, 4483–4491. https://doi.org/10.24963/ijcai.2021/611 Lan, Y., He, G., Jiang, J., et al. (2021). A survey on complex knowledge base question answering: Methods, challenges and solutions. In: Proceedings of the thirtieth international joint conference on artificial intelligence. International Joint Conferences on Artificial Intelligence Organization, Montreal, Canada, 4483–4491. https://​doi.​org/​10.​24963/​ijcai.​2021/​611
Zurück zum Zitat Liang, S., Wei, W., Mao, X. L., et al. (2022). Bisyn-gat+: Bi-syntax aware graph attention network for aspect-based sentiment analysis. Findings of the Association for Computational Linguistics: ACL, 2022, 1835–1848. Liang, S., Wei, W., Mao, X. L., et al. (2022). Bisyn-gat+: Bi-syntax aware graph attention network for aspect-based sentiment analysis. Findings of the Association for Computational Linguistics: ACL, 2022, 1835–1848.
Zurück zum Zitat Luo, K., Lin, F., Luo, X. et al. (2018). Knowledge base question answering via encoding of complex query graphs. In: Proceedings of the 2018 conference on empirical methods in natural language processing. Association for Computational Linguistics, Brussels, Belgium, 2185–2194. https://doi.org/10.18653/v1/D18-1242 Luo, K., Lin, F., Luo, X. et al. (2018). Knowledge base question answering via encoding of complex query graphs. In: Proceedings of the 2018 conference on empirical methods in natural language processing. Association for Computational Linguistics, Brussels, Belgium, 2185–2194. https://​doi.​org/​10.​18653/​v1/​D18-1242
Zurück zum Zitat Miller, A., Fisch, A., Dodge, J., et al. (2016). Key-value memory networks for directly reading documents. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 1400–1409 Miller, A., Fisch, A., Dodge, J., et al. (2016). Key-value memory networks for directly reading documents. In: Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing, 1400–1409
Zurück zum Zitat Saxena, A., Tripathi, A., Talukdar, P. (2020). Improving multi-hop question answering over knowledge graphs using knowledge base embeddings. In: Proceedings of the 58th annual meeting of the association for computational linguistics. Association for Computational Linguistics, Online, 4498–4507, https://doi.org/10.18653/v1/2020.acl-main.412 Saxena, A., Tripathi, A., Talukdar, P. (2020). Improving multi-hop question answering over knowledge graphs using knowledge base embeddings. In: Proceedings of the 58th annual meeting of the association for computational linguistics. Association for Computational Linguistics, Online, 4498–4507, https://​doi.​org/​10.​18653/​v1/​2020.​acl-main.​412
Zurück zum Zitat Saxena, A., Chakrabarti, S., Talukdar, P. (2021). Question answering over temporal knowledge graphs. In: Proceedings of the 59th annual meeting of the association for computational linguistics and the 11th international joint conference on natural language processing (vol 1: Long Papers). Association for Computational Linguistics, Online, 6663–6676. https://doi.org/10.18653/v1/2021.acl-long.520 Saxena, A., Chakrabarti, S., Talukdar, P. (2021). Question answering over temporal knowledge graphs. In: Proceedings of the 59th annual meeting of the association for computational linguistics and the 11th international joint conference on natural language processing (vol 1: Long Papers). Association for Computational Linguistics, Online, 6663–6676. https://​doi.​org/​10.​18653/​v1/​2021.​acl-long.​520
Zurück zum Zitat Sun, H., Bedrax-Weiss, T., Cohen, W. (2019). PullNet: open domain question answering with iterative retrieval on knowledge bases and text. Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing 2380–2390. https://doi.org/10.18653/v1/D19-1242 Sun, H., Bedrax-Weiss, T., Cohen, W. (2019). PullNet: open domain question answering with iterative retrieval on knowledge bases and text. Proceedings of the 2019 conference on empirical methods in natural language processing and the 9th international joint conference on natural language processing 2380–2390. https://​doi.​org/​10.​18653/​v1/​D19-1242
Zurück zum Zitat Sun, K., Li, Z., Zhao, H. (2022). Reorder and then parse, fast and accurate discontinuous constituency parsing. In: Proceedings of the 2022 conference on empirical methods in natural language processing. Association for Computational Linguistics, Abu Dhabi, United Arab Emirates, 10575–10588. https://doi.org/10.18653/v1/2022.emnlp-main.723 Sun, K., Li, Z., Zhao, H. (2022). Reorder and then parse, fast and accurate discontinuous constituency parsing. In: Proceedings of the 2022 conference on empirical methods in natural language processing. Association for Computational Linguistics, Abu Dhabi, United Arab Emirates, 10575–10588. https://​doi.​org/​10.​18653/​v1/​2022.​emnlp-main.​723
Zurück zum Zitat Trouillon, T., Welbl, J., Riedel, S., et al. (2016). Complex embeddings for simple link prediction. In: Proceedings of the 33rd international conference on machine learning. PMLR, 2071–2080 Trouillon, T., Welbl, J., Riedel, S., et al. (2016). Complex embeddings for simple link prediction. In: Proceedings of the 33rd international conference on machine learning. PMLR, 2071–2080
Zurück zum Zitat Wang, J., Li, X., An, X. (2022). Modeling multiple latent information graph structures via graph convolutional network for aspect-based sentiment analysis. Complex & Intelligent Systems 1–12 Wang, J., Li, X., An, X. (2022). Modeling multiple latent information graph structures via graph convolutional network for aspect-based sentiment analysis. Complex & Intelligent Systems 1–12
Zurück zum Zitat Yih, Wt, Chang, M.W., He, X., et al. (2015). Semantic parsing via staged query graph generation: Question answering with knowledge base. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (vol 1: Long Papers). Association for Computational Linguistics, Beijing, China, 1321–1331. https://doi.org/10.3115/v1/P15-1128 Yih, Wt, Chang, M.W., He, X., et al. (2015). Semantic parsing via staged query graph generation: Question answering with knowledge base. In: Proceedings of the 53rd annual meeting of the association for computational linguistics and the 7th international joint conference on natural language processing (vol 1: Long Papers). Association for Computational Linguistics, Beijing, China, 1321–1331. https://​doi.​org/​10.​3115/​v1/​P15-1128
Zurück zum Zitat Zhang, Y., Zhou, H, Li, Z. (2021). Fast and accurate neural CRF constituency parsing. In: Proceedings of the twenty-ninth international joint conference on artificial intelligence, Yokohama, Japan, IJCAI’20, 4046–4053 Zhang, Y., Zhou, H, Li, Z. (2021). Fast and accurate neural CRF constituency parsing. In: Proceedings of the twenty-ninth international joint conference on artificial intelligence, Yokohama, Japan, IJCAI’20, 4046–4053
Metadaten
Titel
Semantic-enhanced reasoning question answering over temporal knowledge graphs
Publikationsdatum
02.02.2024
Erschienen in
Journal of Intelligent Information Systems
Print ISSN: 0925-9902
Elektronische ISSN: 1573-7675
DOI
https://doi.org/10.1007/s10844-024-00840-5