skip to main content
10.1145/3340531.3412760acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

Event-QA: A Dataset for Event-Centric Question Answering over Knowledge Graphs

Published:19 October 2020Publication History

ABSTRACT

Semantic Question Answering (QA) is a crucial technology to facilitate intuitive user access to semantic information stored in knowledge graphs. Whereas most of the existing QA systems and datasets focus on entity-centric questions, very little is known about these systems' performance in the context of events. As new event-centric knowledge graphs emerge, datasets for such questions gain importance. In this paper, we present the Event-QA dataset for answering event-centric questions over knowledge graphs. Event-QA contains 1000 semantic queries and the corresponding English, German and Portuguese verbalizations for EventKG - an event-centric knowledge graph with more than 970 thousand events.

Skip Supplemental Material Section

Supplemental Material

3340531.3412760.mp4

mp4

10.7 MB

References

  1. Dennis Diefenbach, Andreas Both, Kamal Singh, and Pierre Maret. 2020. Towards a Question Answering System over the Semantic Web. Semantic Web, Vol. 11, 3 (2020), 421--439.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Martin Doerr. 2003. The CIDOC Conceptual Reference Module: an Ontological Approach to Semantic Interoperability of Metadata. AI magazine, Vol. 24, 3 (2003), 75--75.Google ScholarGoogle Scholar
  3. Mohnish Dubey, Debayan Banerjee, Abdelrahman Abdelkawi, and Jens Lehmann. 2019. LC-QuAD 2.0: A Large Dataset for Complex Question Answering over Wikidata and DBpedia. In Proceedings of the International Semantic Web Conference. 69--78.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Simon Gottschalk, Viola Bernacchi, Richard Rogers, and Elena Demidova. 2018. Towards Better Understanding Researcher Strategies in Cross-Lingual Event Analytics. In Proceedings of the International Conference on Theory and Practice of Digital Libraries. 139--151.Google ScholarGoogle ScholarCross RefCross Ref
  5. Simon Gottschalk and Elena Demidova. 2018. EventKG: A Multilingual Event-Centric Temporal Knowledge Graph. In Proceedings of the Extended Semantic Web Conference. Springer, 272--287.Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Simon Gottschalk and Elena Demidova. 2019. EventKG - the Hub of Event Knowledge on the Web - and Biographical Timeline Generation. Semantic Web, Vol. 10, 6 (2019), 1039--1070.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Konrad Höffner, Sebastian Walter, Edgard Marx, Ricardo Usbeck, Jens Lehmann, and Axel-Cyrille Ngonga Ngomo. 2017. Survey on Challenges of Question Answering in the Semantic Web. Semantic Web, Vol. 8, 6 (2017), 895--920.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Zhen Jia, Abdalghani Abujabal, Rishiraj Saha Roy, Jannik Strötgen, and Gerhard Weikum. 2018. TempQuestions: A Benchmark for Temporal Question Answering. In Proceedings of the Web Conference. 1057--1062.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Kalev Leetaru and Philip A Schrodt. 2013. GDELT: Global Data on Events, Location, and Tone, 1979--2012. In ISA annual convention, Vol. 2. Citeseer, 1--49.Google ScholarGoogle Scholar
  10. Jens Lehmann, Robert Isele, Max Jakob, Anja Jentzsch, Dimitris Kontokostas, Pablo N. Mendes, Sebastian Hellmann, Mohamed Morsey, Patrick van Kleef, Sören Auer, and Christian Bizer. 2014. DBpedia -- A Large-scale, Multilingual Knowledge Base Extracted from Wikipedia. Semantic Web Journal, Vol. 6, 2 (2014), 167--195.Google ScholarGoogle ScholarCross RefCross Ref
  11. Axel-Cyrille Ngonga Ngomo, Lorenz Bü hmann, Christina Unger, Jens Lehmann, and Daniel Gerber. 2013. Sorry, I don't Speak SPARQL: Translating SPARQL Queries into Natural Language. In Proceedings of the International World Wide Web Conference. 977--988.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Thomas Rebele, Fabian Suchanek, Johannes Hoffart, Joanna Biega, Erdal Kuzey, and Gerhard Weikum. 2016. YAGO: A Multilingual Knowledge Base from Wikipedia, Wordnet, and GeoNames. In Proceedings of the International Semantic Web Conference. 177--185.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Richard Rogers. 2013. Digital Methods. MIT Press.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Marco Rospocher, Marieke van Erp, Piek Vossen, Antske Fokkens, Itziar Aldabe, German Rigau, Aitor Soroa, Thomas Ploeger, and Tessel Bogaard. 2016. Building Event-Centric Knowledge Graphs from News. Journal of Web Semantics , Vol. 37--38 (2016), 132--151.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Estela Saquete, J Luis Vicedo, Patricio Mart'inez-Barco, Rafael Munoz, and Hector Llorens. 2009. Enhancing QA Systems with Complex Temporal Question Processing Capabilities. Journal of Artificial Intelligence Research , Vol. 35 (2009), 775--811.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Saeedeh Shekarpour, Kemele M Endris, Ashwini Jaya Kumar, Denis Lukovnikov, Kuldeep Singh, Harsh Thakkar, and Christoph Lange. 2016. Question Answering on Linked Data: Challenges and Future Directions. In Proceedings of the International Conference Companion on World Wide Web. 693--698.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Alon Talmor and Jonathan Berant. 2018. The Web as a Knowledge-Base for Answering Complex Questions. In Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies. 641--651.Google ScholarGoogle ScholarCross RefCross Ref
  18. Priyansh Trivedi, Gaurav Maheshwari, Mohnish Dubey, and Jens Lehmann. 2017. LC-QuAD: A Corpus for Complex Question Answering over Knowledge Graphs. In Proceedings of the International Semantic Web Conference. 210--218.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Ricardo Usbeck, Ria Hari Gusmita, Axel-Cyrille Ngonga Ngomo, and Muhammad Saleem. 2018. 9th Challenge on Question Answering over Linked Data (QALD-9). In SemDeep-4 and NLIWOD-4. 58--64.Google ScholarGoogle Scholar
  20. Willem Robert Van Hage, Véronique Malaisé, Roxane Segers, Laura Hollink, and Guus Schreiber. 2011. Design and Use of the Simple Event Model (SEM). Web Semantics, Vol. 9, 2 (2011), 128--136.Google ScholarGoogle ScholarCross RefCross Ref
  21. Denny Vrandevcić. 2012. Wikidata: A New Platform for Collaborative Data Collection. In Proceedings of the International Conference on World Wide Web. ACM, 1063--1064.Google ScholarGoogle Scholar
  22. Hamid Zafar, Mohnish Dubey, Jens Lehmann, and Elena Demidova. 2020. IQA: Interactive Query Construction in Semantic Question Answering Systems. Journal of Web Semantics , Vol. 64 (2020), 100586.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Event-QA: A Dataset for Event-Centric Question Answering over Knowledge Graphs

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Conferences
        CIKM '20: Proceedings of the 29th ACM International Conference on Information & Knowledge Management
        October 2020
        3619 pages
        ISBN:9781450368599
        DOI:10.1145/3340531

        Copyright © 2020 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 19 October 2020

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

        Acceptance Rates

        Overall Acceptance Rate1,861of8,427submissions,22%

        Upcoming Conference

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader