Skip to main content
Top

2022 | OriginalPaper | Chapter

Does Structure Matter? Leveraging Data-to-Text Generation for Answering Complex Information Needs

Authors : Hanane Djeddal, Thomas Gerald, Laure Soulier, Karen Pinel-Sauvagnat, Lynda Tamine

Published in: Advances in Information Retrieval

Publisher: Springer International Publishing

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this work, our aim is to provide a structured answer in natural language to a complex information need. Particularly, we envision using generative models from the perspective of data-to-text generation. We propose the use of a content selection and planning pipeline which aims at structuring the answer by generating intermediate plans. The experimental evaluation is performed using the TREC Complex Answer Retrieval (CAR) dataset. We evaluate both the generated answer and its corresponding structure and show the effectiveness of planning-based models in comparison to a text-to-text model.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The large train set for training, and the Y1 benchmark test set for testing.
 
Literature
1.
go back to reference Ahmad, W.U., Chang, K., Wang, H.: Context attentive document ranking and query suggestion. In: Proceedings of the 42nd International ACM SIGIR, SIGIR 2019, pp. 385–394 (2019) Ahmad, W.U., Chang, K., Wang, H.: Context attentive document ranking and query suggestion. In: Proceedings of the 42nd International ACM SIGIR, SIGIR 2019, pp. 385–394 (2019)
2.
go back to reference Asai, A., Hashimoto, K., Hajishirzi, H., Socher, R., Xiong, C.: Learning to retrieve reasoning paths over wikipedia graph for question answering. In: International Conference on Learning Representations (2020) Asai, A., Hashimoto, K., Hajishirzi, H., Socher, R., Xiong, C.: Learning to retrieve reasoning paths over wikipedia graph for question answering. In: International Conference on Learning Representations (2020)
3.
go back to reference Banerjee, S., Lavie, A.: Meteor: An automatic metric for mt evaluation with improved correlation with human judgments. In: Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pp. 65–72 (2005) Banerjee, S., Lavie, A.: Meteor: An automatic metric for mt evaluation with improved correlation with human judgments. In: Proceedings of the ACL Workshop on Intrinsic and Extrinsic Evaluation Measures for Machine Translation and/or Summarization, pp. 65–72 (2005)
4.
go back to reference Chen, D., Fisch, A., Weston, J., Bordes, A.: Reading wikipedia to answer open-domain questions. ACL (2017) Chen, D., Fisch, A., Weston, J., Bordes, A.: Reading wikipedia to answer open-domain questions. ACL (2017)
5.
go back to reference Culpepper, J.S., Diaz, F., Smucker, M.D.: Research frontiers in information retrieval: Report from the third strategic workshop on information retrieval in lorne (SWIRL 2018). SIGIR Forum 1, 34–90 (2018)CrossRef Culpepper, J.S., Diaz, F., Smucker, M.D.: Research frontiers in information retrieval: Report from the third strategic workshop on information retrieval in lorne (SWIRL 2018). SIGIR Forum 1, 34–90 (2018)CrossRef
6.
go back to reference Dietz, L., Verma, M., Radlinski, F., Craswell, N.: Trec complex answer retrieval overview. In: TREC (2017) Dietz, L., Verma, M., Radlinski, F., Craswell, N.: Trec complex answer retrieval overview. In: TREC (2017)
7.
go back to reference Hassan Awadallah, A., White, R.W., Pantel, P., Dumais, S.T., Wang, Y.M.: Supporting complex search tasks. In: CIKM 2014 Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, New York, NY, USA, pp. 829–838 (2014) Hassan Awadallah, A., White, R.W., Pantel, P., Dumais, S.T., Wang, Y.M.: Supporting complex search tasks. In: CIKM 2014 Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management, New York, NY, USA, pp. 829–838 (2014)
8.
go back to reference Lin, C.Y.: Rouge: A package for automatic evaluation of summaries. In: Text Summarization Branches Out, pp. 74–81 (2004) Lin, C.Y.: Rouge: A package for automatic evaluation of summaries. In: Text Summarization Branches Out, pp. 74–81 (2004)
9.
go back to reference Min, S., Zhong, V., Zettlemoyer, L., Hajishirzi, H.: Multi-hop reading comprehension through question decomposition and rescoring. In: ACL (2019) Min, S., Zhong, V., Zettlemoyer, L., Hajishirzi, H.: Multi-hop reading comprehension through question decomposition and rescoring. In: ACL (2019)
10.
go back to reference Puduppully, R., Dong, L., Lapata, M.: Data-to-text generation with content selection and planning. In: The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, pp. 6908–6915 (2019) Puduppully, R., Dong, L., Lapata, M.: Data-to-text generation with content selection and planning. In: The Thirty-Third AAAI Conference on Artificial Intelligence, AAAI 2019, pp. 6908–6915 (2019)
11.
go back to reference Radford, A., Narasimhan, K.: Improving language understanding by generative pre-training (2018) Radford, A., Narasimhan, K.: Improving language understanding by generative pre-training (2018)
12.
go back to reference Raffel, C., et al.: Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res. 21(140), 1–67 (2020)MathSciNetMATH Raffel, C., et al.: Exploring the limits of transfer learning with a unified text-to-text transformer. J. Mach. Learn. Res. 21(140), 1–67 (2020)MathSciNetMATH
13.
go back to reference Scialom, T., et al.: Questeval: Summarization asks for fact-based evaluation. arXiv (2021) Scialom, T., et al.: Questeval: Summarization asks for fact-based evaluation. arXiv (2021)
14.
go back to reference Song, L., Wang, Z., Hamza, W., Zhang, Y., Gildea, D.: Leveraging context information for natural question generation. In: Walker, M.A., Ji, H., Stent, A. (eds.) Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 569–574. Association for Computational Linguistics (2018) Song, L., Wang, Z., Hamza, W., Zhang, Y., Gildea, D.: Leveraging context information for natural question generation. In: Walker, M.A., Ji, H., Stent, A. (eds.) Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, pp. 569–574. Association for Computational Linguistics (2018)
15.
go back to reference Sordoni, A., Bengio, Y., Vahabi, H., Lioma, C., Grue Simonsen, J., Nie, J.Y.: A hierarchical recurrent encoder-decoder for generative context-aware query suggestion. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. Association for Computing Machinery, CIKM 2015, pp. 553–562 (2015) Sordoni, A., Bengio, Y., Vahabi, H., Lioma, C., Grue Simonsen, J., Nie, J.Y.: A hierarchical recurrent encoder-decoder for generative context-aware query suggestion. In: Proceedings of the 24th ACM International on Conference on Information and Knowledge Management. Association for Computing Machinery, CIKM 2015, pp. 553–562 (2015)
16.
go back to reference Tan, C., Wei, F., Yang, N., Du, B., Lv, W., Zhou, M.: S-net: From answer extraction to answer synthesis for machine reading comprehension. In: AAAI (2018) Tan, C., Wei, F., Yang, N., Du, B., Lv, W., Zhou, M.: S-net: From answer extraction to answer synthesis for machine reading comprehension. In: AAAI (2018)
17.
go back to reference Tu, M., Wang, G., Huang, J., Tang, Y., He, X., Zhou, B.: Multi-hop reading comprehension across multiple documents by reasoning over heterogeneous graphs. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics ACL (2019) Tu, M., Wang, G., Huang, J., Tang, Y., He, X., Zhou, B.: Multi-hop reading comprehension across multiple documents by reasoning over heterogeneous graphs. In: Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics ACL (2019)
18.
go back to reference Wang, Y., et al.: Multi-passage machine reading comprehension with cross-passage answer verification. CoRR (2018) Wang, Y., et al.: Multi-passage machine reading comprehension with cross-passage answer verification. CoRR (2018)
19.
go back to reference White, R.W., Roth, R.A.: Exploratory Search: Beyond the Query-Response Paradigm. Morgan & Claypool Publishers, [San Rafael, Calif.] (2009) White, R.W., Roth, R.A.: Exploratory Search: Beyond the Query-Response Paradigm. Morgan & Claypool Publishers, [San Rafael, Calif.] (2009)
20.
go back to reference Wildemuth, B.M., Freund, L.: Assigning search tasks designed to elicit exploratory search behaviors. In: HCIR 2012, Proceedings of the Symposium on Human-Computer Interaction and Information Retrieval. ACM, pp. 1–10 (2012) Wildemuth, B.M., Freund, L.: Assigning search tasks designed to elicit exploratory search behaviors. In: HCIR 2012, Proceedings of the Symposium on Human-Computer Interaction and Information Retrieval. ACM, pp. 1–10 (2012)
21.
go back to reference Yang, H., Guan, D., Zhang, S.: The query change model: Modeling session search as a Markov decision process. ACM Trans. Inf. Syst. 33(4), 20:1–20:33 (2015) Yang, H., Guan, D., Zhang, S.: The query change model: Modeling session search as a Markov decision process. ACM Trans. Inf. Syst. 33(4), 20:1–20:33 (2015)
22.
go back to reference Yang, Z., et al.: HotpotQA: a dataset for diverse, explainable multi-hop question answering. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing ACL, pp. 2369–2380 (2018) Yang, Z., et al.: HotpotQA: a dataset for diverse, explainable multi-hop question answering. In: Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing ACL, pp. 2369–2380 (2018)
23.
go back to reference Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., Artzi, Y.: Bertscore: Evaluating text generation with bert. arXiv preprint (2019) Zhang, T., Kishore, V., Wu, F., Weinberger, K.Q., Artzi, Y.: Bertscore: Evaluating text generation with bert. arXiv preprint (2019)
24.
go back to reference Zhang, X., et al.: Answer complex questions: path ranker is all you need. In: SIGIR 2021, pp. 449–458. ACM (2021) Zhang, X., et al.: Answer complex questions: path ranker is all you need. In: SIGIR 2021, pp. 449–458. ACM (2021)
Metadata
Title
Does Structure Matter? Leveraging Data-to-Text Generation for Answering Complex Information Needs
Authors
Hanane Djeddal
Thomas Gerald
Laure Soulier
Karen Pinel-Sauvagnat
Lynda Tamine
Copyright Year
2022
DOI
https://doi.org/10.1007/978-3-030-99739-7_11