Skip to main content
Fachgebiete
Automobil + Motoren Bauwesen + Immobilien Business IT + Informatik Elektrotechnik + Elektronik Energie + Nachhaltigkeit Finance + Banking Management + Führung Marketing + Vertrieb Maschinenbau + Werkstoffe Versicherung + Risiko
DE
EN
Themenseiten
Organisationspsychologie Projektmanagement Marketing Smart Manufacturing
Bücher
Zeitschriften
Weitere Formate
Podcasts Webinare Technik Webinare Wirtschaft Kongresse Veranstaltungskalender Awards
Jetzt Einzelzugang starten
Zugang für Unternehmen
Referenzkunden
MTZ-Fachkongress

Antriebe und Energiesysteme von morgen


Austausch von Automobil- und Energiewirtschaft

Am 14./15. Mai geht es in Chemnitz um die Mobilitätswende durch Elektro- und Wasserstofffahrzeuge.
Erweiterte Suche
Anmelden
nach oben
Discover Computing
Erschienen in: Discover Computing 4-5/2021

15.07.2021

Strong natural language query generation

verfasst von: Binsheng Liu, Xiaolu Lu, J. Shane Culpepper

Erschienen in: Discover Computing | Ausgabe 4-5/2021

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper, we propose a novel query generation task we refer to as the Strong Natural Language Query (SNLQ) problem. The key idea we explore is how to best learn document summarization and ranker effectiveness jointly in order to generate human-readable queries which capture the information need conveyed by a document, and that can also be used for refinding tasks and query rewriting. Our problem is closely related to two well-known retrieval problems—known-item finding and strong query generation—with the additional objective of maximizing query informativeness. In order to achieve this goal, we combine state-of-the-art abstractive summarization techniques and reinforcement learning. We have empirically compared our new approaches with several closely related baselines using the MS-MARCO data collection, and show that the approach is capable of achieving substantially better trade-off between effectiveness and human-readability than have been reported previously.
Vorheriger Artikel Using word semantic concepts for plagiarism detection in text documents
Nächster Artikel Variational Bayesian representation learning for grocery recommendation

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Jetzt informieren
Fußnoten
1
https://github.com/pytorch/fairseq
 
2
https://github.com/abisee/cnn-dailymail
 
3
https://msmarco.blob.core.windows.net/msmarcoranking/msmarco-docdev-qrels.tsv.gz
 
4
https://msmarco.blob.core.windows.net/msmarcoranking/msmarco-doctrain-qrels.tsv.gz
 
5
https://spacy.io
 
6
https://github.com/rsennrich/subword-nmt
 
7
https://github.com/pisa-engine/pisa
 
8
https://github.com/huggingface/transformers
 
Literatur
Ahmad, WU., Chang, KW., & Wang, H. (2019). Context attentive document ranking and query suggestion. In: Proc. SIGIR, pp 385–394
Azzopardi, L., & de Rijke, M. (2006). Automatic Construction of Known-item Finding Test Beds. In: Proc. SIGIR, pp 603–604
Azzopardi, L., de Rijke, M., & Balog, K. (2007). Building simulated queries for known-item topics: An Analysis using Six European Languages. In: Proc. SIGIR, pp 455–462
Bailey, P., Moffat, A., Scholer, F., & Thomas, P. (2016). UQV100: A test collection with query variability. In: Proc. SIGIR, pp 725–728
Bailey, P., Moffat, A., Scholer, F., & Thomas, P. (2017). Retrieval consistency in the presence of query variations. In: Proc. SIGIR, pp 395–404
Belkin, N.J., Cool, C., Croft, WB., & Callan, J.P. (1993). The effect of multiple query variations on information retrieval system performance. In: Proc. SIGIR, pp 339–346
Bendersky, M., Metzler, D., & Croft, WB. (2012). Effective query formulation with multiple information sources. In: Proc. WSDM, pp 443–452
Berger, A., & Lafferty, J. (1999). Information retrieval as statistical translation. In: Proc. SIGIR, pp 222–229
Bertsekas, D., & Tsitsiklis, J. (1995). Neuro-dynamic programming: An overview. In: Proceedings of 1995 34th IEEE Conference on Decision and Control, vol 1, pp 560–564
Boldi, P., Bonchi, F., Castillo, C., Donato, D., Gionis, A., & Vigna, S. (2008). The query-flow graph: Model and applications. In: Proc. CIKM, pp 609–618
Cai, F., & de Rijke, M. (2016). A survey of query auto completion in information retrieval. Foundations and Trends in Information Retrieval, 10(4), 273–363.CrossRef
Callan, J., & Connell, M. (2001). Query-based sampling of text databases. ACM Transactions on Information Systems, 19(2), 97–130.CrossRef
Clark, K., Khandelwal, U., Levy, O., & Manning, CD. (2019). What does BERT look at? An analysis of BERT’s attention. In: Proc. BlackboxNLP@ACL, pp 276–286
Clarke, J., & Lapata, M. (2006). Models for sentence compression: A comparison across domains, training requirements and evaluation measures. In: Proc. ACL, pp 377–384
Cohan, A., Dernoncourt, F., Kim, DS., Bui, T., Kim, S., Chang, W., & Goharian, N. (2018). A discourse-aware attention model for abstractive summarization of long documents. In: Proc. NAACL-HLT
Crane, M., Culpepper, J.S., Lin, J., Mackenzie, J., & Trotman, A. (2017). A comparison of document-at-a-time and score-at-a-time query evaluation. In: Proc. WSDM, pp 201–210
Dai, Z., & Callan, J. (2019). Deeper text understanding for IR with contextual neural language modeling. In: Proc. SIGIR, pp 985–988
Dang, V., & Croft, WB. (2010). Query reformulation using anchor text. In: Proc. WSDM, pp 41–50
Dawid, A. P., & Skene, A. M. (1979). Maximum likelihood estimation of observer error-rates using the EM algorithm. Journal of the Royal Statistical Society Series C (Applied Statistics), 28(1), 20–28.
Dong, L., Yang, N., Wang, W., Wei, F., Liu, X., Wang, Y., Gao, J., Zhou, M., & Hon, HW. (2019). Unified language model pre-training for natural language understanding and generation. In: Proc. NeurIPS, pp 13042–13054
Dulac-Arnold, G., Evans, R., van Hasselt, H., Sunehag, P., Lillicrap, T., Hunt, J., Mann, T., Weber, T., Degris, T., & Coppin, B. (2016). Deep Reinforcement Learning in Large Discrete Action Spaces. arXiv:151207679 [cs, stat] 1512.07679
Filippova, K., & Altun, Y. (2013). Overcoming the lack of parallel data in sentence compression. In: Proc. EMNLP, pp 1481–1491
Gupta, M., & Bendersky, M. (2015). Information retrieval with verbose queries. Foundations and Trends in Information Retrieval, 9(3–4), 209–354.CrossRef
Hashimoto, T.B., Zhang, H., & Liang, P. (2019). Unifying human and statistical evaluation for natural language generation. In: Proc. NAACL-HLT, pp 1689–1701
Hauff, C., Hagen, M., Beyer, A., & Stein, B. (2012). Towards realistic known-item topics for the clueweb. In: Proc. IIiX, pp 274–277
He, Y., Tang, J., Ouyang, H., Kang, C., Yin, D., & Chang, Y. (2016). Learning to rewrite queries. In: Proc. CIKM, pp 1443–1452
Huang, C. K., Chien, L. F., & Oyang, Y. J. (2003). Relevant term suggestion in interactive web search based on contextual information in query session logs. Journal of the American Society for Information Science and Technology, 54(7), 638–649.CrossRef
Ipeirotis, PG., Provost, F., & Wang, J. (2010). Quality management on Amazon Mechanical Turk. In: Proc. SIGKDD Workshop HCOMP, p 64
Jiang, J.Y., & Wang, W. (2018). Rin: reformulation inference network for context-aware query suggestion. In: Proc. CIKM, pp 197–206
Joglekar, M., Garcia-Molina, H., & Parameswaran, A. (2013). Evaluating the crowd with confidence. In: Proc. KDD, pp 686–694
Joglekar, M., Garcia-Molina, H., & Parameswaran, A. (2015). Comprehensive and reliable crowd assessment algorithms. In: Proc. ICDE, pp 195–206
Kann, K., Rothe, S., & Filippova, K. (2018). Sentence-level fluency evaluation: References help, but can be spared! In: Proc. ACL, pp 313–323
Koenemann, J., & Belkin, NJ. (1996). A case for interaction: A study of interactive information retrieval behavior and effectiveness. In: Proc. SIGCHI, pp 205–212
Kumar, R., Lattanzi, S., & Raghavan, P. (2011). An Algorithmic Treatment of Strong Queries. In: Proc. WSDM, pp 775–784
Lavrenko, V., & Croft, WB. (2001). Relevance based language models. In: Proc. SIGIR, pp 120–127
Lee, CJ., & Croft, WB. (2012). Generating Queries from User-Selected Text. In: Proc. IIiX, pp 100–109
Liu B, Craswell N, Lu X, Kurland O, Culpepper JS (2019) A Comparative Analysis of Human and Automatic Query Variants. In: Proc. ICTIR, p 4
Muramatsu, J., & Pratt, W. (2001). Transparent queries: Investigation users’ mental models of search engines. In: Proc. SIGIR, pp 217–224
Nallapati, R., Zhou, B., dos Santos, C., Gulcehre, C., & Xiang, B. (2016). Abstractive text summarization using sequence-to-sequence rnns and beyond. In: Proc. SIGNLL, pp 280–290
Nogueira, R., Yang, W., Lin, J., & Cho, K. (2019). Document expansion by query prediction. arXiv:190408375
Ogilvie, P., & Callan, J. (2003). Combining Document Representations for Known-Item Search. In: Proc. SIGIR, pp 143–150
Ott, M., Edunov, S., Baevski, A., Fan, A., Gross, S., Ng, N., Grangier, D., & Auli, M. (2019). fairseq: A fast, extensible toolkit for sequence modeling. In: Proc. ACL, pp 48–53
Paulus, R., Xiong, C., & Socher, R. (2018). A Deep Reinforced Model for Abstractive Summarization. In: Proc. ICLR
Hung, Quoc Viet, & N., Tam, N. T., Tran, L. N., & Aberer, K. . (2013). An Evaluation of Aggregation Techniques in Crowdsourcing. Proc. WISE, 8181, 1–15.
Raffel, C., Shazeer, N., Roberts, A., Lee, K., Narang, S., Matena, M., et al. (2020). Exploring the limits of transfer learning with a unified text-to-text transformer. Journal of Machine Learning Research, 21(140), 1–67.MathSciNetMATH
See, A., Liu, PJ., & Manning, CD. (2017). Get to the point: Summarization with pointer-generator networks. In: Proc. ACL, pp 1073–1083
Sheldon, D., Shokouhi, M., Szummer, M., & Craswell, N. (2011). Lambdamerge: merging the results of query reformulations. In: Proc. WSDM, pp 795–804
Sinha, VB., Rao, S., & Balasubramanian, VN. (2018). Fast Dawid-Skene: A Fast Vote Aggregation Scheme for Sentiment Classification. In: Proc. KDD WISDOM, p 8
Sordoni, A., Bengio, Y., Vahabi, H., Lioma, C., Simonsen, JG., & Nie, JY. (2015). A hierarchical recurrent encoder-decoder for generative context-aware query suggestion. In: Proc. CIKM, pp 553–562
Sutton, R. S. (2018). & Barto, AG. An introduction: Reinforcement learning.
Teevan, J. (2007). The Re: search engine: simultaneous support for finding and re-finding. In: Proc. UIST, pp 23–32
Thomas, P., Billerbeck, B., Craswell, N., & White, R. W. (2019). Investigating searchers’ mental models to inform search explanations. ACM Transactions on Information Systems, 38(1), 1–25.CrossRef
Toutanova, K., Brockett, C., Tran, KM., & Amershi, S. (2016). A Dataset and Evaluation Metrics for Abstractive Compression of Sentences and Short Paragraphs. In: Proc. EMNLP, pp 340–350
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, AN., Kaiser, Ł., & Polosukhin, I. (2017). Attention is all you need. In: Proc. NeurIPS, pp 6000–6010
Williams, R. J. (1992). Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning, 8(3), 229–256.MATHCrossRef
Williams, R. J., & Zipser, D. (1989). A learning algorithm for continually running fully recurrent neural networks. Neural Computation, 1(2), 270–280.CrossRef
Wu, B., Xiong, C., Sun, M., & Liu, Z. (2018). Query suggestion with feedback memory network. In: Proc. WWW, pp 1563–1571
Xue, X., & Croft, W. B. (2013). Modeling reformulation using query distributions. ACM Trans Inf Syst, 31(2), 6:1-6:34.
Zahavy, T., Haroush, M., Merlis, N., Mankowitz, DJ., & Mannor, S. (2018). Learn What Not to Learn: Action Elimination with Deep Reinforcement Learning. Advances in Neural Information Processing Systems pp 3562–3573
Metadaten
Titel
Strong natural language query generation
verfasst von
Binsheng Liu
Xiaolu Lu
J. Shane Culpepper
Publikationsdatum
15.07.2021
Verlag
Springer Netherlands
Erschienen in
Discover Computing / Ausgabe 4-5/2021
Print ISSN: 2948-2984
Elektronische ISSN: 2948-2992
DOI
https://doi.org/10.1007/s10791-021-09395-3

Premium Partner

    Bildnachweise