Egidio Terra
ABSTRACT
An usual approach to address mismatching vocabulary problem is to augment the original query using dictionaries and other lexical resources and/or by looking at pseudo-relevant documents. Either way, terms are added to form a new query that will be used to score all documents in a subsequent retrieval pass, and as consequence the original query's focus may drift because of the newly added terms. We propose a new method to address the mismatching vocabulary problem, expanding original query terms only when necessary and complementing the user query for missing terms while scoring documents. It allows related semantic aspects to be included in a conservative and selective way, thus reducing the possibility of query drift. Our results using replacements for the <i>missing query terms</i> in modified document and passages retrieval methods show significant improvement over the original ones.
- A. Berger and J.Lafferty.Information retrieval as statistical translation. In Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval pages 222--229, 1999.]] Google Scholar
Digital Library
- C. Buckley, G. Salton, J. Allan, and A. Singhal. Automatic query expansion using SMART: TREC 3. In In proceedings of Third Text REtrieval Conference Gaithersburg, MD, 1994.]]Google Scholar
- D. Carmel, E. Farchi, Y. Petruschka, and A. Soffer. Automatic query refinement using lexical affinities with maximal information gain. In Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval pages 283--290, Tampere, Finland, 2002.]] Google ScholarDigital Library
- C. Clarke, G. Cormack, M. Laszlo, T. Lynam, and E. Terra. The impact of corpus size on question answering performance. In Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval pages 369--370, Tampere, Finland, 2002.]] Google ScholarDigital Library
- C. L. A. Clarke, G. V. Cormack, andT. R. Lynam. Exploiting redundancy in question answering. In Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval pages 358--365. ACM Press, 2001.]] Google ScholarDigital Library
- C. L. A. Clarke, G. V. Cormack, T. R. Lynam, and E. Terra. Advances in Open Domain Question Answering chapter Question answering by passage selection. Kluwer Academic Publishers. To appear, 2004.]]Google Scholar
- K. Collins-Thompson, E. Terra, J. Callan, and C. L. A. Clarke. The effect of document retrieval quality on factoid question answering. In ACM SIGIR Conference on Research and development in Information Retrieval 2004.]] Google ScholarDigital Library
- C. J. Crouch, D. B. Crouch, Q. Chen, and S. J. Holtz. Improving the retrieval e.ectiveness of very short queries. Information Processing and Management 38(1):1--36, 2002.]] Google ScholarDigital Library
- K. Darwish an D. W. Oard. Probabilistic structured query methods. In Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval pages 338--344, 2003.]] Google ScholarDigital Library
- J. Firth. Studies In Linguistic Analisys chapter A Synopsis of Linguistic Theory, 1930-1955, pages 1--32. Basil Blackwell, Oxford, 3rd edition, 1957.]]Google Scholar
- J. Gao, M. Zhou, J.-Y. Nie, H. He, and W. Chen. Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependence relations. In Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval pages 183--190, 2002.]] Google ScholarDigital Library
- K. S. Jones, S. Walker, and S. E. Robertson. A probabilistic model of information retrieval: development and comparative experiments -part 1 and 2. Information Processing and Management 36(6):779--808; 809--840, 2000.]] Google ScholarDigital Library
- V. Lavrenko and W. B. Croft. Relevance based language models. In Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval pages 120--127, 2001.]] Google ScholarDigital Library
- J. Lin, A. Fernandes, B. Katz, G. Marton, and S. Tellex. Extracting answers from the web using data annotation an knowledge mining techniques. In The Eleventh Text REtrieval Conference (TREC 2002), Gaithersburg, MD, 2002.]]Google Scholar
- M. Mitra, A. Singhal, and C. Buckley. Improving automatic query expansion. In Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval pages 206--214. ACM Press, 1998.]] Google ScholarDigital Library
- J. M. Ponte and W. B. Croft. A language modeling approach to information retrieval. In Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval pages 275--281, 1998.]] Google ScholarDigital Library
- J. Rocchio. The SMART Retrieval System: Experiments in Automatic Document Processing chapter Relevance feedback in information retrieval, pages 313--323. Prentice-Hall Inc., 1971.]]Google Scholar
- G. Salton, A. Wong, and C. S. Yang. A vector space model for automatic indexing. Communications of the ACM 18(11):613--620, 1975.]] Google ScholarDigital Library
- P. Schäuble and P. Sheridan. Cross-language information retrieval (clir) track overview. In The Sixth Text REtrieval Conference (TREC 6), Gaithersburg, MD, 1997.]]Google Scholar
- S. Tellex, B. Katz, J. Lin, A. Fernandes, and G. Marton. Quantitative evaluation of passage retrieval algorithms for question answering. In Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval pages 41--47, 2003.]] Google ScholarDigital Library
- E. Terra and C. L. Clarke. Fast computation of lexical affinity models. In Proceedings of the 20th International Conference on Computational Linguistics (COLING), 2004.]] Google ScholarDigital Library
- E. Terra and C. L. A. Clarke. Frequency estimates for statistical word similarity measures. In Proceedings of Human Language Technology conference / North American chapter of the Association for Computational Linguistics annual meeting pages 244--251, Edmonton, Alberta, 2003.]] Google ScholarDigital Library
- P. D. Turney. Mining the Web for synonyms: PMI--IR versus LSA on TOEFL. In Proceedings of European Conference on Machine Learning-2001 pages 491--502, 2001.]] Google ScholarDigital Library
- J. Xu an B. Croft. Improving the effectiveness of information retrieval with Local Context Analysis. ACM Transactions on Information Systems 18(1):79--112, 2000.]] Google ScholarDigital Library
- J. Xu an W. B. Croft. Corpus-based stemming using cooccurrence of word variants. ACM Trans. Inf. Syst., 16(1):61--81, 1998.]] Google ScholarDigital Library
- D. L. Yeung, C. L. A. Clarke, G. V. Cormack, T. R. Lynam, and E. Terra. Task-specific query expansion (multitext experiments for trec 2003). In 2002 Text REtrieval Conference Gaithersburg, MD, 2003.]]Google Scholar
- C. Zhai and J. Lafferty. Model-based feedback in the language modeling approach to information retrieval. In Proceedings of the tenth international conference on Information and knowledge management pages 403--410, 2001.]] Google ScholarDigital Library
Index Terms
- Scoring missing terms in information retrieval tasks
Recommendations
Chinese information retrieval based on terms and relevant terms
In this article we describe our approach to Chinese information retrieval, where a query is a short natural language description. First, we use automatically extracted short terms from document sets to build indexes and use the short terms in both the ...
Enhancing relevance models with adaptive passage retrieval
ECIR'08: Proceedings of the IR research, 30th European conference on Advances in information retrievalPassage retrieval and pseudo relevance feedback/query expansion have been reported as two effective means for improving document retrieval in literature. Relevance models, while improving retrieval in most cases, hurts performance on some heterogeneous ...
Tuning of Expansion Terms by PRF and WordNet Integrated Approach for AQE
MIKE 2013: Proceedings of the First International Conference on Mining Intelligence and Knowledge Exploration - Volume 8284Vocabulary mismatch in Information retrieval can be solved by Query Expansion (QE) techniques. Relevance feedback is a prominent solution to improve recall of retrieval system. Sometimes user may be reluctant and novice in providing feedback to improve ...
Comments