nach oben

Discover Computing

Erschienen in:

01.12.2009 | Reliable Information Access Workshop

Overview of the Reliable Information Access Workshop

verfasst von: Donna Harman, Chris Buckley

Erschienen in: Discover Computing | Ausgabe 6/2009

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config

KI-gestützte Suche

Aus

Abstract

The Reliable Information Access (RIA) Workshop was held in the summer of 2003, with a goal of improved understanding of information retrieval systems, in particular with regard to the variability of retrieval performance across topics. The workshop ran massive cross-system failure analysis on 45 of the TREC topics and also performed cross-system experiments on pseudo-relevance feedback. This paper presents an overview of that workshop, along with some preliminary conclusions from these experiments. Even if this workshop was held 6 years ago, the issues of improving system performance across all topics is still critical to the field and this paper, along with the others in this issue, are the first widely published full papers for the workshop.

Nächster Artikel A guide to the RIA workshop data archive

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Jetzt informieren

Nur mit Berechtigung zugänglich

Buckley, C. (1985). Implementation of the SMART information retrieval system. Technical Report 85-686. Computer Science Department, Cornell University, Ithaca, NY, May.

Buckley, C. (in press). Why current IR engines fail. Information Retrieval. doi:10.1007/s10791-009-9103-2.

Buckley, C., Singhal, A., Mitra, M., & Salton, G. (1996). New retrieval approaches using SMART: TREC-4. In D. K. Harman (Ed.), The Fourth Text REtrieval Conference (TREC-4) , Gaithersburg, MD, pp. 25–48.

Clarke, C. L. A., Cormack, G. V., & Lynam, T. R. (2001). Exploiting redundancy in question answering. In W. B. Croft, D. J. Harper, D. H. Kraft, & J. Zobel (Eds.), Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval New Orleans, LA, pp. 358–365.

Clarke, C. L. A., Cormack, G. V., Lynam, T. R., Buckley, C., & Harman, D. (in press). Swapping documents and terms. Information Retrieval. doi:10.1007/s10791-009-9105-0.

Collins-Thompson, K., Callan, J., Terra, E., & Clarke, C. L. A. (2004). The effect of document retrieval quality on factoid question answering performance. In K. Järvelin, J. Allan, P. Bruza, & M. Sanderson (Eds.), Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval Sheffield, UK, pp. 574–575.

Cronen-Townsend, S., Zhou, Y., & Croft, W. B. (2002). Predicting query performance. In M. Beaulieu, R. Baeza-Yates, S. H. Myaeng, & K. Järvelin (Eds.), Proceedings of the 25th annual international ACM SIGIR conference on research and development in information retrieval Tampere, Finland, pp. 299–306.

Evans, D. A., & Lefferts, R. G. (1994). Design and evaluation of the CLARIT-TREC-2 system. In D. K. Harman (Ed.), The Second Text REtrieval Conference (TREC-2) Gaithersburg, MD, pp. 137–150.

Evans, D. A., & Lefferts, R. G. (1995). CLARIT-TREC experiments. Information Processing and Management, 31(3), 385–395.CrossRef

Gu, Z. (2004). Comparison of using passages and documents for blind relevance feedback. In K. Järvelin, J. Allan, P. Bruza, & M. Sanderson (Eds.), Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval Sheffield, UK, pp. 482–483.

Lavrenko, V., & Croft, W. B. (2001). Relevance-based language models. In W. B. Croft, D. J. Harper, D. H. Kraft, & J. Zobel (Eds.), Proceedings of the 24th annual international ACM SIGIR conference on research and development in information retrieval New Orleans, LA, pp. 120–127.

Milic-Frayling N., Zhai C., Tong X., Jansen, P., & Evans, D. A. (1998). Experiments in query optimization: The CLARIT system TREC-6 report. In E. M. Voorhees & D. K. Harman (Eds.), The Sixth Text REtrieval Conference (TREC-6) (pp 415–454). Gaithersburg, MD.

Montgomery, J., & Evans, D. A. (2004). Effect of varying number of documents in blind feedback. In K. Järvelin, J. Allan, P. Bruza, & M. Sanderson (Eds.), Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval Sheffield, UK, pp. 476–477.

Ogilvie, P., Voorhees, E., & Callan, J. (in press). On the number of terms used in automatic query expansion. Information Retrieval. doi:10.1007/s10791-009-9104-1.

Ponte, J. M., & Croft, W. B. (1998). A language modeling approach to information retrieval. In W. B. Croft, A. Moffat, C. J. van Rijsbergen, R. Wilkinson, & J. Zobel (Eds.), Proceedings of the 21th annual international ACM SIGIR conference on research and development in information retrieval Melbourne, Australia, pp. 275–281.

Robertson, S. E. (1990). On term selection for query expansion. Journal of Documentation, 46, 359–364.CrossRef

Robertson, S. E., & Sparck Jones, K. (1976). Relevance weighting of search terms. Journal of the American Society for Information Science, 27(3), 129–146.

Robertson, S. E., Walker, S., Jones, S., Hancock-Beaulieu, M. M., & Gatford, M. (1995). OKAPI at TREC-3. In D. K. Harman (Ed.), The Third Text REtrieval Conference (TREC-3) Gaithersburg, MD, pp. 109–126.

Small, S., Strzalkowski, T., Liu, T., Shimizu, N., & Yamrom, B. (2004). A data driven approach to interactive question answering. In M. T. Maybury (Ed.), New directions in questions answering (pp. 129–140). AAAI/MIT Press.

Soboroff, I. (in press). A guide to the RIA workshop data archive. Information Retrieval. doi:10.1007/s10791-009-9102-3.

Strzalkowski, T., Small, S., Hardy, H., Kantor, P., Min, W., Ryan, S., et al. (2008). Question answering as dialogue with data. In T. Strzalkowski & S. Harabagiu (Eds.), Advances in open-domain question answering (pp. 149–188). Springer.

Voorhees, E. M., & Harman, D. (1997). Overview of the Fifth Text REtrieval Conference (TREC-5). In E. M. Voorhees & D. K. Harman (Eds.), The Fifth Text REtrieval Conference (TREC-5) Gaithersburg, MD, pp. 1–28.

Warren, R. H. (2004). A review of relevance feedback experiments at the 2003 Reliable Information Access (RIA) Workshop. In K. Järvelin, J. Allan, P. Bruza, & M. Sanderson (Eds.), Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval Sheffield, UK, pp. 570–571.

Williamson, D., Williamson, R., & Leskm, M. E. (1969). The Cornell implementation of the SMART system. In G. Salton (Ed.), ISR Report 16 to the NSF, pp. 1–62.

Williamson, D., Williamson, R., & Lesk, M. E. (1971). The Cornell implementation of the SMART system. In G. Salton (Ed.), The SMART retrieval system (pp. 12–51). Prentice-Hall.

Yeung, D. L., Clarke, C. L. A., Cormack, G. V., Lynam, T. R., & Terra, E. L. (2004). Task-specific query expansion. In E. M. Voorhees (Ed.), The Twelfth Text REtrieval Conference (TREC-12), Gaithersburg, MD.

Yom-Tov, E., Fine, S., Carmel, D., & Darlow, A. (2005). Learning to estimate query difficulty. In G. Marchionini, A. Moffat, J. Tait, R. Baeza-Yates, & N. Ziviani (Eds.), Proceedings of the 28th annual international ACM SIGIR conference on research and development in information retrieval Salvador, Brazil, pp. 512–519.

Zhai, C., & Lafferty, J. (2001). Model-based feedback in the language modeling approach to information retrieval. In Tenth International Conference on Information and Knowledge Management (CIKM 2001) Atlanta, GA, pp. 1–2.

Titel: Overview of the Reliable Information Access Workshop
verfasst von: Donna Harman
Chris Buckley
Publikationsdatum: 01.12.2009
Verlag: Springer Netherlands
Erschienen in: Discover Computing / Ausgabe 6/2009
Print ISSN: 2948-2984
Elektronische ISSN: 2948-2992
DOI: https://doi.org/10.1007/s10791-009-9101-4

Springer Professional

Abstract

Bitte loggen Sie sich ein, um Zugang zu Ihrer Lizenz zu erhalten.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Technik"

Springer Professional "Wirtschaft"

Weitere Artikel der Ausgabe 6/2009

Swapping documents and terms

On the number of terms used in automatic query expansion

Why current IR engines fail

A guide to the RIA workshop data archive