ABSTRACT
TRECVID is an annual exercise which encourages research in information retrieval from digital video by providing a large video test collection, uniform scoring procedures, and a forum for organizations interested in comparing their results. TRECVID benchmarking covers both interactive and manual searching by end users, as well as the benchmarking of some supporting technologies including shot boundary detection, extraction of some semantic features, and the automatic segmentation of TV news broadcasts into non-overlapping news stories. TRECVID has a broad range of over 40 participating groups from across the world and as it is now (2004) in its 4th annual cycle it is opportune to stand back and look at the lessons we have learned from the cumulative activity. In this paper we shall present a brief and high-level overview of the TRECVID activity covering the data, the benchmarked tasks, the overall results obtained by groups to date and an overview of the approaches taken by selective groups in some tasks. While progress from one year to the next cannot be measured directly because of the changing nature of the video data we have been using, we shall present a summary of the lessons we have learned from TRECVID and include some pointers on what we feel are the most important of these lessons.
- J.L. Gauvain, L. Lamel and G. Adda. The LIMSI Broadcast News Transcription System. Speech Communication, 37(1-2):89-108,2002. Google ScholarDigital Library
- A.F. Smeaton, W. Kraaij, and Paul Over. TREC Video Retrieval Evaluation: A Case Study and Status Report. In Proceedings of RIAO'2004, Coupling approaches, coupling media and coupling languages for information retrieval, Avignon, France, April 2004.Google Scholar
Index Terms
- TRECVID: evaluating the effectiveness of information retrieval tasks on digital video
Recommendations
TRECVID: benchmarking the effectiveness of information retrieval tasks on digital video
CIVR'03: Proceedings of the 2nd international conference on Image and video retrievalMany research groups worldwide are now investigating techniques which can support information retrieval on archives of digital video and as groups move on to implement these techniques they inevitably try to evaluate the performance of their techniques ...
Evaluation campaigns and TRECVid
MIR '06: Proceedings of the 8th ACM international workshop on Multimedia information retrievalThe TREC Video Retrieval Evaluation (TRECVid)is an international benchmarking activity to encourage research in video information retrieval by providing a large test collection, uniform scoring procedures, and a forum for organizations 1 interested in ...
Comments