2008 | OriginalPaper | Chapter
A Wikipedia-Based Multilingual Retrieval Model
Authors : Martin Potthast, Benno Stein, Maik Anderka
Published in: Advances in Information Retrieval
Publisher: Springer Berlin Heidelberg
Activate our intelligent search to find suitable subject content or patents.
Select sections of text to find matching patents with Artificial Intelligence. powered by
Select sections of text to find additional relevant content using AI-assisted search. powered by
This paper introduces CL-ESA, a new multilingual retrieval model for the analysis of cross-language similarity. The retrieval model exploits the multilingual alignment of Wikipedia: given a document
d
written in language
L
we construct a concept vector
d
for
d
, where each dimension
i
in
d
quantifies the similarity of
d
with respect to a document
$d^*_i$
chosen from the “
L
-subset” of Wikipedia. Likewise, for a second document
d
′ written in language
L
′,
$L\not=L'$
, we construct a concept vector
d
′, using from the
L
′-subset of the Wikipedia the topic-aligned counterparts
$d'^*_i$
of our previously chosen documents.
Since the two concept vectors
d
and
d
′ are
collection-relative representations
of
d
and
d
′ they are language-independent. I. e., their similarity can directly be computed with the cosine similarity measure, for instance.
We present results of an extensive analysis that demonstrates the power of this new retrieval model: for a query document
d
the topically most similar documents from a corpus in another language are properly ranked. Salient property of the new retrieval model is its robustness with respect to both the size and the quality of the index document collection.