Anzeige
Erschienen in:
2015 | OriginalPaper | Buchkapitel
Beyond tf-idf and Cosine Distance in Documents Dissimilarity Measure
verfasst von : Sunil Aryal, Kai Ming Ting, Gholamreza Haffari, Takashi Washio
Erschienen in: Information Retrieval Technology
Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.
Wählen Sie Textabschnitte aus um mit Künstlicher Intelligenz passenden Patente zu finden. powered by
Markieren Sie Textabschnitte, um KI-gestützt weitere passende Inhalte zu finden. powered by
Abstract
In vector space model, different types of term weighting schemes are used to adjust bag-of-words document vectors in order to improve the performance of the most widely used cosine distance. Even though the cosine distance with some term weighting schemes result in more reliable (dis)similarity measure in some data sets, it may not perform well in others because of the underlying assumptions of the term weighting schemes. In this paper, we argue that the explicit adjustment of bag-of-words document vectors using term weighting is not required if a data-dependent dissimilarity measure called \(m_p\)-dissimilarity is used. Our empirical result in document retrieval task reveals that \(m_p\) with the simplest binary bag-of-words representation is either better or competitive to the cosine distance with the best performing state-of-the-art term weighting scheme in four widely used benchmark document collections.