2015 | OriginalPaper | Buchkapitel
Generalization in Unsupervised Learning
verfasst von : Karim T. Abou-Moustafa, Dale Schuurmans
Erschienen in: Machine Learning and Knowledge Discovery in Databases
Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.
Wählen Sie Textabschnitte aus um mit Künstlicher Intelligenz passenden Patente zu finden. powered by
Markieren Sie Textabschnitte, um KI-gestützt weitere passende Inhalte zu finden. powered by
We are interested in the following questions. Given a finite data set
$$\mathcal {S}$$
, with neither labels nor side information, and an unsupervised learning algorithm
$$\mathsf {A}$$
, can the generalization of
$$\mathsf {A}$$
be assessed on
$$\mathcal {S}$$
? Similarly, given two unsupervised learning algorithms,
$$\mathsf {A}_1$$
and
$$\mathsf {A}_2$$
, for the same learning task, can one assess whether one will generalize “better” on future data drawn from the same source as
$$\mathcal {S}$$
? In this paper, we develop a general approach to answering these questions in a reliable and efficient manner using mild assumptions on
$$\mathsf {A}$$
. We first propose a concrete generalization criterion for unsupervised learning that is analogous to prediction error in supervised learning. Then, we develop a computationally efficient procedure that realizes the generalization criterion on finite data sets, and propose and extension for comparing the generalization of two algorithms on the same data set. We validate the overall framework on algorithms for clustering and dimensionality reduction (linear and nonlinear).