Anzeige
Erschienen in:
2012 | OriginalPaper | Buchkapitel
Transformation Invariance in Pattern Recognition – Tangent Distance and Tangent Propagation
verfasst von : Patrice Y. Simard, Yann A. LeCun, John S. Denker, Bernard Victorri
Erschienen in: Neural Networks: Tricks of the Trade
Verlag: Springer Berlin Heidelberg
Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.
Wählen Sie Textabschnitte aus um mit Künstlicher Intelligenz passenden Patente zu finden. powered by
Markieren Sie Textabschnitte, um KI-gestützt weitere passende Inhalte zu finden. powered by
In pattern recognition, statistical modeling, or regression, the amount of data is a critical factor affecting the performance. If the amount of data and computational resources are unlimited, even trivial algorithms will converge to the optimal solution. However, in the practical case, given limited data and other resources, satisfactory performance requires sophisticated methods to regularize the problem by introducing
a priori
knowledge. Invariance of the output with respect to certain transformations of the input is a typical example of such
a priori
knowledge. In this chapter, we introduce the concept of tangent vectors, which compactly represent the essence of these transformation invariances, and two classes of algorithms, “tangent distance” and “tangent propagation”, which make use of these invariances to improve performance.