Advertisement
Published in:
2007 | OriginalPaper | Chapter
ChapBoltzmann Machines Learning Using High Order Decimation
Authors : Enric Farguell, Ferran Mazzanti, Eduardo Gomez-Ramirez
Published in: Hybrid Intelligent Systems
Publisher: Springer Berlin Heidelberg
Activate our intelligent search to find suitable subject content or patents.
Select sections of text to find matching patents with Artificial Intelligence. powered by
Select sections of text to find additional relevant content using AI-assisted search. powered by
Boltzmann Machines are recurrent and stochastic neural networks that can learn and reproduce probability distributions. This feature has a serious drawback in the exhaustive computational cost involved. In this context, decimation was introduced as a way to overcome this problem, as it builds a smaller network that is able to reproduce exactly the quantities required to update the weights during learning. Decimation techniques developed can only be used in sparsely connected Boltzmann Machines with stringent constraints on the connections between the units. In this work, decimation is extended to any Boltzmann Machine with no restrictions on connections or topology. This is achieved introducing high order weights, which incorporate additional degrees of freedom.