Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Scribd Logo
Upload

Welcome to Scribd!

  • 20 views

    The Boltzmann Machine

    Uploaded by

    susaresh
    The Boltzmann Machine is a type of neural network similar to Hopfield Networks. It allows for hidden neurons and uses stochastic neurons, unlike Hopfield Networks which are unsupervised. A Boltzmann Machine has neurons that can be clamped, operating freely, or hidden. It operates by randomly selecting a neuron and updating its state stochastically based on its energy and temperature. Over many iterations it reaches a Boltzmann distribution of states at thermal equilibrium. The Boltzmann Learning Rule updates weights based on correlations between hidden and visible neurons.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOC, PDF, TXT or read online from Scribd

    The Boltzmann Machine

    Uploaded by

    susaresh
    20 views2 pages
    The Boltzmann Machine is a type of neural network similar to Hopfield Networks. It allows for hidden neurons and uses stochastic neurons, unlike Hopfield Networks which are unsupervised. A Boltzmann Machine has neurons that can be clamped, operating freely, or hidden. It operates by randomly selecting a neuron and updating its state stochastically based on its energy and temperature. Over many iterations it reaches a Boltzmann distribution of states at thermal equilibrium. The Boltzmann Learning Rule updates weights based on correlations between hidden and visible neurons.

    Original Description:

    describe

    Copyright

    © Attribution Non-Commercial (BY-NC)

    Available Formats

    DOC, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    The Boltzmann Machine is a type of neural network similar to Hopfield Networks. It allows for hidden neurons and uses stochastic neurons, unlike Hopfield Networks which are unsupervised. A Boltzmann Machine has neurons that can be clamped, operating freely, or hidden. It operates by randomly selecting a neuron and updating its state stochastically based on its energy and temperature. Over many iterations it reaches a Boltzmann distribution of states at thermal equilibrium. The Boltzmann Learning Rule updates weights based on correlations between hidden and visible neurons.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOC, PDF, TXT or read online from Scribd
    Download as doc, pdf, or txt
    20 views2 pages

    The Boltzmann Machine

    Uploaded by

    susaresh
    The Boltzmann Machine is a type of neural network similar to Hopfield Networks. It allows for hidden neurons and uses stochastic neurons, unlike Hopfield Networks which are unsupervised. A Boltzmann Machine has neurons that can be clamped, operating freely, or hidden. It operates by randomly selecting a neuron and updating its state stochastically based on its energy and temperature. Over many iterations it reaches a Boltzmann distribution of states at thermal equilibrium. The Boltzmann Learning Rule updates weights based on correlations between hidden and visible neurons.

    Copyright:

    Attribution Non-Commercial (BY-NC)
    Download as DOC, PDF, TXT or read online from Scribd
    Download as doc, pdf, or txt
    of 2

    The Boltzmann Machine

    Similarities to Hopfield Networks 1. state values +1, 1 !. wei"hts s#mmetric $. unit selected at random %. no self feed&ack 'ifferences with Hopfield Networks 1. Boltzmann permits hidden neurons !. Boltzmann uses stochastic neurons $. Hopfield unsupervised while Boltzmann ma# operate supervised

    Boltzmann Machine terminolo"# o o o o hidden, visi&le clamped, operatin" freel# trainin"( input output thermal e)uili&rium

    Basic *peration select neuron at random update stochasticall# pro&+s, - s,. / 10+1+e1p+ delat23,0T. 4lamped and free pro&a&ilities( 5+alpha and 5 alpha 3ner"# for s, - s,. pro&+s, - s,. / 10+1+e1p+!s,v,0T. *perates like a stochastic neuron

    No self feed&ack 2. e1ternal threshold theata, +s6 / 1. N 3. ! states thermal e)uili&rium Boltzmann 'istri&uti
    1.

    5alpha / 107 e1p+ 3alpha0T. o 7 / ... o for lar"e T all states are e)uipro&a&le o as T -6 onl# states with minimum ener"# level have non zero pro&a&ilit# o coarse search - fine search o constraint satisfaction( weak constraints The Boltzmann 8earnin" 9ule hidden neurons act as feature detectors state / visi&le0hidden +alpha 0 &eta. !: choices for alpha !8 choices for &eta, where 8 / N : N.B. te1t sa#s alpha runs from 1 to !: 4lamped 5ro&a&ilit#( 5+alpha / ... 9unnin" free pro&a&ilit#( 5 alpha / ... actual 0desired pro&a&ilities relative entrop# "radient descent method 4orrelations
    o

    You might also like