Boltzmann machines

E7922

Boltzmann machines are stochastic recurrent neural networks used for learning complex probability distributions, foundational in unsupervised learning and energy-based models.

All labels observed (10)

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf energy-based model
probabilistic graphical model
stochastic neural network architecture
unsupervised learning model
approximationMethod mean-field approximation
variational inference
basedOn Boltzmann distribution
statistical mechanics
definesProbability P(s) = exp(-E(s))/Z
difficulty partition function computation is exponential in number of units
hasComponent bias parameters
hidden units
visible units
hasConnectionType fully connected between all units in general form
hasEnergyFunctionForm E(v,h) = -∑_i a_i v_i -∑_j b_j h_j -∑_{i,j} v_i w_{ij} h_j -∑_{i<k} v_i u_{ik} v_k -∑_{j<l} h_j v_{jl} h_l
hasLearningRule contrastive divergence approximation
persistent contrastive divergence
stochastic gradient descent on log-likelihood
hasNetworkType recurrent neural network
hasPartitionFunction Z = ∑_s exp(-E(s))
hasProperty Gibbs distribution over states
Markov random field structure
asynchronous stochastic updates
binary-valued units
converges to thermal equilibrium distribution
energy function
intractable exact learning for large networks
stochastic units
symmetrical weights
undirected connections
hasSamplingMethod Gibbs sampling
Markov chain Monte Carlo
inspired Deep Boltzmann machines
linked to: Boltzmann machines

Deep belief networks
Restricted Boltzmann machines
linked to: Boltzmann machines
introducedBy Geoffrey Hinton
Terrence Sejnowski
introducedInPublication Learning and Relearning in Boltzmann Machines
linked to: Boltzmann machines
introducedInYear 1985
relatedTo Hopfield networks
Ising models
trainingObjective maximize data log-likelihood
usedFor associative memory
combinatorial optimization
density estimation
modeling complex probability distributions
representation learning
unsupervised feature learning

How these facts were elicited

Referenced by (13)

Full triples — surface form annotated when it differs from this entity's canonical label.

Geoffrey Hinton knownFor Boltzmann machines
Geoffrey Hinton knownFor restricted Boltzmann machines
linked to: Boltzmann machines
Geoffrey Hinton knownFor deep belief networks
linked to: Boltzmann machines
Boltzmann machines inspired Restricted Boltzmann machines
linked to: Boltzmann machines
Boltzmann machines inspired Deep Boltzmann machines
linked to: Boltzmann machines
Boltzmann machines introducedInPublication Learning and Relearning in Boltzmann Machines
linked to: Boltzmann machines
A fast learning algorithm for deep belief nets usesModel restricted Boltzmann machine
linked to: Boltzmann machines
A fast learning algorithm for deep belief nets relatedTo Boltzmann machines
Ruslan Salakhutdinov knownFor restricted Boltzmann machines
linked to: Boltzmann machines
Deep belief networks relatedTo deep Boltzmann machines
linked to: Boltzmann machines
Terrence Sejnowski knownFor Boltzmann machine learning
linked to: Boltzmann machines
Hopfield network isRelatedTo Boltzmann machine
subject linked to: Hopfield networks
linked to: Boltzmann machines
Helmholtz machine comparedTo Boltzmann machine
linked to: Boltzmann machines