Helmholtz machine

E260031

The Helmholtz machine is a pioneering generative neural network model that learns internal representations by using separate recognition and generative pathways to perform unsupervised learning.

All labels observed (2)

Label Occurrences
Helmholtz machine canonical 1
wake-sleep algorithm 1

How this entity was disambiguated

Statements (44)

Predicate Object
instanceOf generative neural network model ⓘ
latent variable model ⓘ
probabilistic generative model ⓘ
unsupervised learning model ⓘ
comparedTo Boltzmann machine ⓘ
linked to: Boltzmann machines

autoencoder ⓘ
field artificial neural networks ⓘ
computational neuroscience ⓘ
machine learning ⓘ
goal learn generative model of data ⓘ
model sensory data distribution ⓘ
perform approximate Bayesian inference ⓘ
hasAdvantage biologically plausible learning scheme ⓘ
separate pathways for inference and generation ⓘ
hasArchitecture layered stochastic neural network ⓘ
top-down generative model with bottom-up recognition model ⓘ
hasComponent generative network ⓘ
recognition network ⓘ
hasConcept sleep phase updates recognition weights ⓘ
wake phase updates generative weights ⓘ
hasLearningType unsupervised learning ⓘ
hasLimitation approximate inference quality depends on recognition network ⓘ
training can be difficult ⓘ
hasProperty approximate inference ⓘ
bottom-up recognition connections ⓘ
energy-based interpretation ⓘ
hierarchical structure ⓘ
learns internal representations ⓘ
separate recognition and generative pathways ⓘ
stochastic latent variables ⓘ
top-down generative connections ⓘ
hasTrainingObjective maximize data likelihood approximately ⓘ
minimize divergence between recognition and generative distributions ⓘ
inspired modern deep generative models ⓘ
variational autoencoder ⓘ
namedAfter Hermann von Helmholtz ⓘ
trainedBy sleep phase ⓘ
wake phase ⓘ
usedFor density estimation ⓘ
representation learning ⓘ
unsupervised feature extraction ⓘ
uses local learning rules ⓘ
stochastic units ⓘ
usesLearningRule wake-sleep algorithm ⓘ
linked to: Helmholtz machine

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.

Terrence Sejnowski → knownFor → Helmholtz machine ⓘ
Helmholtz machine → usesLearningRule → wake-sleep algorithm ⓘ
linked to: Helmholtz machine