Solomonoff induction

E774592

Solomonoff induction is a formal theory of universal prediction that combines algorithmic information theory and Bayesian reasoning to define an idealized, incomputable method for inferring future data from past observations.

All labels observed (5)

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf formal theory of universal prediction ⓘ
idealized prediction method ⓘ
incomputable prediction scheme ⓘ
theory in algorithmic information theory ⓘ
aimsTo predict future observations from past data ⓘ
appliesTo online learning scenarios ⓘ
sequential prediction problems ⓘ
approximatedBy MDL-based predictors ⓘ
compression-based prediction methods ⓘ
resource-bounded variants ⓘ
assumes data generated by a computable process ⓘ
basedOn Bayesian mixture of all programs ⓘ
mixture over all computable hypotheses ⓘ
componentOf AIXI formalism ⓘ
linked to: AIXI model
defines universal a priori probability distribution ⓘ
encodes Occam’s razor via program length prior ⓘ
field Bayesian statistics ⓘ
algorithmic information theory ⓘ
machine learning theory ⓘ
philosophy of science ⓘ
formalizedAs universal semimeasure M ⓘ
goal provide a gold standard for inductive inference ⓘ
guarantees convergence to true computable distribution ⓘ
influenced theory of inductive inference ⓘ
universal artificial intelligence ⓘ
inspired AIXI ⓘ
linked to: AIXI model
introducedBy Ray Solomonoff ⓘ
limitation not computable in practice ⓘ
minimizes expected log-loss asymptotically ⓘ
expected number of prediction errors asymptotically ⓘ
namedAfter Ray Solomonoff ⓘ
property computably enumerable from below ⓘ
computationally incomputable ⓘ
publication A Formal Theory of Inductive Inference ⓘ
publicationYear 1964 ⓘ
relatedTo Bayesian universal coding ⓘ
Kolmogorov complexity-based learning ⓘ
Minimum Description Length principle ⓘ
satisfies asymptotic optimality in sequence prediction ⓘ
universal dominance over all computable semimeasures ⓘ
uses prefix-free Turing machine programs ⓘ
usesConcept Bayesian updating ⓘ
Epicurus’ principle of multiple explanations ⓘ
Kolmogorov complexity ⓘ
Occam’s razor ⓘ
linked to: Occam's razor

algorithmic probability ⓘ
universal Turing machine ⓘ
linked to: Turing machine

universal prior ⓘ
weights shorter programs more heavily ⓘ

How these facts were elicited

Referenced by (13)

Full triples — surface form annotated when it differs from this entity's canonical label.

Marcus Hutter → researchInterest → Solomonoff induction ⓘ
Marcus Hutter → basedOn → Solomonoff induction ⓘ
universal intelligence measure → basedOn → Solomonoff induction ⓘ
Ray Solomonoff → notableConcept → Solomonoff induction ⓘ
AIXI → basedOn → Solomonoff induction ⓘ
subject linked to: AIXI model
AIXI → uses → Solomonoff universal prior ⓘ
subject linked to: AIXI model
linked to: Solomonoff induction
AIXI → relatedTo → Solomonoff universal distribution ⓘ
subject linked to: AIXI model
linked to: Solomonoff induction
Solomonoff induction → publication → A Formal Theory of Inductive Inference ⓘ
linked to: Solomonoff induction
Solomonoff induction → formalizedAs → universal semimeasure M ⓘ
linked to: Solomonoff induction
algorithmic information theory → hasKeyConcept → Solomonoff induction ⓘ