AIXI model

E774590

The AIXI model is a theoretical framework for an idealized, maximally intelligent reinforcement learning agent that combines Solomonoff induction with sequential decision theory.

All labels observed (7)

How this entity was disambiguated

Statements (50)

Predicate Object
instanceOf idealized reinforcement learning agent ⓘ
theoretical model of artificial intelligence ⓘ
uncomputable agent model ⓘ
universal artificial intelligence model ⓘ
assumes unknown but computable environment ⓘ
basedOn Bayesian decision theory ⓘ
Solomonoff induction ⓘ
sequential decision theory ⓘ
computabilityStatus uncomputable ⓘ
decisionCriterion Bayes-optimality with respect to universal prior ⓘ
definedBy Marcus Hutter ⓘ
environmentClass all lower semicomputable semimeasures ⓘ
formalizedIn universal artificial intelligence framework ⓘ
formalizes Legg-Hutter intelligence measure ⓘ
goal maximization of cumulative reward ⓘ
hasApproximation AIXItl ⓘ
MC-AIXI-CTW ⓘ
hasLimitation depends on choice of reference universal Turing machine ⓘ
not directly implementable on real hardware ⓘ
hasProperty defined for general reinforcement learning environments ⓘ
environment-agnostic ⓘ
maximally intelligent in its formal setting ⓘ
model-free in the usual RL sense ⓘ
not computable in practice ⓘ
theoretically optimal ⓘ
uses a universal Turing machine prior ⓘ
uses algorithmic probability ⓘ
influenced formal definitions of intelligence ⓘ
theoretical research in AGI ⓘ
interactionPattern agent-environment loop ⓘ
introducedInWork Universal Artificial Intelligence: Sequential Decisions based on Algorithmic Probability ⓘ
optimizes expected discounted reward ⓘ
outputs actions to environment ⓘ
publicationYear 2005 ⓘ
receives observations from environment ⓘ
rewards from environment ⓘ
relatedTo Kolmogorov complexity ⓘ
Solomonoff universal distribution ⓘ
algorithmic information theory ⓘ
partially observable Markov decision processes ⓘ
reinforcement learning ⓘ
sequential decision processes ⓘ
requires enumeration of all programs on a universal Turing machine ⓘ
infinite computational resources ⓘ
selects actions to maximize expected future reward ⓘ
timeStructure discrete time interaction cycles ⓘ
upperBoundFor intelligence of computable agents in its setting ⓘ
uses Solomonoff universal prior ⓘ
expectimax planning over all computable environments ⓘ
mixture over all semicomputable probability measures ⓘ

How these facts were elicited

Referenced by (11)

Full triples — surface form annotated when it differs from this entity's canonical label.

Marcus Hutter → knownFor → AIXI model ⓘ
Marcus Hutter → developed → AIXI ⓘ
linked to: AIXI model
Marcus Hutter → hasConcept → AIXI-tl ⓘ
linked to: AIXI model
universal intelligence measure → relatedTo → AIXI ⓘ
linked to: AIXI model
Ray Solomonoff → inspired → AIXI framework ⓘ
linked to: AIXI model
Universal Artificial Intelligence: Sequential Decisions based on Algorithmic Probability → describes → AIXI as a theoretical optimal agent ⓘ
linked to: AIXI model
Solomonoff induction → inspired → AIXI ⓘ
linked to: AIXI model
Solomonoff induction → componentOf → AIXI formalism ⓘ
linked to: AIXI model
Joel Veness → notableWork → A Monte Carlo AIXI Approximation ⓘ
linked to: AIXI model