Kolmogorov complexity

E183589

Kolmogorov complexity is a measure of the amount of information in an object, defined as the length of the shortest computer program that can produce it.

All labels observed (8)

How this entity was disambiguated

Statements (50)

Predicate Object
instanceOf complexity measure ⓘ
computability-theoretic concept ⓘ
information-theoretic measure ⓘ
alsoKnownAs algorithmic complexity ⓘ
descriptive complexity ⓘ
program-size complexity ⓘ
coreIdea measures information content via shortest effective description ⓘ
definedOver finite binary strings ⓘ
finite strings ⓘ
definition length of the shortest program that outputs a given object and then halts ⓘ
dependsOn choice of universal Turing machine ⓘ
field algorithmic information theory ⓘ
hasVariant conditional Kolmogorov complexity ⓘ
monotone Kolmogorov complexity ⓘ
plain Kolmogorov complexity ⓘ
prefix Kolmogorov complexity ⓘ
prefix-free Kolmogorov complexity ⓘ
space-bounded Kolmogorov complexity ⓘ
time-bounded Kolmogorov complexity ⓘ
implies no algorithm can compute exact Kolmogorov complexity for all strings ⓘ
independentlyDevelopedBy Gregory Chaitin ⓘ
Ray Solomonoff ⓘ
introducedBy Andrey Kolmogorov ⓘ
linked to: Andrei Kolmogorov
invarianceProperty different universal Turing machines change complexity by at most an additive constant ⓘ
keyResult incompressibility method in combinatorics and complexity theory ⓘ
most strings of length n have Kolmogorov complexity close to n ⓘ
only a small fraction of strings are highly compressible ⓘ
mathematicalDomain information theory ⓘ
mathematical logic ⓘ
theoretical computer science ⓘ
namedAfter Andrey Kolmogorov ⓘ
linked to: Andrei Kolmogorov
property non-computable ⓘ
not computable by any algorithm ⓘ
relatedTo Chaitin's constant ⓘ
linked to: Halting problem

Martin-Löf randomness ⓘ
Shannon entropy ⓘ
data compression ⓘ
minimum description length principle ⓘ
universal Turing machine ⓘ
semiComputableProperty upper semicomputable ⓘ
symbol C(x) ⓘ
K(x) ⓘ
timePeriodOfDevelopment 1960s ⓘ
usedFor characterizing algorithmic randomness ⓘ
formalizing Occam's razor ⓘ
formalizing randomness of individual strings ⓘ
foundations of inductive inference ⓘ
foundations of machine learning theory ⓘ
proving lower bounds in theoretical computer science ⓘ
studying incompressibility ⓘ

How these facts were elicited

Referenced by (31)

Full triples — surface form annotated when it differs from this entity's canonical label.

Occam's razor → relatedConcept → Kolmogorov complexity ⓘ
Andrei Kolmogorov → notableWork → Kolmogorov complexity ⓘ
Andrei Kolmogorov → notableIdea → algorithmic randomness ⓘ
linked to: Kolmogorov complexity
Andrei Kolmogorov → notableIdea → Kolmogorov complexity ⓘ
Berry paradox → relatedTo → Kolmogorov complexity ⓘ
Berry paradox → relatedTo → Chaitin’s incompleteness theorem ⓘ
linked to: Kolmogorov complexity
Blum axioms → relatedConcept → Kolmogorov complexity ⓘ
Blum complexity measures → relatedTo → Kolmogorov complexity ⓘ
Computability Theory → fieldOfStudy → Kolmogorov complexity ⓘ
Kolmogorov complexity → hasVariant → prefix Kolmogorov complexity ⓘ
linked to: Kolmogorov complexity
Kolmogorov complexity → hasVariant → plain Kolmogorov complexity ⓘ
linked to: Kolmogorov complexity
Kolmogorov complexity → hasVariant → prefix-free Kolmogorov complexity ⓘ
linked to: Kolmogorov complexity
Marcus Hutter → basedOn → Kolmogorov complexity ⓘ
universal intelligence measure → basedOn → Kolmogorov complexity ⓘ
Ray Solomonoff → influenced → Kolmogorov complexity ⓘ
Leonid Levin → hasResearchInterest → Kolmogorov complexity ⓘ
Kenneth Regan → researchInterest → Kolmogorov complexity ⓘ
Elements of Information Theory → subject → Kolmogorov complexity ⓘ
Martin-Löf randomness → relatedTo → Kolmogorov complexity ⓘ
minimum description length principle → basedOn → Kolmogorov complexity ⓘ
Gregory Chaitin → knownFor → Chaitin–Kolmogorov complexity ⓘ
linked to: Kolmogorov complexity
AIXI → relatedTo → Kolmogorov complexity ⓘ
subject linked to: AIXI model
Solomonoff induction → usesConcept → Kolmogorov complexity ⓘ
algorithmic information theory → fieldOfStudy → Kolmogorov complexity ⓘ
algorithmic information theory → fieldOfStudy → plain Kolmogorov complexity ⓘ
linked to: Kolmogorov complexity
algorithmic information theory → fieldOfStudy → conditional Kolmogorov complexity ⓘ
linked to: Kolmogorov complexity
algorithmic information theory → hasKeyConcept → Kolmogorov complexity ⓘ
algorithmic information theory → hasKeyConcept → prefix Kolmogorov complexity ⓘ
linked to: Kolmogorov complexity
algorithmic information theory → hasKeyConcept → plain Kolmogorov complexity ⓘ
linked to: Kolmogorov complexity