OPT

E435873

OPT is a family of open-source large language models developed by Meta AI, designed as efficient, GPT-style transformer models for natural language processing tasks.

All labels observed (1)

Label Occurrences
OPT canonical 1

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf autoregressive language model ⓘ
large language model family ⓘ
basedOn GPT-style architecture ⓘ
codeRepositoryHost GitHub ⓘ
codeRepositoryOrganization facebookresearch ⓘ
linked to: Meta AI
comparisonTarget OpenAI GPT-3 ⓘ
linked to: GPT-3
designGoal efficient GPT-style model ⓘ
open-source alternative to GPT-3 ⓘ
developer Meta AI ⓘ
Meta Platforms ⓘ
hasPaper OPT: Open Pre-trained Transformer Language Models ⓘ
includesVariant OPT-1.3B ⓘ
OPT-125M ⓘ
OPT-13B ⓘ
OPT-175B ⓘ
OPT-2.7B ⓘ
OPT-30B ⓘ
OPT-350M ⓘ
OPT-6.7B ⓘ
OPT-66B ⓘ
intendedUse benchmarking against GPT-3 ⓘ
downstream NLP applications ⓘ
research ⓘ
language English ⓘ
largestModel OPT-175B ⓘ
license custom Meta license ⓘ
modelArchitecture transformer ⓘ
modelType decoder-only transformer ⓘ
openSource true ⓘ
organization Meta AI ⓘ
paperArchive arXiv ⓘ
paperArxivId 2205.01068 ⓘ
parameterRange 125M–175B parameters ⓘ
releaseDate 2022-05 ⓘ
supportsFineTuning true ⓘ
supportsInferencePrecision BF16 ⓘ
FP16 ⓘ
supportsPrompting true ⓘ
supportsTask classification via prompting ⓘ
dialogue modeling ⓘ
language modeling ⓘ
question answering ⓘ
summarization ⓘ
text completion ⓘ
text generation ⓘ
trainingComputeOptimization efficiency-focused implementation ⓘ
trainingDataSource licensed text data ⓘ
publicly available text data ⓘ
trainingObjective causal language modeling ⓘ

How these facts were elicited

Referenced by (1)

Full triples — surface form annotated when it differs from this entity's canonical label.