GPT-3

E18819

GPT-3 is a large-scale autoregressive language model known for generating human-like text and performing a wide range of natural language tasks with minimal fine-tuning.

AI illustration

How this image was made

AI-generated illustration of GPT-3

This AI-generated illustration was produced by black-forest-labs/FLUX.2-dev (1024x1024) from a prompt written by openai/gpt-oss-120b from the entity's label + description.

Prompt

Generate an image of GPT-3 (GPT-3 is a large-scale autoregressive language model known for generating human-like text and performing a wide range of natural language tasks with minimal fine-tuning.)

All labels observed (13)

How this entity was disambiguated

Statements (57)

Predicate Object
instanceOf autoregressive language model ⓘ
large language model ⓘ
transformer-based model ⓘ
abbreviation GPT-3 ⓘ
announcedIn 2020 ⓘ
architecture Transformer ⓘ
capability few-shot learning ⓘ
natural language generation ⓘ
one-shot learning ⓘ
question answering ⓘ
summarization ⓘ
text completion ⓘ
translation ⓘ
zero-shot learning ⓘ
commercialAccess OpenAI API ⓘ
describedInPaper Language Models are Few-Shot Learners ⓘ
linked to: GPT-3
developer OpenAI ⓘ
fewShotPrompting supported ⓘ
fineTuning supports task-specific fine-tuning ⓘ
fullName Generative Pre-trained Transformer 3 ⓘ
linked to: GPT-3
inputType text ⓘ
language English ⓘ
license proprietary ⓘ
limitation can generate incorrect or fabricated information ⓘ
may reflect biases in training data ⓘ
sensitive to prompt phrasing ⓘ
modelSize 175 billion parameters ⓘ
notableVariant GPT-3 1.3B ⓘ
linked to: GPT-3

GPT-3 125M ⓘ
linked to: GPT-3

GPT-3 13B ⓘ
linked to: GPT-3

GPT-3 175B ⓘ
linked to: GPT-3

GPT-3 2.7B ⓘ
linked to: GPT-3

GPT-3 350M ⓘ
linked to: GPT-3

GPT-3 6.7B ⓘ
linked to: GPT-3
numberOfParametersOfLargestVariant 175B ⓘ
outputType text ⓘ
paperAuthors Tom B. Brown et al. ⓘ
parameterCount 175,000,000,000 ⓘ
predecessor GPT-2 ⓘ
releaseDate June 2020 ⓘ
safetyMitigations content filters via OpenAI API ⓘ
successor GPT-3.5 ⓘ
GPT-4 ⓘ
trainingCompute hundreds of petaflop/s-days (approximate) ⓘ
trainingDataCutoff October 2019 ⓘ
trainingDataSource Common Crawl ⓘ
WebText-like corpora ⓘ
Wikipedia ⓘ
books ⓘ
trainingObjective next-token prediction ⓘ
trainingParadigm self-supervised learning ⓘ
unsupervised pre-training ⓘ
useCase chatbots ⓘ
code generation (via Codex derivatives) ⓘ
content creation ⓘ
virtual assistants ⓘ
zeroShotPrompting supported ⓘ

How these facts were elicited

Referenced by (29)

Full triples — surface form annotated when it differs from this entity's canonical label.

OpenAI → developed → GPT-3 ⓘ
DALL·E → inspiredBy → GPT-3 ⓘ
DALL·E → relatedTo → GPT-3 ⓘ
Codex → relatedTo → GPT-3 ⓘ
GPT-2 → successor → GPT-3 ⓘ
GPT-2 → predecessor → GPT ⓘ
linked to: GPT-3
GPT-3.5 → predecessor → GPT-3 ⓘ
GPT-3 → fullName → Generative Pre-trained Transformer 3 ⓘ
linked to: GPT-3
GPT-3 → abbreviation → GPT-3 ⓘ
GPT-3 → describedInPaper → Language Models are Few-Shot Learners ⓘ
linked to: GPT-3
GPT-3 → notableVariant → GPT-3 175B ⓘ
linked to: GPT-3
GPT-3 → notableVariant → GPT-3 13B ⓘ
linked to: GPT-3
GPT-3 → notableVariant → GPT-3 6.7B ⓘ
linked to: GPT-3
GPT-3 → notableVariant → GPT-3 2.7B ⓘ
linked to: GPT-3
GPT-3 → notableVariant → GPT-3 1.3B ⓘ
linked to: GPT-3
GPT-3 → notableVariant → GPT-3 350M ⓘ
linked to: GPT-3
GPT-3 → notableVariant → GPT-3 125M ⓘ
linked to: GPT-3
ChatGPT → relatedTo → GPT-3 ⓘ
Tom B. Brown → knownFor → GPT-3 ⓘ
subject linked to: Tom B. Brown et al.
Language Models are Few-Shot Learners → mainSubject → GPT-3 ⓘ
subject linked to: Tom B. Brown et al.
GPT series → hasMember → GPT-3 ⓘ
GPT-Neo → inspiredBy → GPT-3 ⓘ
OPT → comparisonTarget → OpenAI GPT-3 ⓘ
linked to: GPT-3
GPT → hasVersion → GPT-3 ⓘ
Language Models are Few-Shot Learners → alsoKnownAs → GPT-3 paper ⓘ
linked to: GPT-3
GPT-1 → influenced → GPT-3 ⓘ
Tom B. Brown → knownFor → GPT-3 ⓘ
Tom B. Brown → workOn → GPT-3 ⓘ