GPT-3

E18819

GPT-3 is a large-scale autoregressive language model known for generating human-like text and performing a wide range of natural language tasks with minimal fine-tuning.

All labels observed (11)

How this entity was disambiguated

Statements (57)

Predicate Object
instanceOf autoregressive language model
large language model
transformer-based model
abbreviation GPT-3
announcedIn 2020
architecture Transformer
capability few-shot learning
natural language generation
one-shot learning
question answering
summarization
text completion
translation
zero-shot learning
commercialAccess OpenAI API
describedInPaper Language Models are Few-Shot Learners
linked to: GPT-3
developer OpenAI
fewShotPrompting supported
fineTuning supports task-specific fine-tuning
fullName Generative Pre-trained Transformer 3
linked to: GPT-3
inputType text
language English
license proprietary
limitation can generate incorrect or fabricated information
may reflect biases in training data
sensitive to prompt phrasing
modelSize 175 billion parameters
notableVariant GPT-3 1.3B
linked to: GPT-3

GPT-3 125M
linked to: GPT-3

GPT-3 13B
linked to: GPT-3

GPT-3 175B
linked to: GPT-3

GPT-3 2.7B
linked to: GPT-3

GPT-3 350M
linked to: GPT-3

GPT-3 6.7B
linked to: GPT-3
numberOfParametersOfLargestVariant 175B
outputType text
paperAuthors Tom B. Brown et al.
parameterCount 175,000,000,000
predecessor GPT-2
releaseDate June 2020
safetyMitigations content filters via OpenAI API
successor GPT-3.5
GPT-4
trainingCompute hundreds of petaflop/s-days (approximate)
trainingDataCutoff October 2019
trainingDataSource Common Crawl
WebText-like corpora
Wikipedia
books
trainingObjective next-token prediction
trainingParadigm self-supervised learning
unsupervised pre-training
useCase chatbots
code generation (via Codex derivatives)
content creation
virtual assistants
zeroShotPrompting supported

How these facts were elicited

Referenced by (21)

Full triples — surface form annotated when it differs from this entity's canonical label.

OpenAI developed GPT-3
DALL·E inspiredBy GPT-3
DALL·E relatedTo GPT-3
Codex relatedTo GPT-3
GPT-2 successor GPT-3
GPT-2 predecessor GPT
linked to: GPT-3
GPT-3.5 predecessor GPT-3
GPT-3 fullName Generative Pre-trained Transformer 3
linked to: GPT-3
GPT-3 abbreviation GPT-3
GPT-3 describedInPaper Language Models are Few-Shot Learners
linked to: GPT-3
GPT-3 notableVariant GPT-3 175B
linked to: GPT-3
GPT-3 notableVariant GPT-3 13B
linked to: GPT-3
GPT-3 notableVariant GPT-3 6.7B
linked to: GPT-3
GPT-3 notableVariant GPT-3 2.7B
linked to: GPT-3
GPT-3 notableVariant GPT-3 1.3B
linked to: GPT-3
GPT-3 notableVariant GPT-3 350M
linked to: GPT-3
GPT-3 notableVariant GPT-3 125M
linked to: GPT-3
ChatGPT relatedTo GPT-3
Tom B. Brown knownFor GPT-3
subject linked to: Tom B. Brown et al.
Language Models are Few-Shot Learners mainSubject GPT-3
subject linked to: Tom B. Brown et al.
GPT series hasMember GPT-3