GPT-Neo

E435863

GPT-Neo is an open-source family of autoregressive language models developed by EleutherAI as a free alternative to OpenAI’s GPT-3.

All labels observed (5)

Label Occurrences
EleutherAI/gpt-neo 1
GPT-Neo canonical 1
GPT-Neo 1.3B 1

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf autoregressive language model family ⓘ
language model ⓘ
language model ⓘ
language model ⓘ
open-source language model ⓘ
accessModel downloadable checkpoints ⓘ
self-hosted ⓘ
architectureType decoder-only transformer ⓘ
basedOn transformer architecture ⓘ
compatibleWith Hugging Face Transformers ⓘ
designedAs free alternative to GPT-3 ⓘ
developer EleutherAI ⓘ
framework PyTorch ⓘ
TensorFlow ⓘ
hasCommunity EleutherAI community ⓘ
hasModel GPT-Neo 1.3B ⓘ
linked to: GPT-Neo

GPT-Neo 125M ⓘ
linked to: GPT-Neo

GPT-Neo 2.7B ⓘ
linked to: GPT-Neo
hostedOn GitHub ⓘ
inspiredBy GPT-3 ⓘ
language English ⓘ
license MIT License ⓘ
openSource true ⓘ
parameterCount 1.3 billion ⓘ
125 million ⓘ
2.7 billion ⓘ
programmingLanguage Python ⓘ
relatedTo GPT-J ⓘ
GPT-NeoX-20B ⓘ
releasedBy EleutherAI ⓘ
releaseYear 2021 ⓘ
repositoryName EleutherAI/gpt-neo ⓘ
linked to: GPT-Neo
supportsInference CPU ⓘ
GPU ⓘ
supportsTask conditional text generation ⓘ
few-shot learning ⓘ
language modeling ⓘ
text completion ⓘ
text continuation ⓘ
text generation ⓘ
zero-shot learning ⓘ
tokenizerType byte pair encoding ⓘ
trainingData The Pile ⓘ
trainingDataDeveloper EleutherAI ⓘ
trainingObjective next token prediction ⓘ
trainingType unsupervised learning ⓘ
useCase application integration ⓘ
prototyping ⓘ
research ⓘ

How these facts were elicited

Referenced by (5)

Full triples — surface form annotated when it differs from this entity's canonical label.

GPT-Neo → repositoryName → EleutherAI/gpt-neo ⓘ
linked to: GPT-Neo
GPT-Neo → hasModel → GPT-Neo 125M ⓘ
linked to: GPT-Neo
GPT-Neo → hasModel → GPT-Neo 1.3B ⓘ
linked to: GPT-Neo
GPT-Neo → hasModel → GPT-Neo 2.7B ⓘ
linked to: GPT-Neo