Noam Shazeer

E457852

Noam Shazeer is an AI researcher and engineer best known as a co-creator of the Transformer architecture and a key contributor to large-scale neural language models.

All labels observed (1)

Label Occurrences
Noam Shazeer canonical 9

How this entity was disambiguated

Statements (45)

Predicate Object
instanceOf artificial intelligence researcher ⓘ
computer scientist ⓘ
person ⓘ
software engineer ⓘ
coAuthorOf Attention Is All You Need ⓘ
Exploring the Limits of Language Modeling ⓘ
On Layer Normalization in the Transformer Architecture ⓘ
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer ⓘ
Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity ⓘ
coAuthorWith Aidan N. Gomez ⓘ
Ashish Vaswani ⓘ
Illia Polosukhin ⓘ
Jakob Uszkoreit ⓘ
Llion Jones ⓘ
Niki Parmar ⓘ
Łukasz Kaiser ⓘ
linked to: Lukasz Kaiser
contributedTo Google’s large-scale language models ⓘ
Transformer architecture ⓘ
developed Sparsely-Gated Mixture-of-Experts layer ⓘ
Switch Transformer architecture ⓘ
educatedAt Brown University ⓘ
employer Google ⓘ
Google Brain ⓘ
Google Research ⓘ
fieldOfWork artificial intelligence ⓘ
large language models ⓘ
machine learning ⓘ
natural language processing ⓘ
gender male ⓘ
knownFor Mixture-of-Experts models ⓘ
Sparsely-Gated Mixture-of-Experts layer ⓘ
Switch Transformer ⓘ
linked to: Transformer

Tensor Processing Unit software contributions ⓘ
co-creating the Transformer architecture ⓘ
contributions to large-scale neural language models ⓘ
work on attention mechanisms in neural networks ⓘ
nationality American ⓘ
notableWork Sparsely-Gated Mixture-of-Experts layer ⓘ
Switch Transformer model ⓘ
Transformer architecture ⓘ
linked to: Transformer
positionHeld research scientist at Google ⓘ
researchInterest efficient training of large models ⓘ
neural network architectures ⓘ
scaling laws for neural networks ⓘ
sequence modeling ⓘ

How these facts were elicited

Referenced by (9)

Full triples — surface form annotated when it differs from this entity's canonical label.

Transformer → introducedBy → Noam Shazeer ⓘ
Łukasz Kaiser → notableStudent → Noam Shazeer ⓘ
subject linked to: Lukasz Kaiser
Łukasz Kaiser → collaboratedWith → Noam Shazeer ⓘ
subject linked to: Lukasz Kaiser
T5 → introducedBy → Noam Shazeer ⓘ
Attention Is All You Need → hasAuthor → Noam Shazeer ⓘ
Ashish Vaswani → coAuthorWith → Noam Shazeer ⓘ
Niki Parmar → coAuthorWith → Noam Shazeer ⓘ
Jakob Uszkoreit → hasCoAuthor → Noam Shazeer ⓘ
Aidan N. Gomez → collaboratedWith → Noam Shazeer ⓘ