Deep contextualized word representations

E771674

Deep contextualized word representations is a seminal NLP paper that introduced ELMo, a deep bidirectional language model that produces context-sensitive word embeddings and significantly advanced performance on many language understanding tasks.

All labels observed (8)

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf natural language processing paper ⓘ
scientific paper ⓘ
abbreviation ELMo paper ⓘ
approachType contextual word representation learning ⓘ
author Christopher Clark ⓘ
Kenton Lee ⓘ
Luke Zettlemoyer ⓘ
Mark Neumann ⓘ
Matt Gardner ⓘ
Matthew E. Peters ⓘ
Mohit Iyyer ⓘ
basedOn bidirectional language modeling ⓘ
citationStatus highly cited ⓘ
comparedTo GloVe ⓘ
word2vec ⓘ
demonstratesImprovementOn coreference resolution ⓘ
named entity recognition ⓘ
question answering ⓘ
semantic role labeling ⓘ
sentiment analysis ⓘ
textual entailment ⓘ
field computational linguistics ⓘ
natural language processing ⓘ
firstAuthor Matthew E. Peters ⓘ
impact significantly advanced performance on many NLP benchmarks ⓘ
improvesOver static word embeddings ⓘ
influenced BERT ⓘ
GPT contextual embeddings ⓘ
contextualized language models ⓘ
introduces ELMo ⓘ
keyIdea represent each token as a function of the entire input sentence ⓘ
use internal states of a deep bidirectional language model as word representations ⓘ
language English ⓘ
mainContribution context-sensitive word embeddings ⓘ
deep bidirectional language model for word representations ⓘ
deep contextualized word representations ⓘ
proposesMethod ELMo embeddings ⓘ
publicationYear 2018 ⓘ
publishedAt 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies ⓘ
linked to: NAACL 2018
publishedIn NAACL-HLT 2018 ⓘ
linked to: NAACL 2018
publisher Association for Computational Linguistics ⓘ
shortTitle ELMo paper ⓘ
taskCategory language understanding ⓘ
title Deep contextualized word representations ⓘ
usesArchitecture multi-layer bidirectional language model ⓘ
usesModelType deep bidirectional LSTM ⓘ
venue NAACL-HLT ⓘ
linked to: NAACL 2018
year 2018 ⓘ

How these facts were elicited

Referenced by (22)

Full triples — surface form annotated when it differs from this entity's canonical label.

Elmo → introducedInPaper → Deep contextualized word representations ⓘ
Deep contextualized word representations → title → Deep contextualized word representations ⓘ
Deep contextualized word representations → introduces → ELMo ⓘ
linked to: Deep contextualized word representations
Matt Gardner → contributedTo → ELMo language model ⓘ
linked to: Deep contextualized word representations
Matt Gardner → notableWork → ELMo ⓘ
linked to: Deep contextualized word representations
Kenton Lee → knownFor → ELMo contextual word embeddings ⓘ
linked to: Deep contextualized word representations
Kenton Lee → notableWork → ELMo ⓘ
linked to: Deep contextualized word representations
Kenton Lee → notableWork → Deep contextualized word representations ⓘ
Kenton Lee → hasCitation → Deep contextualized word representations ⓘ
NAACL 2018 → notablePaper → Deep contextualized word representations ⓘ
NAACL 2018 → introducedModel → ELMo ⓘ
linked to: Deep contextualized word representations
NAACL 2018 → paperTitle → Deep contextualized word representations ⓘ
Embeddings from Language Models → hasAbbreviation → ELMo ⓘ
linked to: Deep contextualized word representations
Embeddings from Language Models → publicationTitle → Deep contextualized word representations ⓘ
Luke Zettlemoyer → coDeveloperOf → ELMo ⓘ
linked to: Deep contextualized word representations
Luke Zettlemoyer → notableWork → ELMo: Deep contextualized word representations ⓘ
linked to: Deep contextualized word representations
Matthew E. Peters → knownFor → ELMo ⓘ
linked to: Deep contextualized word representations
Matthew E. Peters → coDeveloperOf → ELMo ⓘ
linked to: Deep contextualized word representations
Matthew E. Peters → coAuthorOf → Deep contextualized word representations ⓘ
Matthew E. Peters → citationsForWork → Deep contextualized word representations is highly cited in NLP research ⓘ
linked to: Deep contextualized word representations
Matthew E. Peters → impact → ELMo became a standard baseline for contextual word embeddings ⓘ
linked to: Deep contextualized word representations
Matthew E. Peters → impact → ELMo improved performance on multiple NLP benchmarks ⓘ
linked to: Deep contextualized word representations