Sequence to Sequence Learning with Neural Networks

E260048

"Sequence to Sequence Learning with Neural Networks" is a seminal 2014 paper that introduced the sequence-to-sequence (seq2seq) neural network framework for tasks like machine translation, laying the groundwork for many modern NLP models.

All labels observed (1)

How this entity was disambiguated

Statements (50)

Predicate Object
instanceOf machine learning paper ⓘ
neural networks paper ⓘ
scientific paper ⓘ
affiliationOfAuthors Google ⓘ
approach encoder-decoder architecture ⓘ
recurrent neural networks ⓘ
author Ilya Sutskever ⓘ
Oriol Vinyals ⓘ
Quoc V. Le ⓘ
citationStatus highly cited ⓘ
conference Neural Information Processing Systems 2014 ⓘ
linked to: NeurIPS
demonstratedOn English-to-French machine translation ⓘ
WMT English-French dataset ⓘ
field deep learning ⓘ
machine learning ⓘ
natural language processing ⓘ
firstAuthor Ilya Sutskever ⓘ
impact foundational work for modern neural sequence modeling ⓘ
influenceOn Transformer-based models ⓘ
attention-based sequence models ⓘ
encoder-decoder architectures in deep learning ⓘ
neural machine translation ⓘ
sequence-to-sequence models in NLP ⓘ
speech recognition sequence models ⓘ
text summarization models ⓘ
keyIdea map variable-length input sequences to variable-length output sequences ⓘ
train encoder and decoder jointly to maximize conditional probability of target sequence ⓘ
use a fixed-length vector representation of the input sequence ⓘ
mainContribution application of encoder-decoder RNNs to sequence transduction tasks ⓘ
demonstration of neural machine translation with RNN encoder-decoder ⓘ
introduction of the sequence-to-sequence neural network framework ⓘ
organization Google ⓘ
publicationYear 2014 ⓘ
publishedIn Advances in Neural Information Processing Systems ⓘ
linked to: NeurIPS

NeurIPS 2014 ⓘ
linked to: NeurIPS
publisher Neural Information Processing Systems Foundation ⓘ
linked to: NeurIPS
relatedConcept encoder-decoder RNN ⓘ
neural machine translation ⓘ
sequence modeling ⓘ
result achieved state-of-the-art performance on English-French translation at time of publication ⓘ
task machine translation ⓘ
sequence transduction ⓘ
sequence-to-sequence learning ⓘ
technique reversing the order of words in the source sentence ⓘ
use of beam search for decoding ⓘ
use of multi-layer LSTMs ⓘ
title Sequence to Sequence Learning with Neural Networks ⓘ
usesModel LSTM decoder ⓘ
LSTM encoder ⓘ
Long Short-Term Memory network ⓘ
linked to: LSTM networks

How these facts were elicited

Referenced by (4)

Full triples — surface form annotated when it differs from this entity's canonical label.

Quoc V. Le → coAuthorOf → Sequence to Sequence Learning with Neural Networks ⓘ
Oriol Vinyals → notableWork → Sequence to Sequence Learning with Neural Networks ⓘ
Sequence to Sequence Learning with Neural Networks → title → Sequence to Sequence Learning with Neural Networks ⓘ