EncoderDecoderModel

E435886

EncoderDecoderModel is a Hugging Face Transformers architecture that combines a separate encoder and decoder into a unified sequence-to-sequence model for tasks like translation, summarization, and text generation.

All labels observed (2)

Label Occurrences
EncoderDecoderModel canonical 1
encoder-decoder Transformer 1

How this entity was disambiguated

Statements (49)

Predicate Object
instanceOf Hugging Face Transformers class ⓘ
neural network architecture ⓘ
sequence-to-sequence model ⓘ
canUseDecoderType BertLMHeadModel ⓘ
GPT2LMHeadModel ⓘ
linked to: GPT-2

RobertaForCausalLM ⓘ
linked to: RoBERTa

XLNetLMHeadModel ⓘ
linked to: XLNet
canUseEncoderType BertModel ⓘ
DistilBertModel ⓘ
linked to: DistilBERT

LongformerModel ⓘ
linked to: Longformer

RobertaModel ⓘ
linked to: RoBERTa
documentationUrl https://huggingface.co/docs/transformers/model_doc/encoder_decoder ⓘ
hasComponent decoder ⓘ
encoder ⓘ
hasMethod forward ⓘ
from_encoder_decoder_pretrained ⓘ
from_pretrained ⓘ
generate ⓘ
implementedIn Python ⓘ
inheritsFrom PreTrainedModel ⓘ
inputType attention_mask ⓘ
decoder_attention_mask ⓘ
decoder_input_ids ⓘ
input_ids ⓘ
isCompatibleWith AutoTokenizer ⓘ
Seq2SeqTrainer ⓘ
isDefinedInModule transformers.models.encoder_decoder ⓘ
isUsedFor building custom seq2seq models from separate encoder and decoder checkpoints ⓘ
outputType decoder_hidden_states ⓘ
encoder_last_hidden_state ⓘ
logits ⓘ
loss ⓘ
providedBy Hugging Face Transformers library ⓘ
supportsFeature encoder-decoder attention ⓘ
gradient checkpointing ⓘ
teacher forcing ⓘ
weight tying ⓘ
supportsGenerationStrategy beam search ⓘ
greedy search ⓘ
sampling ⓘ
top-k sampling ⓘ
top-p sampling ⓘ
supportsTask conditional text generation ⓘ
machine translation ⓘ
sequence-to-sequence learning ⓘ
text generation ⓘ
text summarization ⓘ
supportsTrainingObjective cross-entropy loss ⓘ
usesConfigClass EncoderDecoderConfig ⓘ

How these facts were elicited

Referenced by (2)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hugging Face Transformers → supportsModelType → EncoderDecoderModel ⓘ
Transformer → hasVariant → encoder-decoder Transformer ⓘ
linked to: EncoderDecoderModel