mBART

E435877

mBART is a multilingual sequence-to-sequence Transformer model designed for tasks like machine translation and text generation across many languages.

All labels observed (5)

How this entity was disambiguated

Statements (45)

Predicate Object
instanceOf Transformer model ⓘ
denoising autoencoder ⓘ
multilingual sequence-to-sequence model ⓘ
neural machine translation model ⓘ
architectureType encoder-decoder ⓘ
basedOn Transformer architecture ⓘ
category large language model ⓘ
multilingual language model ⓘ
designedFor cross-lingual transfer ⓘ
low-resource machine translation ⓘ
developer Facebook AI ⓘ
linked to: Meta AI

Meta AI ⓘ
hasComponent Transformer decoder ⓘ
Transformer encoder ⓘ
hasVariant mBART-25 ⓘ
linked to: mBART

mBART-50 ⓘ
linked to: mBART
implementedIn Hugging Face Transformers ⓘ
fairseq ⓘ
linked to: Fairseq
inputRepresentation language-specific tokens ⓘ
shared subword vocabulary ⓘ
inputType text ⓘ
introducedIn research paper ⓘ
languageCoverage multilingual ⓘ
learningParadigm encoder-decoder pretraining ⓘ
license Apache-2.0 (via common implementations) ⓘ
notableProperty single model for many translation directions ⓘ
strong performance on low-resource languages ⓘ
optimizationAlgorithm Adam ⓘ
outputType text ⓘ
paperTitle Multilingual Denoising Pre-training for Neural Machine Translation ⓘ
pretrainedOn large multilingual corpora ⓘ
pretrainingType self-supervised learning ⓘ
releaseYear 2020 ⓘ
supports many languages ⓘ
supportsTask denoising ⓘ
machine translation ⓘ
sequence-to-sequence learning ⓘ
summarization ⓘ
text generation ⓘ
trainingObjective denoising autoencoding ⓘ
reconstructing original text from noisy input ⓘ
typicalUse fine-tuning for specific translation directions ⓘ
zero-shot translation ⓘ
uses Transformer attention mechanisms ⓘ
subword tokenization ⓘ

How these facts were elicited

Referenced by (5)

Full triples — surface form annotated when it differs from this entity's canonical label.

BART → hasVariant → MBART ⓘ
linked to: mBART
BART → introducedInPaper → BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension ⓘ
linked to: mBART
mBART → hasVariant → mBART-50 ⓘ
linked to: mBART
mBART → hasVariant → mBART-25 ⓘ
linked to: mBART