Wav2Vec2

E435883

Wav2Vec2 is a self-supervised deep learning model for automatic speech recognition that learns powerful audio representations directly from raw waveforms.

All labels observed (7)

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf automatic speech recognition model ⓘ
deep learning model ⓘ
self-supervised learning model ⓘ
speech representation learning model ⓘ
achievesStateOfTheArtOn LibriSpeech 100h setting (at time of publication) ⓘ
availableVia Hugging Face Transformers ⓘ
basedOn convolutional neural networks ⓘ
transformer architecture ⓘ
developedBy Facebook AI Research ⓘ
Meta AI ⓘ
domain audio representation learning ⓘ
speech processing ⓘ
fineTuningDataType labeled speech with transcripts ⓘ
hasComponent convolutional feature encoder ⓘ
quantization module ⓘ
transformer context network ⓘ
hasVariant XLSR-53 ⓘ
linked to: Wav2Vec2

wav2vec 2.0 Base ⓘ
linked to: Wav2Vec2

wav2vec 2.0 Large ⓘ
linked to: Wav2Vec2

wav2vec 2.0 XLSR ⓘ
linked to: Wav2Vec2
implementedIn Fairseq ⓘ
PyTorch ⓘ
inputType 16 kHz mono audio ⓘ
inspired HuBERT ⓘ
WavLM ⓘ
introducedIn 2020 ⓘ
introducedInPaper wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations ⓘ
linked to: Wav2Vec2
languageCoverage English ⓘ
multilingual (via XLSR variants) ⓘ
learningParadigm contrastive learning ⓘ
self-supervised learning ⓘ
operatesOn raw audio waveforms ⓘ
outperforms previous self-supervised speech models on LibriSpeech ⓘ
paperAuthors Abdelrahman Mohamed ⓘ
Alexei Baevski ⓘ
Henry Zhou ⓘ
Michael Auli ⓘ
pretrainingDataType unlabeled speech audio ⓘ
publishedAtConference NeurIPS 2020 ⓘ
linked to: NeurIPS
releasedAs open-source model ⓘ
supportsTask keyword spotting ⓘ
speech classification ⓘ
speech recognition fine-tuning ⓘ
task automatic speech recognition ⓘ
trainingStrategy pretrain-then-finetune ⓘ
usesMasking time-step masking on latent speech representations ⓘ
usesObjective contrastive loss ⓘ
masked prediction ⓘ

How these facts were elicited

Referenced by (7)

Full triples — surface form annotated when it differs from this entity's canonical label.

Wav2Vec2 → introducedInPaper → wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations ⓘ
linked to: Wav2Vec2
Wav2Vec2 → hasVariant → wav2vec 2.0 Base ⓘ
linked to: Wav2Vec2
Wav2Vec2 → hasVariant → wav2vec 2.0 Large ⓘ
linked to: Wav2Vec2
Wav2Vec2 → hasVariant → wav2vec 2.0 XLSR ⓘ
linked to: Wav2Vec2
Wav2Vec2 → hasVariant → XLSR-53 ⓘ
linked to: Wav2Vec2
HuBERT → relatedTo → wav2vec 2.0 ⓘ
linked to: Wav2Vec2