HuBERT

E435884

deep learning model self-supervised speech representation learning model speech foundation model

HuBERT is a self-supervised speech representation learning model that learns powerful audio features from unlabeled speech for tasks like automatic speech recognition and audio classification.

Try in SPARQL Jump to: Surface forms Disambiguation Statements Elicitation Referenced by

All labels observed (5)

Label	Occurrences
HuBERT canonical	2
HuBERT Base	1
HuBERT Large	1
HuBERT X-Large	1
HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units	1

How this entity was disambiguated

This entity first appeared as the object of triple T4389212 — resolving that mention is where its identity was fixed. The disambiguator weighed these candidate entities and picked the highlighted one (or “None”, minting a new entity). This is how homonymy is resolved: the same surface form can point to different entities.

NED1 Entity disambiguation (via context triple) gpt-5-mini-2025-08-07

Target entity: HuBERT
Context triple: [Hugging Face Transformers, supportsModelType, HuBERT]

A. WaveNet
WaveNet is a deep generative neural network architecture for raw audio that produces highly natural-sounding speech and other audio signals.
B. WaveRNN
WaveRNN is a neural network-based audio waveform generator designed as a more efficient, real-time alternative to earlier autoregressive models for tasks like text-to-speech synthesis.
C. Parallel WaveNet
Parallel WaveNet is a neural vocoder architecture that accelerates high-fidelity audio waveform generation by distilling the autoregressive WaveNet model into a fast, parallelizable form.
D. Hugging Face Transformers
Hugging Face Transformers is a widely used open-source library that provides state-of-the-art transformer-based models and tools for natural language processing and related machine learning tasks.
E. WaveGlow
WaveGlow is a flow-based generative neural network model for fast, high-quality text-to-speech audio synthesis.
F. None of above. chosen
G. Unsure - the case is ambiguous/there is not enough information to decide.

NED2 Entity disambiguation (via description) gpt-5-mini-2025-08-07

Target entity: HuBERT
Target entity description: HuBERT is a self-supervised speech representation learning model that learns powerful audio features from unlabeled speech for tasks like automatic speech recognition and audio classification.

A. WaveNet
WaveNet is a deep generative neural network architecture for raw audio that produces highly natural-sounding speech and other audio signals.
B. WaveRNN
WaveRNN is a neural network-based audio waveform generator designed as a more efficient, real-time alternative to earlier autoregressive models for tasks like text-to-speech synthesis.
C. Parallel WaveNet
Parallel WaveNet is a neural vocoder architecture that accelerates high-fidelity audio waveform generation by distilling the autoregressive WaveNet model into a fast, parallelizable form.
D. Hugging Face Transformers
Hugging Face Transformers is a widely used open-source library that provides state-of-the-art transformer-based models and tools for natural language processing and related machine learning tasks.
E. WaveGlow
WaveGlow is a flow-based generative neural network model for fast, high-quality text-to-speech audio synthesis.
F. None of above. chosen

Statements (51)

Predicate	Object
instanceOf	deep learning model ⓘ self-supervised speech representation learning model ⓘ speech foundation model ⓘ
basedOn	Transformer architecture ⓘ
designedFor	audio classification ⓘ automatic speech recognition ⓘ downstream speech tasks ⓘ self-supervised learning from speech ⓘ speech representation learning ⓘ spoken language understanding ⓘ
developedBy	Facebook AI Research ⓘ Meta AI ⓘ
evaluationBenchmark	Libri-light ⓘ LibriSpeech ⓘ TIMIT ⓘ
hasAuthor	Benjamin Bolte ⓘ James Glass ⓘ Kyunghyun Cho ⓘ Wei-Ning Hsu ⓘ Yao-Hung Hubert Tsai ⓘ
hasVariant	HuBERT Base ⓘ linked to: HuBERT HuBERT Large ⓘ linked to: HuBERT HuBERT X-Large ⓘ linked to: HuBERT
improvesOver	wav2vec 2.0 on several speech benchmarks ⓘ
inputType	acoustic features such as log-mel filterbanks ⓘ raw audio waveforms ⓘ
introducedIn	2021 ⓘ
introducedInPaper	HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units ⓘ linked to: HuBERT
language	primarily English in original experiments ⓘ
learningSignalSource	discrete units obtained by clustering MFCC or filterbank features ⓘ
maskingStrategy	masking of contiguous time spans in the input sequence ⓘ
openSourceImplementation	Hugging Face Transformers ⓘ fairseq ⓘ linked to: Fairseq
outputType	contextualized speech representations ⓘ frame-level audio embeddings ⓘ
pretrainingStage	masked region prediction of cluster assignments ⓘ offline clustering of acoustic features ⓘ
publishedAt	Interspeech 2021 ⓘ linked to: INTERSPEECH
relatedTo	Data2Vec ⓘ WavLM ⓘ wav2vec 2.0 ⓘ linked to: Wav2Vec2
supportsTask	audio event classification ⓘ automatic speech recognition fine-tuning ⓘ emotion recognition from speech ⓘ keyword spotting ⓘ phoneme recognition ⓘ speaker recognition ⓘ
trainingDataType	unlabeled speech audio ⓘ
trainingParadigm	self-supervised learning ⓘ
usesObjective	cluster-based prediction task ⓘ masked prediction of latent speech units ⓘ

How these facts were elicited

Referenced by (6)

Full triples — surface form annotated when it differs from this entity's canonical label.

Hugging Face Transformers → supportsModelType → HuBERT ⓘ

Wav2Vec2 → inspired → HuBERT ⓘ

HuBERT → introducedInPaper → HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units ⓘ

linked to: HuBERT

HuBERT → hasVariant → HuBERT Base ⓘ

linked to: HuBERT

HuBERT → hasVariant → HuBERT Large ⓘ

linked to: HuBERT

HuBERT → hasVariant → HuBERT X-Large ⓘ

linked to: HuBERT

All labels observed (5)

How this entity was disambiguated Show

Statements (51)

How these facts were elicited Show

Referenced by (6)

How this entity was disambiguated

How these facts were elicited