VQ-VAE

E755720

VQ-VAE is a neural network model that combines vector quantization with variational autoencoders to learn discrete latent representations for tasks like image and audio generation.

All labels observed (4)

Label Occurrences
VQ-VAE-2 3
VQ-VAE canonical 2
Vector Quantized Variational Autoencoder 2

How this entity was disambiguated

Statements (47)

Predicate Object
instanceOf neural network model ⓘ
addressesProblem learning discrete representations ⓘ
posterior collapse in VAEs ⓘ
basedOn variational autoencoder ⓘ
canBeExtendedTo VQ-VAE-2 ⓘ
linked to: VQ-VAE

hierarchical VQ-VAE ⓘ
linked to: VQ-VAE
codebookSize hyperparameter ⓘ
embeddingDimension hyperparameter ⓘ
fullName Vector Quantized Variational Autoencoder ⓘ
linked to: VQ-VAE
hasAdvantage avoids sampling from continuous latent distributions at training time ⓘ
enables use of powerful autoregressive priors over codes ⓘ
produces interpretable discrete codes ⓘ
hasComponent codebook ⓘ
codebook loss term ⓘ
commitment loss term ⓘ
decoder ⓘ
embedding vectors ⓘ
encoder ⓘ
reconstruction loss term ⓘ
hasLatentSpaceType discrete latent space ⓘ
inputType audio waveforms ⓘ
images ⓘ
spectrograms ⓘ
inspired subsequent discrete representation models ⓘ
introducedInPaper Neural Discrete Representation Learning ⓘ
latentRepresentation indices into a codebook of embeddings ⓘ
outputType reconstructed audio ⓘ
reconstructed images ⓘ
primaryApplication audio generation ⓘ
compression ⓘ
image generation ⓘ
representation learning ⓘ
speech generation ⓘ
proposedBy Aaron van den Oord ⓘ
Koray Kavukcuoglu ⓘ
Oriol Vinyals ⓘ
publicationYear 2017 ⓘ
publishedByOrganization DeepMind ⓘ
usedWith PixelCNN prior ⓘ
linked to: PixelCNN

WaveNet prior ⓘ
linked to: WaveNet
usesOptimizationMethod Adam optimizer ⓘ
stochastic gradient descent ⓘ
usesTechnique vector quantization ⓘ
usesTrainingObjective codebook vector quantization ⓘ
commitment loss regularization ⓘ
reconstruction error minimization ⓘ
usesTrick straight-through estimator ⓘ

How these facts were elicited

Referenced by (8)

Full triples — surface form annotated when it differs from this entity's canonical label.

Aaron van den Oord → developed → VQ-VAE-2 ⓘ
linked to: VQ-VAE
VQ-VAE → fullName → Vector Quantized Variational Autoencoder ⓘ
linked to: VQ-VAE
VQ-VAE → canBeExtendedTo → VQ-VAE-2 ⓘ
linked to: VQ-VAE
VQ-VAE → canBeExtendedTo → hierarchical VQ-VAE ⓘ
linked to: VQ-VAE
Neural Discrete Representation Learning → introduces → Vector Quantized Variational Autoencoder ⓘ
linked to: VQ-VAE
Neural Discrete Representation Learning → influenced → VQ-VAE-2 ⓘ
linked to: VQ-VAE