word2vec

E906310

word2vec is a neural network-based technique for learning dense vector representations of words that capture semantic and syntactic relationships, widely used in natural language processing.

All labels observed (6)

Label Occurrences
word2vec canonical 4
Continuous Bag-of-Words (CBOW) 1
Skip-gram 1

How this entity was disambiguated

Statements (48)

Predicate Object
instanceOf distributional semantics model ⓘ
natural language processing technique ⓘ
neural network-based representation learning method ⓘ
word embedding model ⓘ
basedOn distributional hypothesis ⓘ
neural networks ⓘ
captures semantic relationships between words ⓘ
syntactic relationships between words ⓘ
category unsupervised learning ⓘ
developedAt Google ⓘ
developedBy Tomas Mikolov ⓘ
domain computational linguistics ⓘ
natural language processing ⓘ
embeddingDimension typically 100–300 ⓘ
exampleProperty king - man + woman ≈ queen ⓘ
hasArchitecture Continuous Bag-of-Words (CBOW) ⓘ
linked to: word2vec

Skip-gram ⓘ
linked to: word2vec
implementedIn Gensim ⓘ
PyTorch ⓘ
TensorFlow ⓘ
inputUnit word tokens ⓘ
inspired GloVe ⓘ
fastText ⓘ
many neural word embedding methods ⓘ
introducedInPaper Efficient Estimation of Word Representations in Vector Space ⓘ
introducedInYear 2013 ⓘ
language C (original implementation) ⓘ
Python (reference implementations) ⓘ
license Apache-style open source (original code) ⓘ
optimizationTechnique hierarchical softmax ⓘ
negative sampling ⓘ
output word embeddings ⓘ
popularized vector arithmetic on words ⓘ
representationType continuous vector space ⓘ
dense vectors ⓘ
scalesTo billions of tokens ⓘ
supports large vocabularies ⓘ
task learning dense vector representations of words ⓘ
trainingDataType unlabeled text corpora ⓘ
trainingObjective predict context words from target word (Skip-gram) ⓘ
predict target word from context (CBOW) ⓘ
usedFor feature extraction for NLP models ⓘ
information retrieval ⓘ
machine translation (as component) ⓘ
semantic clustering ⓘ
text classification ⓘ
word analogy tasks ⓘ
word similarity ⓘ

How these facts were elicited

Referenced by (9)

Full triples — surface form annotated when it differs from this entity's canonical label.

Tomas Mikolov → knownFor → word2vec ⓘ
Tomas Mikolov → developed → word2vec algorithm ⓘ
linked to: word2vec
Paragraph Vector → basedOn → Word2Vec ⓘ
linked to: word2vec
word2vec → hasArchitecture → Continuous Bag-of-Words (CBOW) ⓘ
linked to: word2vec
word2vec → hasArchitecture → Skip-gram ⓘ
linked to: word2vec
Kai Chen → contributedTo → word2vec ⓘ