Natural Language Processing · TEE · formulas-chapter

Representation & similarity

Formulas explained through full worked examples

1. Label and one-hot encoding: three complete examples
2. Bag of words and bag of n-grams
3. TF–IDF from the exact slide convention
4. Cosine: products, lengths and division
5. Jaccard: intersection, union and distance
6. Manhattan, Euclidean and Minkowski: three complete comparisons
7. Distributional hypothesis and a co-occurrence matrix
8. Word2Vec: CBOW and skip-gram from training pairs
9. Word analogies and sentence embeddings
10. The GloVe objective and numerical interpretation