Natural Language Processing · M2 · formulas-chapter

Smoothing & perplexity

Formulas explained through full worked examples

1. Laplace smoothing: why both numerator and denominator change
2. A complete unseen-bigram question from corpus to final answer
3. Adjusted counts and relative discounting
4. Perplexity: meaning, formula and four complete examples
5. Log probabilities: replace long products with sums