(0) Cover
(1) Last time
(2) Predicting String Probabilities
(3) Motivation
(4) How to Compute it?
(5) Two Famous Sentences
(6) The Language Modeling Problem
(7) The Language Modeling Problem
(8) Deriving Language Model
(9) Markov Assumption
(10) A Computational Model of Language
(11) Word-Based Approximations
(12) Evaluating a Language Model
(13) Perplexity
(14) Perplexity
(15) Maximum Likelihood Estimate
(16) Sparsity
(17) Today
(18) Add-One (Laplace) Smoothing
(19) Example
(20) Weaknesses of Laplace
(21) Good-Turing Discounting
(22) Good-Turing Discounting: Intuition
(23) Good-Turing Discounting (cont.)
(24) Example: Good-Turing
(25) The Bias-Variance Trade-Off
(26) Interpolation
(27) Linear Interpolation
(28) Linear Interpolation
(29) Parameter Estimation
(30) An Iterative Method
(31) Allowing the \lambda's to vary
(32) Katz Back-Off Models (Bigrams)
(33) Count^\star definitions
(34) Weaknesses of n-gram Models
(35) More Refined Models
(36) Summary


Postscript