Logistic regression example

Simulating a Gaussian classifier






Logistic regression MLE (solid) vs.
Minimal error boundary (dashed)

























CGConjugate Gradient
CoordCoordinate-wise Newton
Dual coordCoordinate-wise Newton on dual objective
NewtonNewton's method
BohningBohning's method (quasi-Newton)
ISIterative Scaling
MISModified Iterative Scaling

300 data points in 100 dimensions

Independent features






Correlated features


Tom Minka
Last modified: Thu Apr 12 10:24:17 EDT 2001