Quadratic Discriminant Analysis

Quadratic Discriminant Analysis

Quadratic discriminant analysis (QDA) assumes observations from each class come from a Gaussian distribution and assumes each class has it's own covariance matrix.

Assume that an observation from the kth class is of the form X∼N(μk,Σk), where Σk is a covariance matrix for the kth class. Under this assumption, the Bayes classifier assigns an observation X=x to the class for which the following is largest:

δk(x)=−12(x−μk)TΣk−1(x−μk)−12log|Σk|+logπk=−12xTΣk−1x+xTΣk−1μk−12μkTΣk−1μk−12log|Σk|+logπk

QDA uses estimates of Σk, μk, and πk for the Bayes classifier and assigns an observation X=x to the class for which the quantity is largest. The quantity x appears as a quadratic function.

Sources: 1

Connect With Me!