Bayes Classifier

Assigning a test observation with predictor vector $x_{0}$ to the class $j$ for which

P r (Y = j | X = x_{0})

And whose error rate is given by

1 - E (m a x_{j} P r (Y = j | X))

The Bayes classifier is the unattainable golden standard to compare other classification models to

Sources: 1