Section 6.4. Model Evaluation

After training a classification or prediction model, the next phase is to test the model. This consists of two parts: first applying the trained model to a test set, and then comparing the predicted values with the actual values.

In this section, we introduce model evaluation techniques for a predictive model. The target variable of the model can be categorical or continuous. Possible model evaluation techniques include both a number of different accuracy statistics and graphs.

Evaluating Classification Model Performance

A classification model can be evaluated by different classification accuracy statistics:

  • confusion matrix
  • class prediction statistics
  • overall accuracy statistics

In addition to these statistics, graphs such as the receiver operating characteristic (ROC) curve and lift chart provide additional information about the classification model performance.