MML-14-10: Classification Diagnostics: Confusion Matrix, ROC/AUC, PR Curves & Calibration – Practice Quiz

35 worked single-select and multiselect questions on Classification Diagnostics: Confusion Matrix, ROC/AUC, PR Curves & Calibration. Cognitive level: Tier 2–3. Prerequisites: QS 14.9.

Learning objectives: Read confusion matrices with explicit class orientation; Compute precision, recall, specificity and F scores; Calculate ROC AUC with correct tie treatment; Interpret PR metrics under prevalence shifts; Assess calibration and binary Brier loss; Choose thresholds and calibration protocols without test leakage.

Each item is self-contained, with calculations, model diagnostics and explanations of every distractor. Study references: scikit-learn model evaluation; scikit-learn probability calibration.