MML-14-01: Linear Regression Formulation: Matrix Notation & Normal Equations – Practice Quiz

40 worked single-select and multiselect questions on Linear Regression Formulation: Matrix Notation & Normal Equations. Cognitive level: Tier 2–3. Prerequisites: Parts 02, 06.

Develop conceptual understanding, step-by-step computations, ML diagnostics and the assigned theoretical derivations. Each explanation analyzes every choice by its content.

Learning objectives: Construct design matrices and interpret coefficient and residual dimensions. Expand RSS and derive its gradient and Hessian. Solve full-rank normal equations with explicit arithmetic. Handle rank deficiency, pseudoinverse solutions and intercept conventions. Distinguish algebraic OLS properties from noise assumptions. Choose numerically stable computational formulations. Analyze transformations and sufficient summary statistics.

Study references: Deisenroth, Faisal & Ong, Mathematics for Machine Learning, Sections 9.1–9.2.1.