A dimensionality-reduction pipeline is fitted on this training set of 5 samples with 2 features:
| Sample | x1 | x2 |
|---|
| A | 0 | 5 |
| B | 11 | 3 |
| C | 10 | 10 |
| D | 17 | 11 |
| E | 12 | 21 |
The pipeline runs the four standard steps:
- Centre the data: ci=xi−xˉ.
- Build the scatter matrix S=∑i=15cici⊤ (a plain sum of outer products, with no division).
- Take u, the unit eigenvector of S with the largest eigenvalue, as PC1.
- Compress each sample to the single number ti=u⊤ci.
Each sample is then reconstructed back into 2-D as x^i=xˉ+tiu.
What is the total squared reconstruction error over the whole training set?
E=∑i=15∥xi−x^i∥2