A model has a single dial . Its total loss is the sum of two competing pieces:
| Piece | Formula | Behaviour as grows |
|---|---|---|
| Complexity penalty | climbs steadily | |
| Fit error | falls away |
Before the optimizer can take a single step it has to ask the loss one question: how steep is it right here? The dial currently sits at .
A slope worked out for one setting is useless the moment the dial moves, so do it properly. Working from the limit definition
first find the derivative as a function of , then evaluate that function at .
Round your answer to two decimal places.