A denoising autoencoder is being trained on a tiny dataset of four strips. Each strip is 4 pixels long, with brightness from to :
| strip | pixel 1 | pixel 2 | pixel 3 | pixel 4 |
|---|---|---|---|---|
Before a strip reaches the network, each of its pixels is knocked out (set to ) independently, with probability . The target is always the clean strip.
A network's score is its reconstruction loss (subtract, square, average over the 4 pixels), averaged over the four strips and over the random knock-outs. In other words, it is the loss the network gets on average.
Two lazy networks have learned nothing about strips:
When the damage is light, the copier scores better.
At what knock-out probability do the two networks score exactly the same?
Round to 2 decimal places.