A hidden layer produces three activations for one training example:
A single downstream unit simply adds them up (all weights equal , no bias), producing .
During training, inverted dropout with keep probability is applied to the layer. Each unit gets its own independent mask , and surviving units are rescaled:
The activations are fixed; the only randomness is the mask.
Over the randomness of the masks, what are the mean and the standard deviation of ?
Select all that apply.