A neuron squashes its raw score zzz with a sharpened sigmoid — an ordinary logistic curve with a gain of 222 baked into the exponent:
a(z)=11+e−2za(z) = \frac{1}{1 + e^{-2z}}a(z)=1+e−2z1
Backpropagation needs a′(z)a'(z)a′(z) at the point where the neuron is perfectly undecided, z=0z = 0z=0.
Given e0=1e^{0} = 1e0=1, what is a′(0)a'(0)a′(0)?
Select all that apply.
14\frac{1}{4}41
12\frac{1}{2}21
111
−14-\frac{1}{4}−41