A tiny network computes its output through this chain of operations:
z=w1x+b1,a=σ(z),y^=w2a,L=21(y^−y)2
where σ(z)=1+e−z1 is the sigmoid.
The current values are
| symbol | x | w1 | b1 | w2 | y |
|---|
| value | 2 | 1.5 | −3 | 4 | 3 |
Run the forward pass, then backpropagate. What is ∂w1∂L at these values?