A tiny two-layer network is trained on a single example. Its computational graph is
with values
x=3,w1=2,b1=−1,w2=4,b2=2,y=20x = 3, \quad w_1 = 2, \quad b_1 = -1, \quad w_2 = 4, \quad b_2 = 2, \quad y = 20x=3,w1=2,b1=−1,w2=4,b2=2,y=20
Run a forward pass, then a backward pass.
What is ∂L∂w1\dfrac{\partial L}{\partial w_1}∂w1∂L?
Select all that apply.
484848
161616
242424
606060