One Hidden Layer, a Batch of Two — medium Matrix Multiplication problem | Incognition
One Hidden Layer, a Batch of Two
20 pts · 20 coins
Matrix MultiplicationMedium
One Hidden Layer, a Batch of Two
A hidden layer of a neural network processes a batch of two examples, each with three features. Rows are examples, columns are features:
X=[1−10321],W=201−113,b=[−21]
The layer computes
Z=XW+b,H=ReLU(Z)
where the layer has one bias per hidden unit, so the same row vector b is added to every row of XW, and ReLU(z)=max(0,z) is applied to each entry separately.