A network reads a single number between and . It has four hidden layers of two ReLU neurons each, a left neuron and a right neuron in every layer (eight hidden neurons in all), and one output neuron with no activation. Every weight and bias is fixed:
| neuron | reads | weights | bias | activation |
|---|---|---|---|---|
| hidden 1, left | ReLU | |||
| hidden 1, right | ReLU | |||
| hidden 2, 3 and 4, left | left and right of the layer below | on left, on right | ReLU | |
| hidden 2, 3 and 4, right | left and right of the layer below | on left, on right | ReLU | |
| output | left and right of hidden 4 | on left, on right | none |
For example, the right neuron of hidden layer 3 outputs , where left and right are the two outputs of hidden layer 2.
The network labels positive when its output and negative otherwise. As sweeps from to , the positive labels come in separate stretches, each cut off from the next by values of labelled negative.
Now picture a wide network with the same budget. It has eight ReLU neurons in a single hidden layer, each reading directly, and they feed one output neuron of the same kind. Its weights and biases can be anything you like.
Which statement is correct?
Select all that apply.