Neural Networks

 

We need to fit an unknown set of functions from a finite dataset
→ fixing a functional form introduces a bias
→ neural networks are non-linear objects: much more flexible parametrisation

Neural Networks allow for a redundant and unbiased parametrization
→ each neuron in the net gives an output (given by the function below) to the subsequent layer:

with a non-linear activation function