Artificial Neural Networks

Artificial neural networks

An artificial neuron.
The basic behavior of an artificial neural network is determined by the dot product (weighted sum) operator in each neuron.
This also has a geometric interpretation.
The dot product of A and B is the magnitude (vector length) of vector A by the magnitude of vector B by the cosine of the angle between them.

 Dot product video.

Statistical properties of the dot product.

The central limit theorem.


  1. Further information.

    The Weighted Sum:

    A frozen neural network:

    The Walsh Hadamard transform:

    The Walsh Hadamard transform (short):

    Activation weight switching (Beyond ReLU):

    Zero curvature initialisation of neural networks:

    SwitchNet4 neural network:


Post a Comment