Neural Network Propagation Formulas Linear Binary Step Sigmoid Logistic Sigmoid Derivative Tanh Tanh Derivative ReLu Leaky ReLu Parametric ReLU Elu Elu Derivative Swish Computed Summation