Neural Network Propagation Formulas

  • Linear
  • Binary Step
  • Sigmoid Logistic
  • Sigmoid Derivative
  • Tanh
  • Tanh Derivative
  • ReLu
  • Leaky ReLu
  • Parametric ReLU
  • Elu
  • Elu Derivative
  • Swish
  • Computed
  • Summation