AD modes
Gradients (Reverse Mode)
Higher Order Gradients (Sparse-on-Reverse)
Variadic Gradients (Sparse or Kahn)
Jacobians (Sparse or Reverse)
Higher Order Jacobian (Sparse-on-Reverse)
Transposed Jacobians (Forward Mode)
Hessian (Sparse-On-Reverse)
Hessian Tensors (Sparse or Sparse-On-Reverse)
Hessian Tensors (Sparse)
Hessian Vector Products (Forward-On-Reverse)
Derivatives (Forward Mode)
Derivatives (Tower)
Directional Derivatives (Forward Mode)
Directional Derivatives (Tower)
Taylor Series (Tower)
Maclaurin Series (Tower)
Gradient Descent