Intro

3Blue1Brown Neural Networks

Neural Network Training

  1. Forward pass: model makes predictions from input data
  2. Compute loss: loss_fn(predictions, true_labels)
  3. Backward pass: compute gradients of the loss w.r.t. each weight (backpropagation)
  4. Update weights: adjust weights using an optimizer (e.g., SGD, Adam)