Gradient AtlasML Materials

Deep learning roadmap

A deep learning roadmap from a single neuron to transformers: backpropagation, optimisers, PyTorch, CNNs, RNNs and attention. This is stage 4 of the five-stage data science roadmap.

What this stage covers

  1. Neurons and activations
  2. Backpropagation by hand
  3. Training and optimisers
  4. PyTorch basics
  5. CNNs for images
  6. RNNs and LSTMs
  7. Attention
  8. Transformers

The chapters for this stage are being written. Meanwhile, start with stage 1: Python.