Tried something different. Instead of another notebook, I drew the whole process of training a transformer as one engineering blueprint. Attention, loss, AdamW, LR schedule, LoRA, scaling law, decoder block, loss curves.
Sound on: the audio is modelled on a GPU mid-training.
