Neural networks are grown, not programmed. What does that growth process look like? Like this!
This is a small language model (3M) across training, visualised with a new interpretability technique: susceptibilities. We call this handsome critter the rainbow serpent.
