New video!
The attention mechanism is well known for its use in Transformers. But where does it come from? It's origins lie in fixing a strange problems of RNNs. Watch the video to learn about it!
youtu.be/lOrTlKrdmkQ
IT'S FINALLY OUT!
After months of work, I'm happy to announce that the first video in a series on visualizing deep learning is out. It's on visualizing the structure of a neural network.
RTs appreciated :)
youtu.be/UOvPeC8WOt8
Life update: I’ve taken up a job as a researcher on the post-training team at @OpenAI, working on reinforcement learning, function calling and other efforts!
I’ve also graduated from @UCBerkeley where I’m grateful for a wonderful four years of learning and fun 😊
New video!
Ever wondered how a partially scanned barcode is still goes through? Or just wanna see a neat application of some abstract math? This video introduces Reed-Solomon Codes, through some seemingly unrelated topics.
youtu.be/1pQJkt7-R4Q
New video!
This one's on visualizing derivatives of complex functions. Turns out, there's some beautiful ways we can visualize the un-graphable.
youtu.be/0CHZMY02Dhk
Here's another brachistochrone thingy I dug up: if you place a ball on any point on the curve, it will always take the same amount of time to reach the end.
New video!
I introduce the idea of a neural language model, building up to the recurrent neural network. Recurrence-based language models were the cream of the crop till 2016 (before transformers), and were even used by Google Translate until then.
youtu.be/rTz6hadM1Lg
New Video!
Excited to be starting a new series on natural language processing! This first video, aims to explain what a Language Model is, through the N-Gram Language Model.
Stay tuned for more! I’ll be posting the next chapter next Monday (April 8)
youtu.be/1il-s4mgNdI
I'm taking a short break from making videos. I wanna make sure I put in as much effort as I can to get into an undergraduate program that I'll be happy spending the next 4 years at.
When I come back, it'll be strong. Expect some mind-blowing videos :)
