*Alice's book got a (minor) upgrade!*
Thanks to the dozens of people who gave feedback, now with 1000% less typos and errors, a novel set of Colab lab sessions, and a brand-new CC-BY-SA license. 🙃
sscardapane.it/alice-book/
*Alice goes to a differentiable wonderland!* 🔥
I published a short free book on the design of neural networks, from convolutions to transformers, SSMs, and a few other topics.
As a bonus, I tried to make it looking nice - any feedback is appreciated! sscardapane.it/alice-book
Because I got asked by so many people, I have open-sourced all videos for my Reproducible Deep Learning course! 🥳
~ 16 hours to combine with 13 code branches and quite a lot of slides. Videos are far from polished but I hope you enjoy them. 🙃
All here: sscardapane.it/teaching/repro…
Gather round, Twitter folks, it's time for our beloved
**Alice's adventures in a differentiable wonderland**, our magical tour of autodiff and backpropagation. 🔥
Slides below 1/n 👇
*Alice is out of draft jail!* 🥳
Thanks to all the feedback, v2 of "Alice in a differentiable wonderland" has practical exercises, a revamped graphic, and new content -- all freely available on arXiv and coming soon on Amazon in print. 🥰
sscardapane.it/alice-book
*Into the land of automatic differentiation*
Material is out! A short PhD course for the CS PhD in @SapienzaRoma covering basic and advanced topics in autodiff w/ slides, (rough) Notion notes, and two notebooks including a PyTorch-like implementation. 😅
sscardapane.it/teaching/phd-a…
If you are interested in graph neural networks, I made a quick Colab tutorial on performing graph classification with #PyTorch Geometric & @PyTorchLightnin, and then explaining the predictions with GNNExplainer and/or Captum.
colab.research.google.com/drive/14GPEIR7…
*Alice's Adventures in a Differentiable Wonderland*
Twitter friends, for a few days the powers that be were boycotting Alice, but now she is back on all Amazon stores! Keep sending me your pictures & your feedbacks on the book. 🔥
All links here: sscardapane.it/alice-book/
New personal challenge: organizing a self-contained PhD course on *reproducible deep learning*.
The idea is to take a simple DL Jupyter notebook and port it to a "reproducible" world with the use of Git @DVCorg@Docker Hydra...
I'll post the material here as we move along.😎 /n
*Generative Flow Networks*
A new method to sample structured objects (eg, graphs, sets) with a formulation inspired to the state space of reinforcement learning.
I have collected a few key ideas and pointers below if you are interested. 👀
1/n
👇
*Diffusion Models are Evolutionary Algorithms*
by @YanboZhang3@drmichaellevin et al.
They develop novel evolutionary algorithms based on an analogy between mutation / natural selection and the forward / reverse processes in diffusion models.
arxiv.org/abs/2410.02543