Vishal Sahoo

@vishalds17

Learning for the fun of it

decodelm.com/profiles/vishal

Joined January 2024

48 Following

6 Followers

Vishal Sahoo
@vishalds17
Aug 2
I just watched 3Blue1Brown Compression is Intelligence on YouTube and realized that I didn't understand entropy or cross-entropy when I was writing my article on LLMs Reminded me of all the knowledge and curiosity I have gained from @3blue1brown and @salkhanacademy over the years Thank you for making knowledge accessible and fun!
Vishal Sahoo
@vishalds17
Jun 16
I made Part 1 of a series on how LLMs work under the hood. This one starts at the beginning: how raw text becomes tokens, IDs, vocabularies, and eventually something a model can train on. Excited to learn and share more! Check it out if you're interested :)
youtube.com
How LLMs Understand Text: Tokenization, Encoding, and BPE Explained | LLMs From Scratch Part 1
This is Part 1 of a series on how Large Language Models like GPT, G...
1
Vishal Sahoo
@vishalds17
May 16
Anthropic ran an RCT with software engineers learning a new Python library. Half used an AI assistant, half coded by hand. The AI group scored 17% lower on a mastery quiz taken minutes after finishing. The biggest gap was in debugging - the skill you need when AI-generated code
How AI assistance impacts the formation of coding skills
From anthropic.com
1
Vishal Sahoo
@vishalds17
May 6
The push right now is "intent-based development." You describe what you want, run a system of agents, review what comes back, ship it. But reading code is not the same as thinking through cases with a blank slate and producing code. We always reviewed other people's code, but we
Vishal Sahoo
@vishalds17
Apr 26
The happiest I've ever been was staring at a whiteboard for hours, stuck. In university I'd spend entire days on a single problem. Trying something. Failing. Trying a different angle. Walking away, coming back, seeing it differently. Going through every possible path - not

Vishal Sahoo

Vishal Sahoo’s posts