Hyung Won Chung (@hwchung27) / X

Hyung Won Chung

592 posts

Hyung Won Chung

@hwchung27

AI Research Scientist @Meta Superintelligence Labs. Past: @OpenAI / @Google Brain / PhD @MIT

Mountain View, CA

Joined February 2021

Pinned
Hyung Won Chung
@hwchung27
Sep 19, 2024
Here is my talk at @MIT (after some delay😅) I made this talk last year when I was thinking about a paradigm shift. This delayed posting is timely as we just released o1, which I believe is a new paradigm. It's a good time to zoom out for high level thinking. (1/11)
00:00
398K
Hyung Won Chung
@hwchung27
Jul 16, 2025
This is my lecture from 2 months ago at @Cornell “How do I increase my output?” One natural answer is "I will just work a few more hours." Working longer can help, but eventually you hit a physical limit. A better question is, “How do I increase my output without increasing
00:00
469K
Hyung Won Chung
@hwchung27
Oct 5, 2023
I gave a talk at Seoul National University. I titled the talk “Large Language Models (in 2023)”. This was an ambitious attempt to summarize our exploding field. Video: youtu.be/dbo3kNKPaUA Slides: docs.google.com/presentation/d… Trying to summarize the field forced me to think
567K
Hyung Won Chung
@hwchung27
Aug 14, 2025
After a great time at OpenAI, we (@EdwardSun0909, @_jasonwei) recently joined @Meta Superintelligence Labs. The first month has already been so much fun building from a clean slate with a truly talent-dense team! Very excited about the compute and long term focus of the new lab
1.2M
Hyung Won Chung
@hwchung27
Jun 11, 2024
I gave a lecture at @Stanford CS 25. Lecture video: youtu.be/orDKvo8h71o?si… AI is moving so fast that it's hard to keep up. Instead of spending all our energy catching up with the latest development, we should study the change itself. First step is to identify and understand
272K
Hyung Won Chung
@hwchung27
Feb 14, 2023
Excited to share that I joined @OpenAI after 3 incredible years at Google Brain! Can’t wait to work on #ChatGPT and help drive the future of AI.
236K
Hyung Won Chung
@hwchung27
Nov 20, 2023
OpenAI is nothing without its people
45K
Hyung Won Chung
@hwchung27
May 17, 2023
I gave an invited lecture on Instruction finetuning and RLHF for @hhexiy 's class at NYU. One unique perspective of my lecture is that I introduce RLHF as an instance of using a learned objective function. Video: youtu.be/zjrM-MW-0y0 Slides: docs.google.com/presentation/d…
142K
Hyung Won Chung
@hwchung27
Jun 6, 2023
We are hiring in the ChatGPT team! Happy to chat about this position. DMs are open. Instead of your papers, I’d love to learn about the most difficult technical problem you worked on and your lessons. It doesn’t have to be ML. I value exceptional technical skill a lot more than
Barret Zoph
@barret_zoph
Jun 6, 2023
Our team at OpenAI is hiring! We're looking for engineers/researchers who do rigorous and thoughtful work understanding and evaluating LLMs like ChatGPT. If you're interested, please apply online and DM me with work that you've done!
304K
Hyung Won Chung
@hwchung27
Jun 13, 2023
An interesting confounding factor in comparing these models is that training details really matter. For Flan-T5, resetting the Adafactor optimizer states during instruction finetuning was the biggest factor. It increased the MMLU almost double digit from 43 to 52. This was
Yi Tay
@YiTayML
Jun 12, 2023
Hot take 🔥: Lots of buzz these days about new foundation open-source models but what if I told you there have been no real advance since 2019's T5 models 😀 Take a look at this table from this new InstructEval paper: arxiv.org/abs/2306.04757. Some thoughts/observations: 1.
169K
Hyung Won Chung
@hwchung27
Feb 3, 2025
Happy to share Deep Research, our new agent model! One notable characteristic of Deep Research is its extreme patience. I think this is rapidly approaching “superhuman patience”. One realization working on this project was that intelligence and patience go really well together.
77K
Hyung Won Chung
@hwchung27
Nov 19, 2023
Many visionaries talk about future. But talking to @sama is another level. It feels like he is already in 2030 and talks back at me. Then thinking about future becomes an "interpolation" between where I am and where he is, as opposed to extrapolation into the wild Can't think
160K
Hyung Won Chung
@hwchung27
Oct 4, 2023
Research code that doesn’t make readers feel dumb is great. Too often, code is written to showcase the author's advanced knowledge of the language/framework, which overwhelms the reader. Researchers come to the code with other thoughts/hypotheses in mind. The mental bandwidth is
55K
Hyung Won Chung
@hwchung27
Oct 21, 2022
New paper + models! We extend instruction finetuning by 1. scaling to 540B model 2. scaling to 1.8K finetuning tasks 3. finetuning on chain-of-thought (CoT) data With these, our Flan-PaLM model achieves a new SoTA of 75.2% on MMLU.
Quoc Le
@quocleix
Oct 21, 2022
New open-source language model from Google AI: Flan-T5 🍮 Flan-T5 is instruction-finetuned on 1,800+ language tasks, leading to dramatically improved prompting and multi-step reasoning abilities. Public models: bit.ly/3sbNPDJ Paper: arxiv.org/abs/2210.11416