[about]   [papers]   [travels]   [talks]  

Chenglei Si (チェンレイ・シ)

[email] [scholar] [twitter] [github]
3rd Year PhD at Stanford NLP

About

At Stanford, I'm advised by the wonderful Tatsu Hashimoto and Diyi Yang. Before coming to Stanford, I did my undergrad at the University of Maryland where I was advised by Jordan Boyd-Graber. I also had the fortune to work with many amazing research mentors and collaborators, including Michael Bernstein, Hal Daumé III, He He, Danqi Chen, Sherry Wu, Zhiyuan Liu, Min-Yen Kan, and many others.

These days, I'm interested in how LLMs can accelerate scientific research. When not writing papers, I also write research related threads for fun. During the summer of 2025, I visited FutureHouse as a research intern, where I worked on research agents and reasoning models for chemistry and biology.

Papers During PhD

• The Ideation-Execution Gap: Execution Outcomes of LLM-Generated versus Human Research Ideas
  Chenglei Si, Tatsunori Hashimoto, Diyi Yang
  preprint [paper] [data] [tweet] [Science Coverage]
  


• Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP Researchers
  Chenglei Si, Diyi Yang, Tatsunori Hashimoto
  ICLR 2025 [paper] [code] [tweet] [Nature News] [Newsweek] [Synced]
  


• Predicting Empirical AI Research Outcomes with Language Models
  Jiaxin Wen, Chenglei Si, Yueh-han Chen, He He, Shi Feng
  NeurIPS 2025 [paper] [tweet]
  


• Design2Code: How Far Are We From Automating Front-End Engineering?
  Chenglei Si*, Yanzhe Zhang*, Zhengyuan Yang, Ruibo Liu, Diyi Yang
  NAACL 2025 [paper] [code] [project page] [tweet] [WorldofAI]
  

Talks

• Fall 2024: The Dream of Automating Research
  Stanford, USC, MIT, Northeastern, MILA, Intel, Samaya AI
  [slides] [podcast]
  


• Summer 2025: Progress on Automating Research
  UVA, alphaXiv, Ai2, CMU, COLM Visions Workshop
  [slides (v1)] [slides (v2)]
  

Conference Travels

• Oct 2025, COLM @ Montreal (co-organizer, LM4Sci)
• Apr 2025, ICLR @ Singapore
• Dec 2024, NeurIPS @ Vancouver
• Jun 2024, NAACL @ Mexico City
• Oct 2023, UIST @ San Francisco
• July 2023, ACL @ Toronto
• May 2023, ICLR @ Kigali
• Dec 2022, EMNLP @ Abu Dhabi
• July 2022, NAACL @ Seattle