comma.ai leaderboard

home · jobs · bounties · Discord · X

Welcome to the comma.ai leaderboard! We designed these challenges around real problems we've faced while building and shipping openpilot. We hope you enjoy them. If you do and score well, you'll probably enjoy a job here. * Submit your solution here * Multiple submissions are allowed * Non-competitive scores will not be published * is an employee or intern score * Active challenges are still expected to be difficult * Archived challenges are (mostly) solved problems

🔗 hardware challenge  

ACTIVE

 HIRING

find as many bugs as you can in our custom wire harness tester

bugs name
21 leosteinberg 👑
20 probablyanasian
20 delat
18 MastroGippo
18 dzid26
17 s-bashar
16 ruselec 👑
16 ashrey
14 1art
14 JulesGy
14 rexblade21
14 peteEH
13 lukasloetkolben
13 Quantizr
13 kostas1507
13 avangerp
13 arnuvbatra01
13 WesleyVong
13 bobycx
13 J-oseph
11 duong999123
11 Ans1S
11 tarnpreetb123
11 piman51277
11 CC-Ian
11 jrlomas
10 ssysm
10 ylevental
10 ZhanXiang-Yu

🔗 controls challenge  

ACTIVE

 HIRING

design a controller to steer a (simulated) car

score name method
35.967 haraschax MPC+much compute
43.776 tfpgh 👑PGTO+BC distillation
45.756 bheijdenPPO
48.08 ellenjxu custom feedback controller + evolution
48.474 TheConverseEngineer tube MPC + 2dof PID
48.57 Quantizr custom feedback controller
49.264 dumanah MPC w diffusion style annealing
50.192 truefit-ai custom PID + evolution
50.633 jonoomph ML PID
50.716 felsager  👑 custom feedback controller
52.506 izzunnafis custom feedback controller
54.708 ch33nchan adaptive PID
54.709 freeklinssen adaptive PID
55.485 garrettpall custom feedback controller
55.739 clouds1729 custom feedback controller + evolution
57.670 YasinSonmez PID w FF
58.57 YashDYD custom feedback controller
59.317 Parth171 custom feedback controller
59.811 avangerp custom feedback controller
59.853 haraschax custom feedback controller
60.993 srikanth-444 PPO
61.783 xfqbuaa custom PID
62.462 0xmmo genetic algorithm
62.971 zachhaidari PID w FF
63.793 fabP258 DOBC
68.055 matthiaspetry custom feedback controller
68.942 Officially-Siddhant custom PID
69.100 Vansh404 custom feedback controller + bayesian optimization
74.440 diegoruizpon custom feedback controller
75.688 Sanjit1 custom feedback controller
76.644 jaumebalust PID w FF
76.723 gcosentino PID w FF
77.365 ZiZizou custom PID
77.411 utkarshgill custom feedback controller
78.590 hpoonawala PID w FF
78.593 Havee005 PID w FF
78.868 yiannisha bayesian optimization
79.316 chinmaymirji PID+TD3
80.828 donymorph custom PID
83.568 jonoomph8 custom PID
88.774 Pranav-Malpure custom PID
90.893 atharva10764 custom PID w FF
91.130 integ01 MPC
95.724 adhintz auto-tuned PID
98.703 QuangTran1608 slsqp
100.445 pau-mensa bayesian optimization
102.184 NikhilGangaram custom PID
110.254 baseline PID

🔗 compression challenge  

ACTIVE

 HIRING

losslessly compress 5,000 minutes of driving data

score name method
3.4 szabolcs-cs self-compressing neural network
2.9 BradyWynn arithmetic coding with GPT
2.6 pkourouklidis 👑 arithmetic coding with GPT
2.3 anonymous zpaq
2.3 rostislav zpaq
2.2 anonymous zpaq
2.2 anonymous zpaq
2.2 0x41head zpaq
2.2 tillinf zpaq
2.2 ylevental zpaq
2.2 nuniesmith zpaq
1.6 baseline lzma

🔗 design challenge  

ACTIVE

design a UI to communicate openpilot's confidence to the user

NOTE: the job has been filled, but the challenge is still active for the leaderboard

name design
davidcalifornia design
utkarshgill design
hyusap design
salfolio design
dahsmartgirl design
kalipeng design

🔗 calibration challenge  

ARCHIVED

predict the direction of travel (in camera frame) from provided dashcam video

score name
5.33% fredyshox
9.4% Boris
10.0% krikarls
11.4% Ritam
18.5% bongbui321
18.7% Nathan
19.0% MartinEthier
19.0% louislva
19.6% arshsinghal6
19.6% Yasin
20.0% RoyVorster
20.0% Roman
20.22% Armandpl
20.5% Herman
24.8% gijskoning