Skip to content

Leaderboard

Matbench is an automated leaderboard for benchmarking state of the art ML algorithms predicting a diverse range of solid materials' properties. It is hosted and maintained by the Materials Project.

crystal

Materials Properties Materials Discovery
Task Submissions 180 9
Algorithms 28 9
Benchmark Task Suite 1 1

Leaderboard-Property: General Purpose Algorithms on matbench_v0.1

Find more information about this benchmark on the benchmark info page

Task name Samples Algorithm Verified MAE (unit) or ROCAUC Notes
matbench_steels 312 MODNet (v0.1.12) 87.7627 (MPa)
matbench_jdft2d 636 MODNet (v0.1.12) 33.1918 (meV/atom)
matbench_phonons 1,265 MegNet (kgcnn v2.1.0) 28.7606 (cm^-1) structure required
matbench_expt_gap 4,604 MODNet (v0.1.12) 0.3327 (eV)
matbench_dielectric 4,764 MODNet (v0.1.12) 0.2711 (unitless)
matbench_expt_is_metal 4,921 AMMExpress v2020 0.9209
matbench_glass 5,680 MODNet (v0.1.12) 0.9603
matbench_log_gvrh 10,987 coNGN 0.0670 (log10(GPa)) structure required
matbench_log_kvrh 10,987 coNGN 0.0491 (log10(GPa)) structure required
matbench_perovskites 18,928 coGN 0.0269 (eV/unit cell) structure required
matbench_mp_gap 106,113 coGN 0.1559 (eV) structure required
matbench_mp_is_metal 106,113 CGCNN v2019 0.9520 structure required
matbench_mp_e_form 132,752 coGN 0.0170 (eV/atom) structure required