Skip to content

[CLI] add hf datasets leaderboard#4154

Merged
Wauplin merged 7 commits intomainfrom
codex/datasets-leaderboard-cli
Apr 28, 2026
Merged

[CLI] add hf datasets leaderboard#4154
Wauplin merged 7 commits intomainfrom
codex/datasets-leaderboard-cli

Conversation

@hanouticelina
Copy link
Copy Markdown
Contributor

@hanouticelina hanouticelina commented Apr 27, 2026

This PR adds hf datasets leaderboard DATASET_ID as the CLI counterpart to HfApi.get_dataset_leaderboard(...).

$ hf datasets leaderboard SWE-bench/SWE-bench_Verified --limit 5
RANK MODEL_ID                      VALUE SOURCE                    
---- ----------------------------- ----- --------------------------
   1 deepseek-ai/DeepSeek-V4-Pro    80.6 Model Card                
   2 moonshotai/Kimi-K2.6           80.2 Model Card                
   3 deepseek-ai/DeepSeek-V4-Flash    79 Model Card                
   4 zai-org/GLM-5                  77.8 Model card                
   5 OrionLLM/GRM-2.6-Plus          77.7 Official GRM-2.6 Benchmark

Note

Low Risk
Low risk: adds a new read-only CLI command that calls an existing Hub API and updates docs; no changes to auth, uploads, or data mutation paths.

Overview
Adds a new hf datasets leaderboard <DATASET_ID> command that fetches a dataset’s leaderboard via HfApi.get_dataset_leaderboard and prints the top entries (configurable via --limit, respecting existing --format/--token patterns).

Updates the CLI guide and generated CLI reference docs to document the new subcommand and provide usage examples.

Reviewed by Cursor Bugbot for commit cab9693. Bugbot is set up for automated code reviews on this repo. Configure here.

@hanouticelina hanouticelina requested a review from Wauplin April 27, 2026 15:24
@bot-ci-comment
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

Copy link
Copy Markdown
Contributor

@Wauplin Wauplin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you!

@Wauplin Wauplin merged commit 10f1d21 into main Apr 28, 2026
20 of 21 checks passed
@Wauplin Wauplin deleted the codex/datasets-leaderboard-cli branch April 28, 2026 14:11
@Wauplin
Copy link
Copy Markdown
Contributor

Wauplin commented Apr 28, 2026

Windows 3.10 still with a flaky test 😭

@huggingface-hub-bot
Copy link
Copy Markdown
Contributor

This PR has been shipped as part of the v1.13.0 release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants