Skip to content

[CLI] Add hints and example to hf datasets leaderboard#4174

Merged
Wauplin merged 2 commits intomainfrom
cursor/leaderboard-hints-9ef8
Apr 30, 2026
Merged

[CLI] Add hints and example to hf datasets leaderboard#4174
Wauplin merged 2 commits intomainfrom
cursor/leaderboard-hints-9ef8

Conversation

@Wauplin
Copy link
Copy Markdown
Contributor

@Wauplin Wauplin commented Apr 30, 2026

Context: https://huggingface.slack.com/archives/C0A1MNQ8LF3/p1777552593518999

Summary

Improve discoverability of leaderboard-related CLI commands:

  • New example in --help: Added hf datasets ls --filter benchmark:official as a third example in the hf datasets leaderboard help text, so users know how to discover available leaderboards.
  • Hint: list available leaderboards: After the leaderboard table output, prints a hint suggesting hf datasets ls --filter benchmark:official.
  • Hint: get model info: After the leaderboard table output, prints a hint suggesting hf models info <model_id> using the top-ranked model from the results as a concrete example.

Example output

$ hf datasets leaderboard SWE-bench/SWE-bench_Verified --limit 3
RANK MODEL_ID                      VALUE SOURCE    
---- ----------------------------- ----- ----------
   1 deepseek-ai/DeepSeek-V4-Pro    80.6 Model Card
   2 moonshotai/Kimi-K2.6           80.2 Model Card
   3 deepseek-ai/DeepSeek-V4-Flash    79 Model Card
Hint: Use 'hf datasets ls --filter benchmark:official' to list available leaderboards.
Hint: Use 'hf models info deepseek-ai/DeepSeek-V4-Pro' to get details about a model.

Slack Thread

Open in Web Open in Cursor 

- Add example in --help showing how to list available leaderboards
  (hf datasets ls --filter benchmark:official)
- Add hint after output to list available leaderboards
- Add hint after output to get model info for the top-ranked model

Co-authored-by: Lucain <[email protected]>
@bot-ci-comment
Copy link
Copy Markdown

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

@Wauplin Wauplin marked this pull request as ready for review April 30, 2026 12:55
Copy link
Copy Markdown
Contributor

@hanouticelina hanouticelina left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@Wauplin Wauplin merged commit d501a9e into main Apr 30, 2026
21 checks passed
@Wauplin Wauplin deleted the cursor/leaderboard-hints-9ef8 branch April 30, 2026 13:01
@huggingface-hub-bot
Copy link
Copy Markdown
Contributor

This PR has been shipped as part of the v1.14.0 release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants