Skip to content

feat(cli): update benchmark cli#157

Merged
cheyang merged 5 commits intosgl-project:mainfrom
bcfre:bench-phase2
Feb 13, 2026
Merged

feat(cli): update benchmark cli#157
cheyang merged 5 commits intosgl-project:mainfrom
bcfre:bench-phase2

Conversation

@bcfre
Copy link
Copy Markdown
Collaborator

@bcfre bcfre commented Feb 11, 2026

Ⅰ. Motivation

Ⅱ. Modifications

Ⅲ. Does this pull request fix one issue?

fixes #XXXX

Ⅳ. List the added test cases (unit test/integration test) if any, please explain if no tests are needed.

Ⅴ. Describe how to verify it

VI. Special notes for reviews

Checklist

  • Format your code make fmt.
  • Add unit tests or integration tests.
  • Update the documentation related to the change.

@gemini-code-assist
Copy link
Copy Markdown

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

@coveralls
Copy link
Copy Markdown

coveralls commented Feb 11, 2026

Pull Request Test Coverage Report for Build 21932263741

Details

  • 0 of 0 changed or added relevant lines in 0 files are covered.
  • 84 unchanged lines in 4 files lost coverage.
  • Overall coverage decreased (-0.03%) to 38.465%

Files with Coverage Reduction New Missed Lines %
cli/cmd/llm/benchmark/job.go 8 95.72%
cli/cmd/llm/benchmark/dashboard_cmd.go 13 23.21%
cli/cmd/llm/benchmark/logs.go 14 0.0%
cli/cmd/llm/benchmark/benchmark.go 49 61.95%
Totals Coverage Status
Change from base Build 21891484685: -0.03%
Covered Lines: 4732
Relevant Lines: 12302

💛 - Coveralls

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the kubectl rbg llm benchmark CLI to improve UX around inspecting benchmark jobs/config, align PVC URI handling, and support building/publishing the benchmark dashboard image.

Changes:

  • Added benchmark get to fetch and display the benchmark config stored on a Job annotation.
  • Simplified PVC URI parsing by removing {namespace}:{pvc} support and documenting namespace resolution via kubeconfig context.
  • Improved operational behavior for logs/dashboard (pod readiness handling, port-forward error propagation, cleanup context) and updated docs/workflow.

Reviewed changes

Copilot reviewed 11 out of 11 changed files in this pull request and generated 6 comments.

Show a summary per file
File Description
doc/features/kubectl-rbg-benchmark.md Documents the new get command and updated PVC URI format; updates flag defaults and examples.
cmd/cli/cmd/llm/benchmark/pvc_test.go Removes namespace-in-URI test cases to match new PVC parsing rules.
cmd/cli/cmd/llm/benchmark/pvc.go Drops namespace parsing from PVC URIs and updates parsing logic/docs.
cmd/cli/cmd/llm/benchmark/logs.go Adjusts pod readiness waiting to allow log streaming from terminated pods.
cmd/cli/cmd/llm/benchmark/job.go Stores serialized benchmark config on the Job via annotation for later retrieval.
cmd/cli/cmd/llm/benchmark/get.go New command to read the Job annotation config and print it as YAML.
cmd/cli/cmd/llm/benchmark/dashboard_portforward.go Propagates port-forward process exit errors via result channel.
cmd/cli/cmd/llm/benchmark/dashboard_pod_test.go Removes dashboard PVC namespace test now that PVC namespace is no longer represented in parsed components.
cmd/cli/cmd/llm/benchmark/dashboard_cmd.go Uses a timeout context for pod deletion and updates pod readiness call signature.
cmd/cli/cmd/llm/benchmark/benchmark.go Registers the new get subcommand and enforces --config/-f mutual exclusivity; updates defaults/docs for flags.
.github/workflows/docker-build-push.yml Adds build/push step and summary entry for the benchmark dashboard image.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread cmd/cli/cmd/llm/benchmark/job.go
Comment thread cmd/cli/cmd/llm/benchmark/job.go
Comment thread cmd/cli/cmd/llm/benchmark/get.go
Comment thread cmd/cli/cmd/llm/benchmark/dashboard_cmd.go
Comment thread cmd/cli/cmd/llm/benchmark/benchmark.go Outdated
Comment thread doc/features/kubectl-rbg-benchmark.md Outdated
Comment thread cmd/cli/cmd/llm/benchmark/benchmark.go Outdated
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 13 out of 13 changed files in this pull request and generated 9 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread cmd/cli/cmd/llm/benchmark/benchmark.go
Comment thread cmd/cli/cmd/llm/benchmark/get.go
Comment thread doc/features/kubectl-rbg-benchmark.md
Comment thread cmd/cli/cmd/llm/benchmark/benchmark.go
Comment thread cmd/cli/cmd/llm/benchmark/get.go
Comment thread cmd/cli/cmd/llm/benchmark/dashboard_portforward.go
Comment thread cmd/cli/cmd/llm/benchmark/pvc.go
Comment thread cmd/cli/cmd/llm/benchmark/job.go
Comment thread cmd/cli/cmd/llm/benchmark/job.go
@bcfre bcfre requested a review from cheyang February 12, 2026 03:14
@cheyang
Copy link
Copy Markdown
Collaborator

cheyang commented Feb 12, 2026

/gemini review

@gemini-code-assist
Copy link
Copy Markdown

Warning

You have reached your daily quota limit. Please wait up to 24 hours and I will start processing your requests again!

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 14 out of 14 changed files in this pull request and generated 4 comments.


💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread cmd/cli/cmd/llm/benchmark/job.go
Comment thread cmd/cli/cmd/llm/benchmark/job.go
Comment thread cmd/cli/cmd/llm/benchmark/benchmark.go
Comment thread cmd/cli/cmd/llm/benchmark/get.go
Copy link
Copy Markdown
Collaborator

@cheyang cheyang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

@cheyang cheyang enabled auto-merge (squash) February 13, 2026 06:36
@cheyang cheyang disabled auto-merge February 13, 2026 06:37
@cheyang cheyang merged commit a7af265 into sgl-project:main Feb 13, 2026
14 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants