Skip to content

update aiconfigurator dependency#228

Merged
cheyang merged 3 commits intosgl-project:mainfrom
diw-zw:llm-generate
Mar 24, 2026
Merged

update aiconfigurator dependency#228
cheyang merged 3 commits intosgl-project:mainfrom
diw-zw:llm-generate

Conversation

@diw-zw
Copy link
Copy Markdown
Collaborator

@diw-zw diw-zw commented Mar 20, 2026

Ⅰ. Motivation

Here’s the English translation in Markdown format for your PR description:


Update CLI Tool to Support aiconfigurator 0.7.0

Major Changes

  1. Parameter Naming Convention

    • All underscores (_) in parameter names have been replaced with hyphens (-), following the new aiconfigurator 0.7.0 guidelines.
  2. Generated File Naming

    • The output file name format has changed from
      {model_base_name}_isl{isl}_osl{osl}_ttft{ttft}_tpot{tpot}_
      
      to
      {model_base_name}_{system}_{backend}_isl{isl}_osl{osl}_ttft{ttft}_tpot{tpot}_
      
  3. Enhanced --model Argument

    • The --model parameter now supports both local model paths and Hugging Face model IDs. Users can specify either a local model file or a Hugging Face Model ID.
  4. Removed hf_id Argument

    • The hf_id argument is no longer supported. All model selection should be done through the --model parameter.

Additional Notes

  • This update ensures that the CLI tool is compatible with the new aiconfigurator interface.
  • All related command calls and parameter parsing logic have been updated accordingly, referring to the upgrade documentation and the new tool specification.
  • Please update any existing scripts or configuration files to use the new parameter names and output file naming rules.

Ⅲ. Does this pull request fix one issue?

fixes #XXXX

Ⅳ. List the added test cases (unit test/integration test) if any, please explain if no tests are needed.

Ⅴ. Describe how to verify it

VI. Special notes for reviews

Checklist

  • Format your code make fmt.
  • Add unit tests or integration tests.
  • Update the documentation related to the change.

@diw-zw diw-zw marked this pull request as ready for review March 20, 2026 09:07
@gemini-code-assist
Copy link
Copy Markdown

Summary of Changes

Hello, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed!

This pull request updates the CLI tool to ensure full compatibility with aiconfigurator version 0.7.0. The changes primarily involve refactoring command-line argument parsing, adjusting output file naming conventions, and streamlining model identification. This update simplifies the user experience by consolidating model specification and aligns the tool with the latest aiconfigurator interface, improving consistency and maintainability.

Highlights

  • Parameter Naming Convention: All underscores (_) in parameter names have been replaced with hyphens (-) to align with the new aiconfigurator 0.7.0 guidelines.
  • Generated File Naming: The output file name format now includes {system}_{backend} in addition to the model base name and other parameters.
  • Enhanced --model Argument: The --model parameter now supports both local model paths and Hugging Face model IDs, consolidating model specification.
  • Removed hf_id Argument: The hf_id argument is no longer supported, with all model selection handled by the --model parameter.

🧠 New Feature in Public Preview: You can now enable Memory to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console.

Using Gemini Code Assist

The full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips.

Invoking Gemini

You can request assistance from Gemini at any point by creating a comment using either /gemini <command> or @gemini-code-assist <command>. Below is a summary of the supported commands on the current page.

Feature Command Description
Code Review /gemini review Performs a code review for the current pull request in its current state.
Pull Request Summary /gemini summary Provides a summary of the current pull request in its current state.
Comment @gemini-code-assist Responds in comments when explicitly tagged, both in pull request comments and review comments.
Help /gemini help Displays a list of available commands.

Customization

To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a .gemini/ folder in the base of the repository. Detailed instructions can be found here.

Limitations & Feedback

Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for GitHub and other Google products, sign up here.

Footnotes

  1. Review the Privacy Notices, Generative AI Prohibited Use Policy, Terms of Service, and learn how to configure Gemini Code Assist in GitHub here. Gemini can make mistakes, so double check it and use code with caution.

Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the aiconfigurator dependency to version 0.7.0 and adapts the CLI tool to its new interface. The changes include updating command-line arguments, removing the deprecated --hf-id flag, and modifying how model paths and output directories are handled. The changes are well-aligned with the description. My review focuses on improving the new path parsing logic. I've identified duplicated code for path normalization and suggest refactoring it into a shared helper function, while also simplifying the implementation by using the standard path package. This will improve code maintainability.

Comment thread cmd/cli/cmd/llm/generate/generate.go Outdated
Comment thread cmd/cli/cmd/llm/generate/renderer.go
Copy link
Copy Markdown

@gemini-code-assist gemini-code-assist Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code Review

This pull request updates the aiconfigurator dependency and adapts the code to its new API. The changes include updating command-line argument formats, handling new model name conventions (including Hugging Face IDs), and parsing updated configuration file structures. My review focuses on improving code maintainability. I've identified duplicated code for path resolution logic and suggested a refactoring to use the standard Go path package. This will make the code more concise, idiomatic, and easier to maintain.

Comment thread cmd/cli/cmd/llm/generate/renderer.go
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the kubectl-rbg llm generate CLI integration to align with aiconfigurator v0.7.0, including updated CLI flag naming and changes to how generated outputs are discovered and parsed.

Changes:

  • Switch aiconfigurator CLI arguments from underscore style to hyphen style (e.g., --total-gpus, --save-dir, --database-mode).
  • Remove the dedicated Hugging Face ID flag/field and derive model base naming from --model.
  • Update output directory matching and generator config parsing to reflect the new aiconfigurator output conventions (including a new DynConfig section).

Reviewed changes

Copilot reviewed 6 out of 6 changed files in this pull request and generated 6 comments.

Show a summary per file
File Description
cmd/cli/cmd/llm/generate/types.go Removes HuggingFaceID, reshapes GeneratorConfig (adds DynConfig, changes YAML tags).
cmd/cli/cmd/llm/generate/renderer.go Stops using hf-id for model path derivation and derives model mount path from --model.
cmd/cli/cmd/llm/generate/parser.go Updates output directory prefix pattern and validates mode via DynConfig.
cmd/cli/cmd/llm/generate/generate.go Updates example, introduces GetModelBaseName, and changes normalization behavior for model names.
cmd/cli/cmd/llm/generate/executor.go Updates aiconfigurator CLI args to hyphenated flag names and removes --hf_id.
cmd/cli/cmd/llm/generate/dependency.go Raises the minimum required aiconfigurator version to 0.7.0.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread cmd/cli/cmd/llm/generate/renderer.go
Comment thread cmd/cli/cmd/llm/generate/renderer.go
Comment thread cmd/cli/cmd/llm/generate/generate.go
Comment thread cmd/cli/cmd/llm/generate/generate.go Outdated
Comment thread cmd/cli/cmd/llm/generate/types.go
Comment thread cmd/cli/cmd/llm/generate/parser.go Outdated
Comment thread cmd/cli/cmd/llm/generate/renderer.go
Comment thread cmd/cli/cmd/llm/generate/types.go
Copy link
Copy Markdown
Collaborator

@cheyang cheyang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/approve

@cheyang cheyang merged commit bffec7d into sgl-project:main Mar 24, 2026
9 checks passed
@diw-zw diw-zw deleted the llm-generate branch April 30, 2026 08:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants