Skip to content

api: changes LLM prefix -> AI*#76

Merged
mathetake merged 9 commits intomainfrom
removellmprefix
Jan 16, 2025
Merged

api: changes LLM prefix -> AI*#76
mathetake merged 9 commits intomainfrom
removellmprefix

Conversation

@mathetake
Copy link
Copy Markdown
Member

This comes up in a thread in #71 with @yuzisun, and we might
want to remove the LLM prefix.

The rationale is that the current functionality is nothing to do
with "LLM" but more about the general routing and authn/z
with "AI providers" where the input is OpenAI format.

On the other hand, there "will be" the LLM specific CRD such
as the configurations for prompt guard, semantics caching etc.

I would like to have inputs from the community members!

cc @envoyproxy/ai-gateway-assignable

Signed-off-by: Takeshi Yoneda <[email protected]>
@mathetake
Copy link
Copy Markdown
Member Author

Applied the change according to the discussion so far:

  • AIRoute -> AIGatewayRoute
  • AIBackend -> AIServiceBackend

anything else?

@mathetake mathetake changed the title discussion[api]: changes LLM prefix -> AI discussion[api]: changes LLM prefix -> AI* Jan 13, 2025
@mathetake
Copy link
Copy Markdown
Member Author

mathetake commented Jan 14, 2025

PING ALL - this is blocking others

@Krishanx92
Copy link
Copy Markdown
Contributor

LGTM

@mathetake
Copy link
Copy Markdown
Member Author

others thoughts? if not, I will polish this PR as a proper one not just for discussion

Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
@mathetake
Copy link
Copy Markdown
Member Author

ok i will work on it

@mathetake mathetake marked this pull request as draft January 16, 2025 01:37
Signed-off-by: Takeshi Yoneda <[email protected]>
@mathetake mathetake changed the title discussion[api]: changes LLM prefix -> AI* api: changes LLM prefix -> AI* Jan 16, 2025
@mathetake mathetake requested a review from yuzisun January 16, 2025 01:41
@mathetake mathetake marked this pull request as ready for review January 16, 2025 01:41
@mathetake mathetake requested a review from a team as a code owner January 16, 2025 01:41
@mathetake
Copy link
Copy Markdown
Member Author

@yuzisun can you take a look?

Signed-off-by: Takeshi Yoneda <[email protected]>
Signed-off-by: Takeshi Yoneda <[email protected]>
@mathetake mathetake merged commit 874937c into main Jan 16, 2025
@mathetake mathetake deleted the removellmprefix branch January 16, 2025 01:57
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants