Skip to content

feat(ai-proxy): add new ctx variable for request llm model#12554

Merged
Baoyuantop merged 6 commits into
apache:masterfrom
Revolyssup:revolyssup/request-model
Sep 2, 2025
Merged

feat(ai-proxy): add new ctx variable for request llm model#12554
Baoyuantop merged 6 commits into
apache:masterfrom
Revolyssup:revolyssup/request-model

Conversation

@Revolyssup

@Revolyssup Revolyssup commented Aug 28, 2025

Copy link
Copy Markdown
Contributor

Description

User needs to record the LLM model of client requests that are not modified by the gateway when logging AI proxy requests, so add a new context variable to record it.

Checklist

  • I have explained the need for this PR and the problem it solves
  • I have explained the changes or the new features added to this PR
  • I have added tests corresponding to this change
  • I have updated the documentation to reflect this change
  • I have verified that this change is backward compatible (If not, please discuss on the APISIX mailing list first)

@dosubot dosubot Bot added size:M This PR changes 30-99 lines, ignoring generated files. enhancement New feature or request labels Aug 28, 2025
@dosubot dosubot Bot added size:L This PR changes 100-499 lines, ignoring generated files. and removed size:M This PR changes 30-99 lines, ignoring generated files. labels Aug 31, 2025
@Baoyuantop
Baoyuantop merged commit abd398c into apache:master Sep 2, 2025
53 of 59 checks passed
@Revolyssup
Revolyssup deleted the revolyssup/request-model branch September 2, 2025 04:59
jizhuozhi pushed a commit to jizhuozhi/apisix that referenced this pull request Oct 18, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement New feature or request size:L This PR changes 100-499 lines, ignoring generated files.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants