feat: support gemini openai api by SkyeYoung · Pull Request #12883 · apache/apisix

SkyeYoung · 2026-01-09T11:16:20Z

Description

Refer to the changes in #12565 to add support for gemini

also check gemini openai doc: https://ai.google.dev/gemini-api/docs/openai

Already tested in real world:

# config.yaml
deployment:
  role: data_plane
  role_data_plane:
    config_provider: yaml

routes:
  - id: 1
    uri: /hello
    plugins:
      ai-proxy:
        provider: gemini
        auth:
          header:
            Authorization: "Bearer xxx"
        options:
          model: gemini-2.0-flash
#END

ubuntu-20:~/apisix$ curl -X POST http://localhost:9080/anything   -H "Content-Type: application/json"   -d '{"messages": [{"role": "user", "content": "Hello"}]}'
data: {"choices":[{"delta":{"content":"Hello! How can I help you today?","role":"assistant"},"finish_reason":"stop","index":0}],"created":1767957025,"id":"IeJgacrFI4OfqtsPuaDzuQ8","model":"gemini-2.5-flash","object":"chat.completion.chunk"}

data: [DONE]

Which issue(s) this PR fixes:

Fixes #

Checklist

I have explained the need for this PR and the problem it solves
I have explained the changes or the new features added to this PR
I have added tests corresponding to this change
I have updated the documentation to reflect this change
I have verified that this change is backward compatible (If not, please discuss on the APISIX mailing list first)

Copilot

Pull request overview

This PR adds support for Google's Gemini OpenAI-compatible API to APISIX's AI proxy plugins. It follows the same implementation pattern as the recently added Azure OpenAI and AIMLAPI support.

Changes:

Added a new driver for gemini-openai provider that uses Google's OpenAI-compatible endpoint
Updated all plugin schemas to include gemini-openai in the provider enum lists
Added comprehensive test coverage with a new test file
Updated documentation in both English and Chinese to reflect the new provider option

Reviewed changes

Copilot reviewed 11 out of 11 changed files in this pull request and generated 4 comments.

Show a summary per file

File	Description
`apisix/plugins/ai-drivers/gemini-openai.lua`	New driver implementation for Gemini's OpenAI-compatible API endpoint
`apisix/plugins/ai-drivers/schema.lua`	Added `gemini-openai` to provider schemas and compatibility checker
`apisix/plugins/ai-proxy/schema.lua`	Added `gemini-openai` to provider enums for both single and multi-instance schemas
`apisix/plugins/ai-request-rewrite.lua`	Added `gemini-openai` to provider enum list
`docs/en/latest/plugins/ai-proxy.md`	Added documentation for `gemini-openai` provider with endpoint details
`docs/en/latest/plugins/ai-proxy-multi.md`	Added documentation for `gemini-openai` provider with endpoint details
`docs/en/latest/plugins/ai-request-rewrite.md`	Added `gemini-openai` to provider options list
`docs/zh/latest/plugins/ai-proxy.md`	Chinese documentation update for `gemini-openai` provider
`docs/zh/latest/plugins/ai-proxy-multi.md`	Chinese documentation update for `gemini-openai` provider
`docs/zh/latest/plugins/ai-request-rewrite.md`	Chinese documentation update for `gemini-openai` provider
`t/plugin/ai-proxy-gemini-openai.t`	New test file with comprehensive test coverage for the gemini-openai provider

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2026-01-11T08:03:09Z

+print "Hello, World!\n";
+print $resp;
+
+


Debug print statements should be removed before merging. These lines appear to be left over from development and testing.

Suggested change

print "Hello, World!\n";

print $resp;

Copilot · 2026-01-11T08:03:09Z

+                                        "stream": true
+                                    },
+                                    "override": {
+                                        "endpoint": "http://localhost:7737/v1/chat/completions"


The endpoint configuration in TEST 3 uses port 7737 which differs from port 6724 used elsewhere in the test file. However, the mock server is only configured to listen on port 6724 (line 52). This will cause TEST 4 to fail as it tries to connect to a non-existent server on port 7737.

Suggested change

"endpoint": "http://localhost:7737/v1/chat/completions"

"endpoint": "http://localhost:6724/v1/chat/completions"

Copilot · 2026-01-11T08:03:09Z

 | ------------------------- | ------------ | -------- | ------------------------------------------------------------------------------------ |
 | prompt                    | Yes          | String   | The prompt send to LLM service.                                                      |
-| provider                  | Yes          | String   | Name of the LLM service. Available options: openai, deekseek, azure-openai, aimlapi and openai-compatible. When `aimlapi` is selected, the plugin uses the OpenAI-compatible driver with a default endpoint of `https://api.aimlapi.com/v1/chat/completions`.   |
+| provider                  | Yes          | String   | Name of the LLM service. Available options: openai, deekseek, azure-openai, aimlapi, gemini-openai, and openai-compatible. When `aimlapi` is selected, the plugin uses the OpenAI-compatible driver with a default endpoint of `https://api.aimlapi.com/v1/chat/completions`.   |


Spelling error: "deekseek" should be "deepseek" to match the correct provider name used throughout the codebase.

Copilot · 2026-01-11T08:03:10Z

 | ------------------------- | ------------ | -------- | ------------------------------------------------------------------------------------ |
 | prompt                    | 是          | String   | 发送到 LLM 服务的提示。                                                      |
-| provider                  | 是          | String   | LLM 服务的名称。可用选项：openai、deekseek、azure-openai、aimlapi 和 openai-compatible。当选择 `aimlapi` 时，插件使用 OpenAI 兼容驱动程序，默认端点为 `https://api.aimlapi.com/v1/chat/completions`。   |
+| provider                  | 是          | String   | LLM 服务的名称。可用选项：openai、deekseek、azure-openai、aimlapi、gemini-openai 和 openai-compatible。当选择 `aimlapi` 时，插件使用 OpenAI 兼容驱动程序，默认端点为 `https://api.aimlapi.com/v1/chat/completions`。   |


Spelling error: "deekseek" should be "deepseek" to match the correct provider name used throughout the codebase.

…t-gemini-openai

* feat: support gemini openai api * chore: add missing changes * chore * docs: update * fix

feat: support gemini openai api

359ff98

dosubot Bot added size:L This PR changes 100-499 lines, ignoring generated files. enhancement New feature or request labels Jan 9, 2026

chore: add missing changes

7f01e6c

moonming requested a review from Copilot January 11, 2026 07:57

Copilot started reviewing on behalf of moonming January 11, 2026 07:58 View session

Copilot AI reviewed Jan 11, 2026

View reviewed changes

SkyeYoung requested review from bzp2010, membphis and moonming January 12, 2026 01:25

SkyeYoung marked this pull request as draft January 12, 2026 06:09

SkyeYoung added 3 commits January 22, 2026 02:35

Merge remote-tracking branch 'upstream/master' into young/feat/suppor…

9a6c001

…t-gemini-openai

chore

1581408

docs: update

c2a1556

SkyeYoung marked this pull request as ready for review January 22, 2026 03:31

fix

437566e

SkyeYoung requested a review from nic-6443 January 22, 2026 03:32

membphis approved these changes Jan 22, 2026

View reviewed changes

AlinsRan approved these changes Jan 23, 2026

View reviewed changes

bzp2010 approved these changes Jan 23, 2026

View reviewed changes

SkyeYoung merged commit 03278a3 into apache:master Jan 23, 2026
26 checks passed

SkyeYoung deleted the young/feat/support-gemini-openai branch January 23, 2026 09:27

wistefan pushed a commit to wistefan/apisix that referenced this pull request Jun 16, 2026

feat: support gemini openai api (apache#12883)

d05e2f6

* feat: support gemini openai api * chore: add missing changes * chore * docs: update * fix

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

feat: support gemini openai api#12883

feat: support gemini openai api#12883
SkyeYoung merged 6 commits into
apache:masterfrom
SkyeYoung:young/feat/support-gemini-openai

SkyeYoung commented Jan 9, 2026 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Copilot AI Jan 11, 2026

Uh oh!

Copilot AI Jan 11, 2026

Uh oh!

Copilot AI Jan 11, 2026

Uh oh!

Copilot AI Jan 11, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

	"endpoint": "http://localhost:7737/v1/chat/completions"
	"endpoint": "http://localhost:6724/v1/chat/completions"

Uh oh!

Conversation

SkyeYoung commented Jan 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Which issue(s) this PR fixes:

Checklist

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Jan 11, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 11, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 11, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 11, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

SkyeYoung commented Jan 9, 2026 •

edited

Loading