feat: support anthropic openai api by SkyeYoung · Pull Request #12881 · apache/apisix

SkyeYoung · 2026-01-09T09:58:31Z

Description

Refer to the changes in #12565 to add support for anthropic

Already tested in real world:

ubuntu-20:~/apisix$ curl -X POST http://localhost:9080/anything   -H "Content-Type: application/json"   -d '{"messages": [{"role": "user", "content": "Hello"}]}'
data: {"id":"msg_01Nsk7mHmmCAxsEpWwp2t2db","choices":[{"index":0,"delta":{"role":"assistant"}}],"created":1767952346,"model":"claude-sonnet-4-5-20250929","object":"chat.completion.chunk"        }

data: {"id":"msg_01Nsk7mHmmCAxsEpWwp2t2db","choices":[{"index":0,"delta":{"content":"Hello! How can I help you today"}}],"created":1767952346,"model":"claude-sonnet-4-5-20250929","object":"chat.completion.chunk"  }

data: {"id":"msg_01Nsk7mHmmCAxsEpWwp2t2db","choices":[{"index":0,"delta":{"content":"?"}}],"created":1767952346,"model":"claude-sonnet-4-5-20250929","object":"chat.completion.chunk"        }

data: {"id":"msg_01Nsk7mHmmCAxsEpWwp2t2db","choices":[{"index":0,"delta":{},"finish_reason":"stop"}],"created":1767952346,"model":"claude-sonnet-4-5-20250929","object":"chat.completion.chunk"      }

data: [DONE]

Which issue(s) this PR fixes:

Fixes #

Checklist

I have explained the need for this PR and the problem it solves
I have explained the changes or the new features added to this PR
I have added tests corresponding to this change
I have updated the documentation to reflect this change
I have verified that this change is backward compatible (If not, please discuss on the APISIX mailing list first)

…nai' into young/feat/support-anthropic-openai

Copilot

Pull request overview

This PR adds support for Anthropic's OpenAI-compatible API to the APISIX AI plugins. The implementation follows the pattern of other OpenAI-compatible providers by creating a new driver that uses the openai-base implementation.

Changes:

Added new anthropic-openai driver for Anthropic API integration
Updated plugin schemas to include anthropic-openai as a valid provider
Added comprehensive test coverage for the new provider
Updated English and Chinese documentation across multiple plugins

Reviewed changes

Copilot reviewed 11 out of 11 changed files in this pull request and generated 8 comments.

Show a summary per file

File	Description
apisix/plugins/ai-drivers/anthropic-openai.lua	New driver file for Anthropic OpenAI API using openai-base with proper host and path configuration
apisix/plugins/ai-drivers/schema.lua	Added anthropic-openai to chat_request_schema and is_openai_compatible_provider function
apisix/plugins/ai-proxy/schema.lua	Added anthropic-openai to provider enum in both instance and proxy schemas
apisix/plugins/ai-request-rewrite.lua	Added anthropic-openai to provider enum
t/plugin/ai-proxy-anthropic-openai.t	New test file with coverage for authentication, streaming, and basic request handling
docs/en/latest/plugins/ai-proxy.md	Updated to mention Anthropic support in description and provider list
docs/en/latest/plugins/ai-proxy-multi.md	Updated to mention Anthropic support in description and provider list
docs/en/latest/plugins/ai-request-rewrite.md	Updated to include anthropic-openai in provider options
docs/zh/latest/plugins/ai-proxy.md	Chinese version of ai-proxy documentation updates
docs/zh/latest/plugins/ai-proxy-multi.md	Chinese version of ai-proxy-multi documentation updates
docs/zh/latest/plugins/ai-request-rewrite.md	Chinese version of ai-request-rewrite documentation updates

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Copilot · 2026-01-11T08:03:58Z

 | ------------------------- | ------------ | -------- | ------------------------------------------------------------------------------------ |
 | prompt                    | Yes          | String   | The prompt send to LLM service.                                                      |
-| provider                  | Yes          | String   | Name of the LLM service. Available options: openai, deekseek, azure-openai, aimlapi and openai-compatible. When `aimlapi` is selected, the plugin uses the OpenAI-compatible driver with a default endpoint of `https://api.aimlapi.com/v1/chat/completions`.   |
+| provider                  | Yes          | String   | Name of the LLM service. Available options: openai, deekseek, azure-openai, aimlapi, anthropic-openai, openai-compatible. When `aimlapi` is selected, the plugin uses the OpenAI-compatible driver with a default endpoint of `https://api.aimlapi.com/v1/chat/completions`. When `anthropic-openai` is selected, the plugin uses the OpenAI-compatible driver with a default endpoint of `https://api.anthropic.com/v1/chat/completions`.   |


The provider name is misspelled as "deekseek" but should be "deepseek" to match the actual provider enum value.

Copilot · 2026-01-11T08:03:59Z

 | ------------------------- | ------------ | -------- | ------------------------------------------------------------------------------------ |
 | prompt                    | 是          | String   | 发送到 LLM 服务的提示。                                                      |
-| provider                  | 是          | String   | LLM 服务的名称。可用选项：openai、deekseek、azure-openai、aimlapi 和 openai-compatible。当选择 `aimlapi` 时，插件使用 OpenAI 兼容驱动程序，默认端点为 `https://api.aimlapi.com/v1/chat/completions`。   |
+| provider                  | 是          | String   | LLM 服务的名称。可用选项：openai、deekseek、azure-openai、aimlapi、anthropic-openai 和 openai-compatible。当选择 `aimlapi` 时，插件使用 OpenAI 兼容驱动程序，默认端点为 `https://api.aimlapi.com/v1/chat/completions`。   |


The provider name is misspelled as "deekseek" but should be "deepseek" to match the actual provider enum value.

Copilot · 2026-01-11T08:03:59Z

+print "Hello, World!\n";
+print $resp;
+
+


Debug print statements should be removed from test files before merging. These print statements appear to be left over from development/debugging.

Suggested change

print "Hello, World!\n";

print $resp;

Copilot · 2026-01-11T08:03:59Z

 | instances                          | array[object]  | True     |                                   |              | LLM instance configurations. |
 | instances.name                     | string         | True     |                                   |              | Name of the LLM service instance. |
-| instances.provider                 | string         | True     |                                   | [openai, deepseek, azure-openai, aimlapi, openai-compatible] | LLM service provider. When set to `openai`, the Plugin will proxy the request to `api.openai.com`. When set to `deepseek`, the Plugin will proxy the request to `api.deepseek.com`. When set to `aimlapi`, the Plugin uses the OpenAI-compatible driver and proxies the request to `api.aimlapi.com` by default. When set to `openai-compatible`, the Plugin will proxy the request to the custom endpoint configured in `override`. |
+| instances.provider                 | string         | True     |                                   | [openai, deepseek, azure-openai, aimlapi, openrouter, openai-compatible, anthropic-openai] | LLM service provider. When set to `openai`, the Plugin will proxy the request to `api.openai.com`. When set to `deepseek`, the Plugin will proxy the request to `api.deepseek.com`. When set to `aimlapi`, the Plugin uses the OpenAI-compatible driver and proxies the request to `api.aimlapi.com` by default. When set to `openrouter`, the Plugin uses the OpenAI-compatible driver and proxies the request to `openrouter.ai` by default. When set to `anthropic-openai`, the Plugin will proxy the request to `api.anthropic.com` by default. When set to `openai-compatible`, the Plugin will proxy the request to the custom endpoint configured in `override`. |


Documentation mentions "openrouter" as a supported provider, but this is inconsistent with the actual implementation. The PR only adds support for "anthropic-openai", not "openrouter". Either the "openrouter" provider support needs to be implemented with corresponding schema updates and driver file, or it should be removed from the documentation.

Copilot · 2026-01-11T08:04:00Z

 | instances                          | array[object]  | 是     |                                   |              | LLM 实例配置。 |
 | instances.name                     | string         | 是     |                                   |              | LLM 服务实例的名称。 |
-| instances.provider                 | string         | 是     |                                   | [openai, deepseek, azure-openai, aimlapi, openai-compatible] | LLM 服务提供商。设置为 `openai` 时，插件将代理请求到 `api.openai.com`。设置为 `deepseek` 时，插件将代理请求到 `api.deepseek.com`。设置为 `aimlapi` 时，插件使用 OpenAI 兼容驱动程序，默认将请求代理到 `api.aimlapi.com`。设置为 `openai-compatible` 时，插件将代理请求到在 `override` 中配置的自定义端点。 |
+| instances.provider                 | string         | 是     |                                   | [openai, deepseek, azure-openai, aimlapi, openrouter, openai-compatible, anthropic-openai] | LLM 服务提供商。设置为 `openai` 时，插件将代理请求到 `api.openai.com`。设置为 `deepseek` 时，插件将代理请求到 `api.deepseek.com`。设置为 `aimlapi` 时，插件使用 OpenAI 兼容驱动程序，默认将请求代理到 `api.aimlapi.com`。设置为 `openrouter` 时，插件使用 OpenAI 兼容驱动程序，默认将请求代理到 `openrouter.ai`。设置为 `anthropic-openai` 时，插件使用 OpenAI 兼容驱动程序，默认将请求代理到 `api.anthropic.com`。设置为 `openai-compatible` 时，插件将代理请求到在 `override` 中配置的自定义端点。 |


Documentation mentions "openrouter" as a supported provider, but this is inconsistent with the actual implementation. The PR only adds support for "anthropic-openai", not "openrouter". Either the "openrouter" provider support needs to be implemented with corresponding schema updates and driver file, or it should be removed from the documentation.

Copilot · 2026-01-11T08:04:00Z

+                                        "stream": true
+                                    },
+                                    "override": {
+                                        "endpoint": "http://localhost:7737/v1/chat/completions"


The endpoint in TEST 3 uses port 7737, but the mock server is configured to listen on port 6725 (line 53). This will cause TEST 4 to fail because it tries to send requests to the endpoint configured in TEST 3. The endpoint should be changed to "http://localhost:6725/v1/chat/completions" to match the mock server configuration.

Suggested change

"endpoint": "http://localhost:7737/v1/chat/completions"

"endpoint": "http://localhost:6725/v1/chat/completions"

moonming

I have several concerns that need to be addressed:

API Endpoint Compatibility (Critical)

According to Anthropic’s official documentation, their native API uses /v1/messages, not /v1/chat/completions. Could you please clarify:

•	Does Anthropic officially support the `/v1/chat/completions` endpoint on `api.anthropic.com`?
•	Can you share the complete test logs showing actual requests/responses to this endpoint?

If this endpoint isn’t officially supported, we may need to implement a native driver for the /v1/messages API instead.

Testing Approach

The current tests use mocked responses, which only validates our routing logic but doesn’t verify actual compatibility with Anthropic’s API. Please add integration tests with real API calls to ensure the request/response format conversion works correctly.

Naming Convention

The provider name anthropic-openai is confusing. We should use simply anthropic to match the pattern of other providers (openai, deepseek, etc.). The -openai suffix suggests this is a variant or compatibility layer, which may mislead users.

Documentation Consistency

The docs mention both “OpenRouter” and “Anthropic” - please ensure consistency across all documentation files.

Looking forward to your clarification!

SkyeYoung · 2026-01-11T15:56:35Z

@moonming

pls check https://platform.claude.com/docs/en/api/openai-sdk. Just like Azure has its own API but also provides OpenAI compatible API, anthropic also provides a similar compatibility layer.
The reason is the same as above. Currently apisix does not use azure’s own api, but azure compatible API(so it's azure-ai but not azure). I think it can be consistent with the current azure-openai at this point. The testing part also completely refers to the existing practices of the project. If you need to use real API requests, please add the relevant API KEY secret in the project so that I can test it.
This seems to be an issue caused by me adjusting the document locally, I will adjust that.

… into young/feat/support-anthropic-openai

SkyeYoung · 2026-01-12T09:51:34Z

waiting merge of #12878

…t-anthropic-openai

bzp2010 · 2026-01-13T04:08:12Z

@moonming @membphis

Has this naming been confirmed? Do we need to add an explicit suffix hint for "using compatible API"? This seems inconsistent with our expectations. This holds true even if you intend to express a "vendor-product branch."

I believe that regardless of the AI we use internally, whether it's in compatibility mode or not has no impact on users. Since all APIs are now exposed in OpenAI format, users don't need to know the format used upstream—they just need the functionality to work.

Therefore, anthropic suffices as this provider value.

My initial idea came from the naming of azure-openai, which has already been expressed above #12881 (comment). The advantage of doing this is to leave room for the Anthropic API.

But it seems you already have different ideas.

agree to use anthropic as provider name

bzp2010

Temporarily block the merge until the provider name is confirmed.

SkyeYoung added 7 commits January 9, 2026 06:10

feat: add support for openrouter

4436603

fix: test logic

8442d0e

chore: align

2cd5c0c

chore: update zh docs

46b4044

feat: support anthropic openai api

bbdc0f0

chore: add rest part

d6fbf30

chore: update rest part

94a88c3

SkyeYoung marked this pull request as ready for review January 9, 2026 10:43

dosubot Bot added size:L This PR changes 100-499 lines, ignoring generated files. enhancement New feature or request labels Jan 9, 2026

SkyeYoung requested review from bzp2010, kayx23 and moonming January 9, 2026 10:43

SkyeYoung added 3 commits January 9, 2026 18:48

Delete apisix/plugins/ai-drivers/openrouter.lua

682bc08

fix

8360e72

Merge remote-tracking branch 'origin/young/feat/support-anthropic-ope…

546dc55

…nai' into young/feat/support-anthropic-openai

moonming requested review from Copilot and removed request for bzp2010, kayx23 and moonming January 11, 2026 07:57

Copilot started reviewing on behalf of moonming January 11, 2026 07:57 View session

Copilot AI reviewed Jan 11, 2026

View reviewed changes

moonming requested changes Jan 11, 2026

View reviewed changes

SkyeYoung requested a review from moonming January 12, 2026 01:05

fix: docs

b0efa44

SkyeYoung requested review from bzp2010 and membphis January 12, 2026 01:26

SkyeYoung added 2 commits January 12, 2026 06:33

fix: solve @membphis comments

1960e9c

chore: rm useless

5fd91c0

SkyeYoung added 5 commits January 12, 2026 06:42

chore: add missing changes

05a3324

chore: solve @membphis comment

b3d426b

chore: use openai-compatible-api-response.json

5458bd7

chore: add comments

230548e

Merge remote-tracking branch 'origin/young/feat/ai-driver-openrouter'…

6ef59f3

… into young/feat/support-anthropic-openai

SkyeYoung added 3 commits January 12, 2026 12:16

Merge remote-tracking branch 'upstream/master' into young/feat/suppor…

74c273b

…t-anthropic-openai

chore

56c0d56

chore: add missing changes

cb7723b

moonming previously approved these changes Jan 13, 2026

View reviewed changes

membphis previously approved these changes Jan 13, 2026

View reviewed changes

bzp2010 approved these changes Jan 13, 2026

View reviewed changes

bzp2010 self-requested a review January 13, 2026 04:17

bzp2010 requested changes Jan 13, 2026

View reviewed changes

chore: rename to anthropic

c4b8abb

SkyeYoung dismissed stale reviews from membphis and moonming via c4b8abb January 13, 2026 06:26

SkyeYoung requested review from bzp2010, membphis and moonming January 13, 2026 08:23

membphis approved these changes Jan 13, 2026

View reviewed changes

bzp2010 approved these changes Jan 13, 2026

View reviewed changes

SkyeYoung requested a review from nic-6443 January 14, 2026 01:07

nic-6443 approved these changes Jan 14, 2026

View reviewed changes

SkyeYoung merged commit 80c587e into apache:master Jan 14, 2026
27 of 28 checks passed

SkyeYoung deleted the young/feat/support-anthropic-openai branch January 14, 2026 01:09

wistefan pushed a commit to wistefan/apisix that referenced this pull request Jun 16, 2026

feat: support anthropic openai api (apache#12881)

62de7f7

	"endpoint": "http://localhost:7737/v1/chat/completions"
	"endpoint": "http://localhost:6725/v1/chat/completions"

Uh oh!

Conversation

SkyeYoung commented Jan 9, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Which issue(s) this PR fixes:

Checklist

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull request overview

Reviewed changes

Uh oh!

Copilot AI Jan 11, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 11, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 11, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 11, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 11, 2026

Choose a reason for hiding this comment

Uh oh!

Copilot AI Jan 11, 2026

Choose a reason for hiding this comment

Uh oh!

moonming left a comment

Choose a reason for hiding this comment

Uh oh!

SkyeYoung commented Jan 11, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

SkyeYoung commented Jan 12, 2026

Uh oh!

bzp2010 Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

SkyeYoung Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

membphis Jan 13, 2026

Choose a reason for hiding this comment

Uh oh!

bzp2010 left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

SkyeYoung commented Jan 9, 2026 •

edited

Loading

SkyeYoung commented Jan 11, 2026 •

edited

Loading