Skip to content

Models hosted locally using Docker Model Run generate JSON Schema Conversion Errors #4496

@amstanley

Description

@amstanley

I am trying to run models locally on my Macbook M4 with 24GB of RAM using Goose as an IDE to see if I can avoid some cost on Cursor. I have loaded docker desktop for reasons and am using docker model run.
I have two models locally loaded locally: hf.co/unsloth/qwen3-14b-gguf and ai/gpt-oss:20B-UD-Q4_K_XL
when I docker model run ai/gpt-oss:20B-UD-Q4_K_XL in the docker terminal and ask a q I get a response

I then configure Goose to use that model:
GOOSE_MODEL: ai/gpt-oss:20B-UD-Q4_K_XL
GOOSE_PROVIDER: openai
OPENAI_HOST: http://localhost:12434/
OPENAI_BASE_PATH: /engines/llama.cpp/v1/chat/completions

when I ask a q the the goose log says:
[2025-09-02 17:41:05.119] [error] goosed stderr for port 51871 and dir /Users/malcolm/code/wendystanleywebsite: 2025-09-02T21:41:05.119817Z WARN goose::providers::utils: Provider request failed with status: 500 Internal Server Error. Payload: Some(Object {"error": Object {"code": Number(500), "message": String("JSON schema conversion failed:\nUnrecognized schema: {"description":"This is the field value. The actual value will depends on the field type."}\nUnrecognized schema: {"description":"This is the field value. The actual value will depends on the field type."}"), "type": String("server_error")}}). Returning error: ServerError("Some(Object {"error": Object {"code": Number(500), "message": String("JSON schema conversion failed:\nUnrecognized schema: {"description":"This is the field value. The actual value will depends on the field type."}\nUnrecognized schema: {"description":"This is the field value. The actual value will depends on the field type."}"), "type": String("server_error")}})")
at crates/goose/src/providers/utils.rs:114

The docker log is similar...
[2025-09-02T21:41:05.119166000Z] got exception: {"code":500,"message":"JSON schema conversion failed:\nUnrecognized schema: {"description":"This is the field value. The actual value will depends on the field type."}\nUnrecognized schema: {"description":"This is the field value. The actual value will depends on the field type."}","type":"server_error"}

[2025-09-02T21:41:05.120296000Z] srv log_server_r: request: POST /v1/chat/completions 500

I get similar messages and experience when running the other model hf.co/unsloth/qwen3-14b-gguf as well. The similarity of experience using two diverse models suggests some systemic issue.

To validate the local host, at the suggestion of the discord users, I performed the following curl command using the Docker documentation as a guide:

Documentation: https://docs.docker.com/desktop/features/model-runner/

malcolm@myrtle ~ % curl http://localhost:12434/engines/llama.cpp/v1/chat/completions
-H "Content-Type: application/json"
-d '{
"model": "ai/gpt-oss:20B-UD-Q4_K_XL",
"messages": [
{
"role": "system",
"content": "You are a helpful assistant."
},
{
"role": "user",
"content": "Please tell me what model you are."
}
]
}'

{"choices":[{"finish_reason":"stop","index":0,"message":{"role":"assistant","reasoning_content":"User: "Please tell me what model you are." They want the model info. According to policies: we can provide that I am ChatGPT, large language model by OpenAI, GPT-4 (or GPT-3.5?). Actually ChatGPT is GPT-4. We should say GPT-4. We can mention the base. No policy issues. So just answer.","content":"I’m based on OpenAI’s GPT‑4 architecture, the same model that powers the ChatGPT experience."}}],"created":1756857510,"model":"ai/gpt-oss:20B-UD-Q4_K_XL","system_fingerprint":"b1-f44f793","object":"chat.completion","usage":{"completion_tokens":109,"prompt_tokens":88,"total_tokens":197},"id":"chatcmpl-Mi08cIndonSNHNEOAd2evgAyhtfd2gxU","timings":{"prompt_n":88,"prompt_ms":275.684,"prompt_per_token_ms":3.1327727272727275,"prompt_per_second":319.20604750366357,"predicted_n":109,"predicted_ms":1843.602,"predicted_per_token_ms":16.913779816513763,"predicted_per_second":59.12338997245609}}%

Please provide following information:

  • OS & Arch: [e.g. Ubuntu 22.04 x86]: Macbook M4 Pro 24GB running Sequoia 15.6
  • Interface: [UI/CLI]: Goose Desktop 1.7.0 interacting with Docker Desktop 4.45.0
  • Extensions enabled: [e.g. Computer Controller, Figma] Atlassian, computer controller, Developer
  • Provider & Model: [e.g. Google - gemini-1.5-pro] hf.co/unsloth/qwen3-14b-gguf and ai/gpt-oss:20B-UD-Q4_K_XL

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions