Skip to content

ollama-qwen3.5:35b suspicious compatibility problem #14492

Open

Description

@Jackallink

What is the issue?

ERROR: raise ResponseError(e.response.text, e.response.status_code) from None ollama._types.ResponseError: failed to parse JSON: unexpected end of JSON input (status code: 500)
OS: Mac osx : RAM 64G
Ollama client: pypi ollama 0.6.1
0llama version: 0.17.4
model: qwen3.5:35b
Whenever I config num_ctx as 8k,16k,64k,128k or 256k, this error will reproduced. Not sure it's a ollama-qwen3.5:35b compatibility problem. When I used qwen3:30b, the problem would not reproduced.


Full Content here 👇:

Bug Report: qwen3.5 tool call parsing fails with "failed to parse JSON: unexpected end of JSON input"

Issue Description

When using the qwen3.5 model (qwen35moe) with tool calling enabled via Ollama Python library, the API returns HTTP 500 errors. The server logs show:

qwen3 tool call parsing failed error="failed to parse JSON: unexpected end of JSON input"

This error occurs intermittently but repeatedly during chat sessions that involve tool calls.

Environment

  • Ollama Version: 0.17.4
  • macOS Version: Darwin/24.6.0 (macOS Sequoia)
  • Hardware: Apple M1 Max (Metal GPU)
  • GPU Memory: 48.0 GiB available
  • Python Client: ollama Python library

Server Log Context

The following is the relevant excerpt from ~/.ollama/logs/server.log:

# Server startup and model loading
time=2026-02-27T12:46:48.855+08:00 level=INFO source=routes.go:1665 msg="Ollama cloud disabled: false"
time=2026-02-27T12:46:48.862+08:00 level=INFO source=routes.go:1718 msg="Listening on [::]:11434 (version 0.17.4)"
time=2026-02-27T12:46:49.005+08:00 level=INFO source=types.go:42 msg="inference compute" id=0 filter_id=0 library=Metal compute=0.0 name=Metal description="Apple M1 Max" libdirs="" driver=0.0 pci_id="" type=discrete total="48.0 GiB" available="48.0 GiB"

# Model loaded successfully
time=2026-02-27T12:50:20.741+08:00 level=INFO source=ggml.go:136 msg="" architecture=qwen35moe file_type=Q4_K_M name="" description="" num_tensors=1959 num_key_values=57

# Metal GPU initialization
ggml_metal_device_init: GPU name:   Apple M1 Max
ggml_metal_device_init: GPU family: MTLGPUFamilyApple7  (1007)
ggml_metal_device_init: GPU family: MTLGPUFamilyCommon3 (3003)
ggml_metal_device_init: GPU family: MTLGPUFamilyMetal3  (5001)
ggml_metal_device_init: tensor API disabled for pre-M5 and pre-A19 devices
ggml_metal_device_init: has tensor            = false

# Successful chat requests
[GIN] 2026/02/27 - 12:56:09 | 200 |         3m59s |             ::1 | POST     "/api/chat"
[GIN] 2026/02/27 - 12:56:28 | 200 | 18.148873417s |             ::1 | POST     "/api/chat"
[GIN] 2026/02/27 - 12:57:38 | 200 |          1m8s |             ::1 | POST     "/api/chat"
[GIN] 2026/02/27 - 12:57:57 | 200 | 18.438211334s |             ::1 | POST     "/api/chat"

# Tool call parsing failure
time=2026-02-27T12:59:31.677+08:00 level=WARN source=qwen3.go:108 msg="qwen3 tool call parsing failed" error="failed to parse JSON: unexpected end of JSON input"

# HTTP 500 error response
[GIN] 2026/02/27 - 12:59:31 | 500 |         1m34s |             ::1 | POST     "/api/chat"

Error Pattern

The error follows this consistent pattern:

  1. Multiple successful POST /api/chat requests (HTTP 200)
  2. Model generates a tool call
  3. qwen3 tool call parsing failed warning appears in logs
  4. Final request returns HTTP 500

Full Error from Python Client

ERROR: raise ResponseError(e.response.text, e.response.status_code) from None
ollama._types.ResponseError: failed to parse JSON: unexpected end of JSON input (status code: 500)

Additional Observations

  • Error Source: qwen3.go:108 - This is internal Ollama code for handling Qwen3 model's tool calling
  • Occurrence Frequency: This error has been observed 10+ times in the server log within a few hours of usage
  • Model: qwen3.5 (qwen35moe, Q4_K_M quantization)
  • File Type: GGUF V3 (latest)

Expected Behavior

The model should either:

  1. Successfully generate valid JSON for tool calls, OR
  2. Return a graceful error message instead of causing a 500 error

Possible Root Cause

The Qwen3.5 model appears to generate incomplete JSON output when attempting tool calls. Ollama's internal JSON parser in qwen3.go fails to parse this incomplete JSON, causing the entire request to fail with HTTP 500.

Workarounds Tried

  1. Using different model: qwen3:30b-a3b-thinking work without this issue

Request

This appears to be an issue with how Ollama handles malformed tool call output from the Qwen3.5 model. Possible solutions:

  1. Add retry logic or JSON recovery in the qwen3.go parser
  2. Better error handling to return a more informative message to the client
  3. Document this known limitation for Qwen3.5 tool calling

Logs Location: ~/.ollama/logs/server.log
App Version: 0.17.4
Date: 2026-02-27

Activity

  1. rick-github commented on Feb 27, 2026

    @rick-github
    Collaborator

    Server logs will aid in debugging.

  2. FieldMouse-AI commented on Feb 27, 2026

    @FieldMouse-AI
  3. rick-github commented on Feb 27, 2026

    @rick-github
    Collaborator

    @meidaid Wrong place to post that, see #14419. In your case, ollama does not yet support qwen35/qwen35moe models downloaded from HF.

  4. Jackallink commented on Feb 28, 2026

    @Jackallink
    Author

    Server logs will aid in debugging.

    I have added the log context and preliminary analysis diagnostics. 👉 issue #14492

  5. rick-github commented on Feb 28, 2026

    @rick-github
    Collaborator

    Full log. Example code that reproduces the problem would also be helpful.

  6. rick-github commented on Mar 12, 2026

    @rick-github
    Collaborator

    Possibly fixed in 0.17.6 via #14605. Please upgrade and test.

  7. hashelq commented on Mar 22, 2026

    @hashelq

    Possibly fixed in 0.17.6 via #14605. Please upgrade and test.

    • ~ /bin/ollama --version ollama version is 0.18.2
    • Qwen3.5:9B
    • RENDERER qwen3.5
    • PARSER qwen3.5

    I still observe broken tool calls within the thinking block.

  8. rick-github commented on Mar 22, 2026

    @rick-github
    Collaborator

    Logs and example code that reproduces the problem would be helpful.

  9. hashelq commented on Mar 22, 2026

    @hashelq

    Steps to reproduce (my case)

    • Open a project in opencode
    • Select model to ollama qwen3.5
    • Prompt "analyze this project"
    • See first tools OK
    • Next tools show broken XML inside the thinking and the bot stops answering.

    Setup:

    OLLAMA_KV_CACHE_TYPE=q4_0 OLLAMA_KEEP_ALIVE=-1 OLLAMA_MAX_LOADED_MODELS=1 OLLAMA_NUM_PARALLEL=1 OLLAMA_MAX_QUEUE=1 OLLAMA_FLASH_ATTENTION=1 OLLAMA_DEBUG=3 /usr/local/bin/ollama serve 2> log.txt

    FROM ./Qwen3.5-9B-Q8_0.gguf
    TEMPLATE {{ .Prompt }}
    RENDERER qwen3.5
    PARSER qwen3.5
    PARAMETER top_p 0.95
    PARAMETER presence_penalty 1.5
    PARAMETER temperature 1
    PARAMETER top_k 20
    PARAMETER min_p 0
    PARAMETER num_gpu 64
    PARAMETER num_ctx 262144
    

    Log:

    Details
    time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3459 id=3460
    time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3460 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3460
    time=2026-03-22T20:23:57.703Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3460
    time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3459
    time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3459
    time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3459 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.727Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=oom from=[4053]
    time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3459
    time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3460
    time=2026-03-22T20:23:57.727Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=oom
    time=2026-03-22T20:23:57.727Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:oom}] state=0 buffer=""
    time=2026-03-22T20:23:57.727Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=oom toolCalls=[] done=false
    time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3460
    time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3460 id=3461
    time=2026-03-22T20:23:57.727Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3461 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.728Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3461
    time=2026-03-22T20:23:57.728Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3461
    time=2026-03-22T20:23:57.751Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3460
    time=2026-03-22T20:23:57.751Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3460
    time=2026-03-22T20:23:57.751Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3460 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.752Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=- from=[12]
    time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3460
    time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3461
    time=2026-03-22T20:23:57.752Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-
    time=2026-03-22T20:23:57.752Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-}] state=0 buffer=""
    time=2026-03-22T20:23:57.752Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=- toolCalls=[] done=false
    time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3461
    time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3461 id=3462
    time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3462 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3462
    time=2026-03-22T20:23:57.752Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3462
    time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3461
    time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3461
    time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3461 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.776Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=are from=[532]
    time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3461
    time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3462
    time=2026-03-22T20:23:57.776Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=are
    time=2026-03-22T20:23:57.776Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:are}] state=0 buffer=""
    time=2026-03-22T20:23:57.776Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=are toolCalls=[] done=false
    time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3462
    time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3462 id=3463
    time=2026-03-22T20:23:57.776Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3463 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.777Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3463
    time=2026-03-22T20:23:57.777Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3463
    time=2026-03-22T20:23:57.800Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3462
    time=2026-03-22T20:23:57.800Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3462
    time=2026-03-22T20:23:57.800Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3462 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.801Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=-we from=[59269]
    time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3462
    time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3463
    time=2026-03-22T20:23:57.801Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-we
    time=2026-03-22T20:23:57.801Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-we}] state=0 buffer=""
    time=2026-03-22T20:23:57.801Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=-we toolCalls=[] done=false
    time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3463
    time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3463 id=3464
    time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3464 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3464
    time=2026-03-22T20:23:57.801Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3464
    time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3463
    time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3463
    time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3463 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.825Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=.ai from=[39046]
    time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3463
    time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3464
    time=2026-03-22T20:23:57.825Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=.ai
    time=2026-03-22T20:23:57.825Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:.ai}] state=0 buffer=""
    time=2026-03-22T20:23:57.825Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=.ai toolCalls=[] done=false
    time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3464
    time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3464 id=3465
    time=2026-03-22T20:23:57.825Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3465 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.826Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3465
    time=2026-03-22T20:23:57.826Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3465
    time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3464
    time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3464
    time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3464 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.849Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/index from=[8750]
    time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3464
    time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3465
    time=2026-03-22T20:23:57.849Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/index
    time=2026-03-22T20:23:57.849Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/index}] state=0 buffer=""
    time=2026-03-22T20:23:57.849Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/index toolCalls=[] done=false
    time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3465
    time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3465 id=3466
    time=2026-03-22T20:23:57.849Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3466 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.850Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3466
    time=2026-03-22T20:23:57.850Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3466
    time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3465
    time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3465
    time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3465 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.874Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=.html from=[2480]
    time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3465
    time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3466
    time=2026-03-22T20:23:57.874Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=.html
    time=2026-03-22T20:23:57.874Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:.html}] state=0 buffer=""
    time=2026-03-22T20:23:57.874Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=.html toolCalls=[] done=false
    time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3466
    time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3466 id=3467
    time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3467 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3467
    time=2026-03-22T20:23:57.874Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3467
    time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3466
    time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3466
    time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3466 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.898Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3466
    time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3467
    time=2026-03-22T20:23:57.898Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:57.898Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3467
    time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3467 id=3468
    time=2026-03-22T20:23:57.898Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3468 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.899Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3468
    time=2026-03-22T20:23:57.899Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3468
    time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3467
    time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3467
    time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3467 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.922Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510]
    time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3467
    time=2026-03-22T20:23:57.922Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3468
    time=2026-03-22T20:23:57.923Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</
    time=2026-03-22T20:23:57.923Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3468
    time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3468 id=3469
    time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3469 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3469
    time=2026-03-22T20:23:57.923Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3469
    time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3468
    time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3468
    time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3468 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.947Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704]
    time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3468
    time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3469
    time=2026-03-22T20:23:57.947Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter
    time=2026-03-22T20:23:57.947Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</parameter}]" state=0 buffer=""
    time=2026-03-22T20:23:57.947Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</parameter" toolCalls=[] done=false
    time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3469
    time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3469 id=3470
    time=2026-03-22T20:23:57.947Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3470 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.948Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3470
    time=2026-03-22T20:23:57.948Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3470
    time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3469
    time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3469
    time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3469 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.971Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
    time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3469
    time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3470
    time=2026-03-22T20:23:57.971Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
    time=2026-03-22T20:23:57.971Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
    time=2026-03-22T20:23:57.971Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
    time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3470
    time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3470 id=3471
    time=2026-03-22T20:23:57.971Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3471 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.972Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3471
    time=2026-03-22T20:23:57.972Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3471
    time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3470
    time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3470
    time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3470 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:57.996Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3470
    time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3471
    time=2026-03-22T20:23:57.996Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:57.996Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3471
    time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3471 id=3472
    time=2026-03-22T20:23:57.996Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3472 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:57.997Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3472
    time=2026-03-22T20:23:57.997Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3472
    time=2026-03-22T20:23:58.020Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3471
    time=2026-03-22T20:23:58.020Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3471
    time=2026-03-22T20:23:58.020Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3471 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.021Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510]
    time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3471
    time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3472
    time=2026-03-22T20:23:58.021Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</
    time=2026-03-22T20:23:58.021Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3472
    time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3472 id=3473
    time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3473 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3473
    time=2026-03-22T20:23:58.021Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3473
    time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3472
    time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3472
    time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3472 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.045Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=function from=[1628]
    time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3472
    time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3473
    time=2026-03-22T20:23:58.045Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=function
    time=2026-03-22T20:23:58.045Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</function}]" state=0 buffer=""
    time=2026-03-22T20:23:58.045Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</function" toolCalls=[] done=false
    time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3473
    time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3473 id=3474
    time=2026-03-22T20:23:58.045Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3474 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.046Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3474
    time=2026-03-22T20:23:58.046Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3474
    time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3473
    time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3473
    time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3473 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.069Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
    time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3473
    time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3474
    time=2026-03-22T20:23:58.069Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
    time=2026-03-22T20:23:58.069Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
    time=2026-03-22T20:23:58.069Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
    time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3474
    time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3474 id=3475
    time=2026-03-22T20:23:58.069Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3475 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.070Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3475
    time=2026-03-22T20:23:58.070Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3475
    time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3474
    time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3474
    time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3474 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.094Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3474
    time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3475
    time=2026-03-22T20:23:58.094Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:58.094Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3475
    time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3475 id=3476
    time=2026-03-22T20:23:58.094Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3476 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.095Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3476
    time=2026-03-22T20:23:58.095Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3476
    time=2026-03-22T20:23:58.118Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3475
    time=2026-03-22T20:23:58.118Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3475
    time=2026-03-22T20:23:58.118Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3475 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.119Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</tool_call> from=[248059]
    time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3475
    time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3476
    time=2026-03-22T20:23:58.119Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</tool_call>
    time=2026-03-22T20:23:58.119Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</tool_call>}]" state=0 buffer=""
    time=2026-03-22T20:23:58.119Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</tool_call>" toolCalls=[] done=false
    time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3476
    time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3476 id=3477
    time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3477 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3477
    time=2026-03-22T20:23:58.119Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3477
    time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3476
    time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3476
    time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3476 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.143Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3476
    time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3477
    time=2026-03-22T20:23:58.143Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:58.143Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3477
    time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3477 id=3478
    time=2026-03-22T20:23:58.143Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3478 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.144Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3478
    time=2026-03-22T20:23:58.144Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3478
    time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3477
    time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3477
    time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3477 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.168Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=<tool_call> from=[248058]
    time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3477
    time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3478
    time=2026-03-22T20:23:58.168Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=<tool_call>
    time=2026-03-22T20:23:58.168Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<tool_call>}]" state=0 buffer=""
    time=2026-03-22T20:23:58.168Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<tool_call>" toolCalls=[] done=false
    time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3478
    time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3478 id=3479
    time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3479 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3479
    time=2026-03-22T20:23:58.168Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3479
    time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3478
    time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3478
    time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3478 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.192Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3478
    time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3479
    time=2026-03-22T20:23:58.192Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:58.192Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3479
    time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3479 id=3480
    time=2026-03-22T20:23:58.192Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3480 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.193Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3480
    time=2026-03-22T20:23:58.193Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3480
    time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3479
    time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3479
    time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3479 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.217Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=< from=[27]
    time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3479
    time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3480
    time=2026-03-22T20:23:58.217Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=<
    time=2026-03-22T20:23:58.217Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3480
    time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3480 id=3481
    time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3481 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.217Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3481
    time=2026-03-22T20:23:58.218Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3481
    time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3480
    time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3480
    time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3480 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.241Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=function from=[1628]
    time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3480
    time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3481
    time=2026-03-22T20:23:58.241Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=function
    time=2026-03-22T20:23:58.241Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<function}]" state=0 buffer=""
    time=2026-03-22T20:23:58.241Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<function" toolCalls=[] done=false
    time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3481
    time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3481 id=3482
    time=2026-03-22T20:23:58.241Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3482 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.242Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3482
    time=2026-03-22T20:23:58.242Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3482
    time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3481
    time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3481
    time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3481 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.266Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="=b" from=[21402]
    time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3481
    time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3482
    time=2026-03-22T20:23:58.266Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="=b"
    time=2026-03-22T20:23:58.266Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:=b}]" state=0 buffer=""
    time=2026-03-22T20:23:58.266Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="=b" toolCalls=[] done=false
    time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3482
    time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3482 id=3483
    time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3483 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3483
    time=2026-03-22T20:23:58.266Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3483
    time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3482
    time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3482
    time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3482 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.290Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=ash from=[956]
    time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3482
    time=2026-03-22T20:23:58.290Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3483
    time=2026-03-22T20:23:58.291Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=ash
    time=2026-03-22T20:23:58.291Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:ash}] state=0 buffer=""
    time=2026-03-22T20:23:58.291Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=ash toolCalls=[] done=false
    time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3483
    time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3483 id=3484
    time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3484 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3484
    time=2026-03-22T20:23:58.291Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3484
    time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3483
    time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3483
    time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3483 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.315Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
    time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3483
    time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3484
    time=2026-03-22T20:23:58.315Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
    time=2026-03-22T20:23:58.315Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
    time=2026-03-22T20:23:58.315Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
    time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3484
    time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3484 id=3485
    time=2026-03-22T20:23:58.315Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3485 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.316Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3485
    time=2026-03-22T20:23:58.316Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3485
    time=2026-03-22T20:23:58.339Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3484
    time=2026-03-22T20:23:58.339Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3484
    time=2026-03-22T20:23:58.339Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3484 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.340Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3484
    time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3485
    time=2026-03-22T20:23:58.340Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:58.340Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3485
    time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3485 id=3486
    time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3486 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3486
    time=2026-03-22T20:23:58.340Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3486
    time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3485
    time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3485
    time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3485 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.364Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=< from=[27]
    time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3485
    time=2026-03-22T20:23:58.364Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=<
    time=2026-03-22T20:23:58.364Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3486
    time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3486
    time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3486 id=3487
    time=2026-03-22T20:23:58.364Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3487 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.365Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3487
    time=2026-03-22T20:23:58.365Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3487
    time=2026-03-22T20:23:58.388Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3486
    time=2026-03-22T20:23:58.388Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3486
    time=2026-03-22T20:23:58.388Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3486 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.389Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704]
    time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3486
    time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3487
    time=2026-03-22T20:23:58.389Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter
    time=2026-03-22T20:23:58.389Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<parameter}]" state=0 buffer=""
    time=2026-03-22T20:23:58.389Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<parameter" toolCalls=[] done=false
    time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3487
    time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3487 id=3488
    time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3488 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3488
    time=2026-03-22T20:23:58.389Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3488
    time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3487
    time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3487
    time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3487 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.413Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="=" from=[28]
    time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3487
    time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3488
    time=2026-03-22T20:23:58.413Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="="
    time=2026-03-22T20:23:58.413Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:=}]" state=0 buffer=""
    time=2026-03-22T20:23:58.413Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="=" toolCalls=[] done=false
    time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3488
    time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3488 id=3489
    time=2026-03-22T20:23:58.413Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3489 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.414Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3489
    time=2026-03-22T20:23:58.414Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3489
    time=2026-03-22T20:23:58.437Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3488
    time=2026-03-22T20:23:58.437Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3488
    time=2026-03-22T20:23:58.437Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3488 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.438Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=command from=[5454]
    time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3488
    time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3489
    time=2026-03-22T20:23:58.438Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=command
    time=2026-03-22T20:23:58.438Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:command}] state=0 buffer=""
    time=2026-03-22T20:23:58.438Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=command toolCalls=[] done=false
    time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3489
    time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3489 id=3490
    time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3490 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3490
    time=2026-03-22T20:23:58.438Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3490
    time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3489
    time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3489
    time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3489 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.462Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
    time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3489
    time=2026-03-22T20:23:58.462Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
    time=2026-03-22T20:23:58.462Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
    time=2026-03-22T20:23:58.462Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
    time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3490
    time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3490
    time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3490 id=3491
    time=2026-03-22T20:23:58.462Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3491 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.463Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3491
    time=2026-03-22T20:23:58.464Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3491
    time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3490
    time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3490
    time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3490 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.487Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3490
    time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3491
    time=2026-03-22T20:23:58.487Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:58.487Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3491
    time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3491 id=3492
    time=2026-03-22T20:23:58.487Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3492 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.488Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3492
    time=2026-03-22T20:23:58.488Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3492
    time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3491
    time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3491
    time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3491 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.512Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=ls from=[4577]
    time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3491
    time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3492
    time=2026-03-22T20:23:58.512Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=ls
    time=2026-03-22T20:23:58.512Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\nls}]" state=0 buffer=""
    time=2026-03-22T20:23:58.512Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\nls" toolCalls=[] done=false
    time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3492
    time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3492 id=3493
    time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3493 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3493
    time=2026-03-22T20:23:58.512Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3493
    time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3492
    time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3492
    time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3492 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.536Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" -" from=[471]
    time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3492
    time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3493
    time=2026-03-22T20:23:58.536Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" -"
    time=2026-03-22T20:23:58.536Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: -}]" state=0 buffer=""
    time=2026-03-22T20:23:58.536Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" -" toolCalls=[] done=false
    time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3493
    time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3493 id=3494
    time=2026-03-22T20:23:58.536Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3494 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.537Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3494
    time=2026-03-22T20:23:58.537Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3494
    time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3493
    time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3493
    time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3493 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.561Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=la from=[4120]
    time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3493
    time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3494
    time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3494
    time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3494 id=3495
    time=2026-03-22T20:23:58.561Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=la
    time=2026-03-22T20:23:58.561Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:la}] state=0 buffer=""
    time=2026-03-22T20:23:58.561Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=la toolCalls=[] done=false
    time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3495 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3495
    time=2026-03-22T20:23:58.561Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3495
    time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3494
    time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3494
    time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3494 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.585Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" /" from=[593]
    time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3494
    time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3495
    time=2026-03-22T20:23:58.585Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" /"
    time=2026-03-22T20:23:58.585Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: /}]" state=0 buffer=""
    time=2026-03-22T20:23:58.585Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" /" toolCalls=[] done=false
    time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3495
    time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3495 id=3496
    time=2026-03-22T20:23:58.585Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3496 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.586Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3496
    time=2026-03-22T20:23:58.586Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3496
    time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3495
    time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3495
    time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3495 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.610Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=home from=[4955]
    time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3495
    time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3496
    time=2026-03-22T20:23:58.610Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=home
    time=2026-03-22T20:23:58.610Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:home}] state=0 buffer=""
    time=2026-03-22T20:23:58.610Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=home toolCalls=[] done=false
    time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3496
    time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3496 id=3497
    time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3497 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3497
    time=2026-03-22T20:23:58.610Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3497
    time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3496
    time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3496
    time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3496 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.634Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/ne from=[86236]
    time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3496
    time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3497
    time=2026-03-22T20:23:58.634Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/ne
    time=2026-03-22T20:23:58.634Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/ne}] state=0 buffer=""
    time=2026-03-22T20:23:58.634Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/ne toolCalls=[] done=false
    time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3497
    time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3497 id=3498
    time=2026-03-22T20:23:58.634Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3498 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.635Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3498
    time=2026-03-22T20:23:58.635Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3498
    time=2026-03-22T20:23:58.658Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3497
    time=2026-03-22T20:23:58.658Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3497
    time=2026-03-22T20:23:58.658Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3497 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.659Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=ko from=[9048]
    time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3497
    time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3498
    time=2026-03-22T20:23:58.659Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=ko
    time=2026-03-22T20:23:58.659Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:ko}] state=0 buffer=""
    time=2026-03-22T20:23:58.659Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=ko toolCalls=[] done=false
    time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3498
    time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3498 id=3499
    time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3499 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3499
    time=2026-03-22T20:23:58.659Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3499
    time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3498
    time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3498
    time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3498 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.683Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/how from=[48637]
    time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3498
    time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3499
    time=2026-03-22T20:23:58.683Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/how
    time=2026-03-22T20:23:58.683Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/how}] state=0 buffer=""
    time=2026-03-22T20:23:58.683Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/how toolCalls=[] done=false
    time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3499
    time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3499 id=3500
    time=2026-03-22T20:23:58.683Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3500 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.684Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3500
    time=2026-03-22T20:23:58.684Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3500
    time=2026-03-22T20:23:58.707Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3499
    time=2026-03-22T20:23:58.707Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3499
    time=2026-03-22T20:23:58.707Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3499 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.708Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=-d from=[1676]
    time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3499
    time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3500
    time=2026-03-22T20:23:58.708Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-d
    time=2026-03-22T20:23:58.708Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-d}] state=0 buffer=""
    time=2026-03-22T20:23:58.708Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=-d toolCalls=[] done=false
    time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3500
    time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3500 id=3501
    time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3501 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3501
    time=2026-03-22T20:23:58.708Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3501
    time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3500
    time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3500
    time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3500 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.732Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=oom from=[4053]
    time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3500
    time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3501
    time=2026-03-22T20:23:58.732Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=oom
    time=2026-03-22T20:23:58.732Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:oom}] state=0 buffer=""
    time=2026-03-22T20:23:58.732Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=oom toolCalls=[] done=false
    time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3501
    time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3501 id=3502
    time=2026-03-22T20:23:58.732Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3502 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.733Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3502
    time=2026-03-22T20:23:58.733Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3502
    time=2026-03-22T20:23:58.756Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3501
    time=2026-03-22T20:23:58.756Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3501
    time=2026-03-22T20:23:58.756Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3501 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.757Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=- from=[12]
    time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3501
    time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3502
    time=2026-03-22T20:23:58.757Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-
    time=2026-03-22T20:23:58.757Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-}] state=0 buffer=""
    time=2026-03-22T20:23:58.757Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=- toolCalls=[] done=false
    time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3502
    time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3502 id=3503
    time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3503 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3503
    time=2026-03-22T20:23:58.757Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3503
    time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3502
    time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3502
    time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3502 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.781Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=are from=[532]
    time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3502
    time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3503
    time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3503
    time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3503 id=3504
    time=2026-03-22T20:23:58.781Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3504 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.781Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=are
    time=2026-03-22T20:23:58.781Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:are}] state=0 buffer=""
    time=2026-03-22T20:23:58.781Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=are toolCalls=[] done=false
    time=2026-03-22T20:23:58.782Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3504
    time=2026-03-22T20:23:58.782Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3504
    time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3503
    time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3503
    time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3503 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.805Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=-we from=[59269]
    time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3503
    time=2026-03-22T20:23:58.805Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3504
    time=2026-03-22T20:23:58.806Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=-we
    time=2026-03-22T20:23:58.806Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:-we}] state=0 buffer=""
    time=2026-03-22T20:23:58.806Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=-we toolCalls=[] done=false
    time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3504
    time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3504 id=3505
    time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3505 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3505
    time=2026-03-22T20:23:58.806Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3505
    time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3504
    time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3504
    time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3504 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.830Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=.ai from=[39046]
    time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3504
    time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3505
    time=2026-03-22T20:23:58.830Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=.ai
    time=2026-03-22T20:23:58.830Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:.ai}] state=0 buffer=""
    time=2026-03-22T20:23:58.830Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=.ai toolCalls=[] done=false
    time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3505
    time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3505 id=3506
    time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3506 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3506
    time=2026-03-22T20:23:58.830Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3506
    time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3505
    time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3505
    time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3505 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.854Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=/src from=[13050]
    time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3505
    time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3506
    time=2026-03-22T20:23:58.854Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=/src
    time=2026-03-22T20:23:58.854Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:/src}] state=0 buffer=""
    time=2026-03-22T20:23:58.854Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=/src toolCalls=[] done=false
    time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3506
    time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3506 id=3507
    time=2026-03-22T20:23:58.854Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3507 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.855Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3507
    time=2026-03-22T20:23:58.855Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3507
    time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3506
    time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3506
    time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3506 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.878Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3506
    time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3507
    time=2026-03-22T20:23:58.878Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:58.879Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3507
    time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3507 id=3508
    time=2026-03-22T20:23:58.878Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3508 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.879Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3508
    time=2026-03-22T20:23:58.879Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3508
    time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3507
    time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3507
    time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3507 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.903Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510]
    time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3507
    time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3508
    time=2026-03-22T20:23:58.903Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</
    time=2026-03-22T20:23:58.903Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3508
    time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3508 id=3509
    time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3509 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3509
    time=2026-03-22T20:23:58.903Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3509
    time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3508
    time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3508
    time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3508 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.927Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704]
    time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3508
    time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3509
    time=2026-03-22T20:23:58.928Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter
    time=2026-03-22T20:23:58.928Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</parameter}]" state=0 buffer=""
    time=2026-03-22T20:23:58.928Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</parameter" toolCalls=[] done=false
    time=2026-03-22T20:23:58.927Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3509
    time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3509 id=3510
    time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3510 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3510
    time=2026-03-22T20:23:58.928Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3510
    time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3509
    time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3509
    time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3509 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.952Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
    time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3509
    time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3510
    time=2026-03-22T20:23:58.952Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
    time=2026-03-22T20:23:58.952Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
    time=2026-03-22T20:23:58.952Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
    time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3510
    time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3510 id=3511
    time=2026-03-22T20:23:58.952Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3511 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.953Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3511
    time=2026-03-22T20:23:58.953Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3511
    time=2026-03-22T20:23:58.976Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3510
    time=2026-03-22T20:23:58.976Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3510
    time=2026-03-22T20:23:58.976Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3510 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:58.977Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3510
    time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3511
    time=2026-03-22T20:23:58.977Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:58.977Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3511
    time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3511 id=3512
    time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3512 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3512
    time=2026-03-22T20:23:58.977Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3512
    time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3511
    time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3511
    time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3511 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.001Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=< from=[27]
    time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3511
    time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3512
    time=2026-03-22T20:23:59.001Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=<
    time=2026-03-22T20:23:59.001Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3512
    time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3512 id=3513
    time=2026-03-22T20:23:59.001Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3513 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.002Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3513
    time=2026-03-22T20:23:59.002Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3513
    time=2026-03-22T20:23:59.025Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3512
    time=2026-03-22T20:23:59.025Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3512
    time=2026-03-22T20:23:59.025Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3512 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.026Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704]
    time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3512
    time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3513
    time=2026-03-22T20:23:59.026Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter
    time=2026-03-22T20:23:59.026Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n<parameter}]" state=0 buffer=""
    time=2026-03-22T20:23:59.026Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n<parameter" toolCalls=[] done=false
    time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3513
    time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3513 id=3514
    time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3514 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3514
    time=2026-03-22T20:23:59.026Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3514
    time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3513
    time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3513
    time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3513 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.050Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="=" from=[28]
    time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3513
    time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3514
    time=2026-03-22T20:23:59.050Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="="
    time=2026-03-22T20:23:59.050Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:=}]" state=0 buffer=""
    time=2026-03-22T20:23:59.050Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="=" toolCalls=[] done=false
    time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3514
    time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3514 id=3515
    time=2026-03-22T20:23:59.050Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3515 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.051Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3515
    time=2026-03-22T20:23:59.051Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3515
    time=2026-03-22T20:23:59.074Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3514
    time=2026-03-22T20:23:59.074Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3514
    time=2026-03-22T20:23:59.074Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3514 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.075Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=description from=[4532]
    time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3514
    time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3515
    time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3515
    time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3515 id=3516
    time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3516 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.075Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=description
    time=2026-03-22T20:23:59.075Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:description}] state=0 buffer=""
    time=2026-03-22T20:23:59.075Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=description toolCalls=[] done=false
    time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3516
    time=2026-03-22T20:23:59.075Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3516
    time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3515
    time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3515
    time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3515 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.099Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
    time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3515
    time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3516
    time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3516
    time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3516 id=3517
    time=2026-03-22T20:23:59.099Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3517 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.099Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
    time=2026-03-22T20:23:59.099Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
    time=2026-03-22T20:23:59.099Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
    time=2026-03-22T20:23:59.100Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3517
    time=2026-03-22T20:23:59.100Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3517
    time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3516
    time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3516
    time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3516 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.124Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3516
    time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3517
    time=2026-03-22T20:23:59.124Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:59.124Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3517
    time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3517 id=3518
    time=2026-03-22T20:23:59.124Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3518 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.125Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3518
    time=2026-03-22T20:23:59.125Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3518
    time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3517
    time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3517
    time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3517 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.148Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=List from=[826]
    time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3517
    time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3518
    time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3518
    time=2026-03-22T20:23:59.148Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=List
    time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3518 id=3519
    time=2026-03-22T20:23:59.148Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3519 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.148Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\nList}]" state=0 buffer=""
    time=2026-03-22T20:23:59.148Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\nList" toolCalls=[] done=false
    time=2026-03-22T20:23:59.149Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3519
    time=2026-03-22T20:23:59.149Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3519
    time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3518
    time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3518
    time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3518 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.173Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" src" from=[2212]
    time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3518
    time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3519
    time=2026-03-22T20:23:59.173Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" src"
    time=2026-03-22T20:23:59.173Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: src}]" state=0 buffer=""
    time=2026-03-22T20:23:59.173Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" src" toolCalls=[] done=false
    time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3519
    time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3519 id=3520
    time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3520 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3520
    time=2026-03-22T20:23:59.173Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3520
    time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3519
    time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3519
    time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3519 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.197Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=" directory" from=[6025]
    time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3519
    time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3520
    time=2026-03-22T20:23:59.197Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=" directory"
    time=2026-03-22T20:23:59.198Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content: directory}]" state=0 buffer=""
    time=2026-03-22T20:23:59.198Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=" directory" toolCalls=[] done=false
    time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3520
    time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3520 id=3521
    time=2026-03-22T20:23:59.197Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3521 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.198Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3521
    time=2026-03-22T20:23:59.198Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3521
    time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3520
    time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3520
    time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3520 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.222Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3520
    time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3521
    time=2026-03-22T20:23:59.222Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:59.222Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3521
    time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3521 id=3522
    time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3522 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3522
    time=2026-03-22T20:23:59.222Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3522
    time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3521
    time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3521
    time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3521 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.246Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510]
    time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3521
    time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3522
    time=2026-03-22T20:23:59.246Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</
    time=2026-03-22T20:23:59.246Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3522
    time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3522 id=3523
    time=2026-03-22T20:23:59.246Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3523 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.247Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3523
    time=2026-03-22T20:23:59.247Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3523
    time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3522
    time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3522
    time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3522 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.271Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=parameter from=[15704]
    time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3522
    time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3523
    time=2026-03-22T20:23:59.271Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=parameter
    time=2026-03-22T20:23:59.271Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</parameter}]" state=0 buffer=""
    time=2026-03-22T20:23:59.271Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</parameter" toolCalls=[] done=false
    time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3523
    time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3523 id=3524
    time=2026-03-22T20:23:59.271Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3524 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.272Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3524
    time=2026-03-22T20:23:59.272Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3524
    time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3523
    time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3523
    time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3523 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.295Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
    time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3523
    time=2026-03-22T20:23:59.295Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3524
    time=2026-03-22T20:23:59.296Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
    time=2026-03-22T20:23:59.296Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
    time=2026-03-22T20:23:59.296Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
    time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3524
    time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3524 id=3525
    time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3525 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3525
    time=2026-03-22T20:23:59.296Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3525
    time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3524
    time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3524
    time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3524 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.320Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3524
    time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3525
    time=2026-03-22T20:23:59.320Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:59.320Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3525
    time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3525 id=3526
    time=2026-03-22T20:23:59.320Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3526 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.321Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3526
    time=2026-03-22T20:23:59.321Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3526
    time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3525
    time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3525
    time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3525 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.345Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</ from=[510]
    time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3525
    time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3526
    time=2026-03-22T20:23:59.345Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</
    time=2026-03-22T20:23:59.345Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3526
    time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3526 id=3527
    time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3527 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3527
    time=2026-03-22T20:23:59.345Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3527
    time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3526
    time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3526
    time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3526 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.369Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=function from=[1628]
    time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3526
    time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3527
    time=2026-03-22T20:23:59.369Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=function
    time=2026-03-22T20:23:59.369Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</function}]" state=0 buffer=""
    time=2026-03-22T20:23:59.369Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</function" toolCalls=[] done=false
    time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3527
    time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3527 id=3528
    time=2026-03-22T20:23:59.369Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3528 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.370Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3528
    time=2026-03-22T20:23:59.370Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3528
    time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3527
    time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3527
    time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3527 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.394Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=> from=[29]
    time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3527
    time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3528
    time=2026-03-22T20:23:59.394Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=>
    time=2026-03-22T20:23:59.394Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events=[{content:>}] state=0 buffer=""
    time=2026-03-22T20:23:59.394Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking=> toolCalls=[] done=false
    time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3528
    time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3528 id=3529
    time=2026-03-22T20:23:59.394Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3529 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.395Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3529
    time=2026-03-22T20:23:59.395Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3529
    time=2026-03-22T20:23:59.418Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3528
    time=2026-03-22T20:23:59.418Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3528
    time=2026-03-22T20:23:59.418Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3528 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.419Z level=TRACE source=bytepairencoding.go:280 msg=decoded string="\n" from=[198]
    time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3528
    time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3529
    time=2026-03-22T20:23:59.419Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content="\n"
    time=2026-03-22T20:23:59.419Z level=TRACE source=routes.go:2447 msg="builtin parser empty output" parser=qwen3.5
    time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3529
    time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3529 id=3530
    time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3530 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3530
    time=2026-03-22T20:23:59.419Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3530
    time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3529
    time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3529
    time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3529 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.443Z level=TRACE source=bytepairencoding.go:280 msg=decoded string=</tool_call> from=[248059]
    time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3529
    time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3530
    time=2026-03-22T20:23:59.443Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=</tool_call>
    time=2026-03-22T20:23:59.443Z level=TRACE source=qwen35.go:121 msg="qwen3.5 events parsed" events="[{content:\n</tool_call>}]" state=0 buffer=""
    time=2026-03-22T20:23:59.443Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="\n</tool_call>" toolCalls=[] done=false
    time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3530
    time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3530 id=3531
    time=2026-03-22T20:23:59.443Z level=TRACE source=runner.go:592 msg="forwardBatch iBatch" batchID=3531 seqIdx=0 seq.iBatch=0 i+1=1 len(seq.inputs)=1
    time=2026-03-22T20:23:59.444Z level=TRACE source=runner.go:475 msg="forwardBatch waiting for compute to start" pendingBatch.id=3531
    time=2026-03-22T20:23:59.444Z level=TRACE source=runner.go:644 msg="computeBatch: waiting for inputs to be ready" batchID=3531
    time=2026-03-22T20:23:59.467Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3530
    time=2026-03-22T20:23:59.467Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3530
    time=2026-03-22T20:23:59.467Z level=TRACE source=runner.go:758 msg="computeBatch: vocab details" batchID=3530 seqIdx=0 len(logits)=248320 len(activeBatch.batch.Outputs)=1 vocabSize=248320 iBatches=[0]
    time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:772 msg="computeBatch: EOS" batchID=3530 seqIdx=0
    time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3530
    time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:646 msg="computeBatch: inputs are ready" batchID=3531
    time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:718 msg="computeBatch: signaling computeStartedCh" batchID=3531
    time=2026-03-22T20:23:59.468Z level=TRACE source=runner.go:477 msg="forwardBatch compute started, setting up next batch" pendingBatch.id=3531 id=3532
    time=2026-03-22T20:23:59.468Z level=TRACE source=routes.go:2420 msg="builtin parser input" parser=qwen3.5 content=""
    time=2026-03-22T20:23:59.468Z level=TRACE source=routes.go:2444 msg="builtin parser output" parser=qwen3.5 content="" thinking="" toolCalls=[] done=true
    time=2026-03-22T20:23:59.468Z level=DEBUG source=sched.go:404 msg="context for request finished" runner.name=registry.ollama.ai/library/Qwen3.5-9B-Q8_0:latest runner.inference="[{ID:GPU-7864033d27e41cb9 Library:ROCm}]" runner.size="14.2 GiB" runner.vram="14.2 GiB" runner.parallel=1 runner.pid=1139644 runner.model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4 runner.num_ctx=262144
    time=2026-03-22T20:23:59.468Z level=DEBUG source=sched.go:309 msg="runner with non-zero duration has gone idle, adding timer" runner.name=registry.ollama.ai/library/Qwen3.5-9B-Q8_0:latest runner.inference="[{ID:GPU-7864033d27e41cb9 Library:ROCm}]" runner.size="14.2 GiB" runner.vram="14.2 GiB" runner.parallel=1 runner.pid=1139644 runner.model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4 runner.num_ctx=262144 duration=2562047h47m16.854775807s
    time=2026-03-22T20:23:59.468Z level=DEBUG source=sched.go:327 msg="after processing request finished event" runner.name=registry.ollama.ai/library/Qwen3.5-9B-Q8_0:latest runner.inference="[{ID:GPU-7864033d27e41cb9 Library:ROCm}]" runner.size="14.2 GiB" runner.vram="14.2 GiB" runner.parallel=1 runner.pid=1139644 runner.model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4 runner.num_ctx=262144 refCount=0
    time=2026-03-22T20:23:59.492Z level=TRACE source=runner.go:726 msg="computeBatch: logits ready" batchID=3531
    time=2026-03-22T20:23:59.492Z level=TRACE source=runner.go:731 msg="computeBatch: decoding" batchID=3531
    time=2026-03-22T20:23:59.492Z level=TRACE source=runner.go:651 msg="computeBatch: outputs are ready" batchID=3531
    time=2026-03-22T20:24:00.255Z level=DEBUG source=sched.go:908 msg="shutting down runner" model=/home/neko/.ollama/models/blobs/sha256-809626574d0cb43d4becfa56169980da2bb448f2299270f7be443cb89d0a6ae4
    time=2026-03-22T20:24:00.255Z level=DEBUG source=server.go:1830 msg="stopping llama server" pid=1139644
    time=2026-03-22T20:24:00.255Z level=DEBUG source=server.go:1836 msg="waiting for llama server to exit" pid=1139644
    time=2026-03-22T20:24:00.255Z level=DEBUG source=sched.go:287 msg="shutting down scheduler completed loop"
    time=2026-03-22T20:24:00.255Z level=DEBUG source=sched.go:161 msg="shutting down scheduler pending loop"
    time=2026-03-22T20:24:00.374Z level=ERROR source=server.go:303 msg="llama runner terminated" error="signal: interrupt"
    time=2026-03-22T20:24:00.374Z level=DEBUG source=server.go:1840 msg="llama server stopped" pid=1139644
    

    HW:

    • Linux AMD ROCm
  10. rick-github commented on Mar 22, 2026

    @rick-github
    Collaborator

    Full log, from the start.

  11. rick-github commented on Mar 22, 2026

    @rick-github
    Collaborator

    Where was the GGUF sourced from?

  12. hashelq commented on Mar 22, 2026

    @hashelq

    Where was the GGUF sourced from?

    https://huggingface.co/unsloth/Qwen3.5-9B-GGUF

    upd1:

    Also I have same exact problems with
    https://huggingface.co/Jackrong 's qwen3.5 cladue-4.6opus-dist v1 models
    and
    https://huggingface.co/Tesslate/OmniCoder-9B-GGUF

    It seems all qwen3.5 and their forks are affected in my case

    upd2:

    just pulled qwen3.5:2b with ollama pull
    with cfg:

    FROM qwen3.5:2b
    
    PARAMETER num_gpu 64
    PARAMETER num_ctx 64000
    

    Same issue

  13. rick-github commented on Mar 22, 2026

    @rick-github
    Collaborator

    Do you have the issue if you use the model from the ollama library?

  14. hashelq commented on Mar 23, 2026

    @hashelq

    Do you have the issue if you use the model from the ollama library?

    Yes, I demonstrate it above with qwen3.5:2b

  15. hashelq commented on Mar 23, 2026

    @hashelq

    Interestingly, seems like switching to

    RENDERER qwen3-coder
    PARSER qwen3-coder
    

    for qwen3.5:9b fixes the basic tool calling (read/list/grep/whatever) problems for a trade off of broken think tag parsing.

    But with this setup I seen the qwen could not correctly call the opencode's questions tool..

    Image
  16. hashelq commented on Mar 24, 2026

    @hashelq

    I found that sometimes qwen3.5 models fail to produce "</think>" at the end of thinking.

    Here is the omnicoder 9b (qwen3.5:9b fork) raw:

    <function=bash>
    <parameter=command>
    cat /home/neko/how-doom-are-we.ai/package.json
    </parameter>
    <parameter=description>
    Read package.json
    </parameter>
    </function>
    </tool_call>[GIN] 2026/03/24 - 18:09:02 | 200 | 14.620707514s |       127.0.0.1 | POST     "/v1/chat/completions"
    I need to explore the directory structure more and look at key files to understand the project[GIN] 2026/03/24 - 18:09:05 |
    200 |      83.359µs |       127.0.0.1 | POST     "/api/blobs/sha256:3bb360f0d5bf788503dcd751e704760173298a35b26602dfb939474d87745732"
     better.
    
    
    
    <tool_call>
    
    <[GIN] 2026/03/24 - 18:09:05 | 200 |  188.708997ms |       127.0.0.1 | POST     "/api/create"
    
    <function=bash>
    
    <
    <parameter=command>
    
    

    It clearly misses the </think> after word "better".

    And the debugging code is model/parsers/qwen35.go

    func (p *Qwen35Parser) eat() ([]qwen35Event, bool) {
    	var events []qwen35Event
    
    	fmt.Print(p.buffer.String())
    	switch p.state {
    	case qwen35ParserStateCollectingThinking:
    		acc := p.buffer.String()

    ... I was not using flash attention or KV_CACHE_TYPE for recent tests
    Other observations:

    • Was testing it with vulkan instead of ROCm, the problem is the same.
    • qwen3.5 9B models seems to break much faster than 2B model
  17. rick-github commented on Mar 24, 2026

    @rick-github
    Collaborator
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions