Repository navigation
Commit aa85cbb
authored
fix: disable deepseek thinking via extra_body in codex workflows (#19)
* ci: sync codex eval workflows on main with latest fixes
Roll forward the two manual-codex-judge*.yml files on main to match
what feat/codex-eval-backend currently carries. Workflow_dispatch
parses the YAML from main, so the iterative fixes on the feat branch
weren't visible to the Actions tab until this lands.
Cumulative changes since the initial registration in #13:
- Install LiteLLM proxy via `uv tool install` (was pip+setup-python).
- Drop a `cp .../litellm_proxy_hooks.py /tmp/litellm/` step so LiteLLM
can resolve the hook module (it looks relative to the config file's
directory, not PYTHONPATH).
- Register the hook via `litellm_settings.callbacks` so non-function
tools (codex's namespace / MCP groupings) are stripped before
forwarding to DeepSeek.
- Set `reasoning_effort: none` on both deepseek-v4-* models so
thinking mode is disabled and codex doesn't have to round-trip
`reasoning_content` (which it doesn't know about).
- Move `setup-uv` above the litellm step so `uv tool` is available
for the proxy install; remove the obsolete `setup-python` step.
Workflows remain `workflow_dispatch:` only and depend on skills-evals
code (driver, hook, tests, conftest changes) that lives only on
feat/codex-eval-backend. Dispatch them with ref=feat/codex-eval-backend
until #11 merges.
Signed-off-by: Tanzim Saqib <[email protected]>
* fix: disable deepseek thinking via extra_body, not reasoning_effort
Same fix as on the feat branch — reasoning_effort=none was ignored
(DeepSeek's schema only accepts "high" or "max"). The actual
disable is `thinking: { type: "disabled" }` passed via extra_body
so LiteLLM merges it into the upstream request body.
Signed-off-by: Tanzim Saqib <[email protected]>
---------
Signed-off-by: Tanzim Saqib <[email protected]>1 parent 3e59695 commit aa85cbb
2 files changed
Lines changed: 22 additions & 12 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
61 | 61 | | |
62 | 62 | | |
63 | 63 | | |
64 | | - | |
| 64 | + | |
65 | 65 | | |
66 | 66 | | |
67 | 67 | | |
68 | 68 | | |
69 | 69 | | |
70 | 70 | | |
71 | | - | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
72 | 74 | | |
73 | 75 | | |
74 | 76 | | |
75 | 77 | | |
76 | | - | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
77 | 81 | | |
78 | 82 | | |
79 | 83 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
102 | 102 | | |
103 | 103 | | |
104 | 104 | | |
105 | | - | |
106 | | - | |
107 | | - | |
108 | | - | |
109 | | - | |
110 | | - | |
111 | | - | |
| 105 | + | |
| 106 | + | |
| 107 | + | |
| 108 | + | |
| 109 | + | |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
112 | 114 | | |
113 | 115 | | |
114 | 116 | | |
115 | 117 | | |
116 | 118 | | |
117 | | - | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
118 | 122 | | |
119 | 123 | | |
120 | 124 | | |
121 | 125 | | |
122 | | - | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
123 | 129 | | |
124 | 130 | | |
125 | 131 | | |
| |||
0 commit comments