Repository navigation
Commit 8821173
committed
fix: NVIDIA NIM model compatibility issues
- DeepSeek v4: Add chat_template_kwargs to enable thinking (fixes silent stall)
See: anomalyco#24264
- Nemotron 3 Ultra: Add chat_template_kwargs to enable thinking (fixes hang)
See: anomalyco#34026
- MiniMax M3: Use thinking.type instead of chat_template_kwargs for NIM compatibility
(NIM only accepts thinking.type 'enabled' or 'disabled', not 'adaptive')
- Model ID slash fix: Try prepending provider ID for NVIDIA NIM models with
slash-containing IDs (e.g., nvidia/nvidia/nemotron-3-ultra-550b-a55b)1 parent c5ef753 commit 8821173
3 files changed
Lines changed: 89 additions & 5 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1879 | 1879 | | |
1880 | 1880 | | |
1881 | 1881 | | |
| 1882 | + | |
| 1883 | + | |
| 1884 | + | |
| 1885 | + | |
| 1886 | + | |
| 1887 | + | |
| 1888 | + | |
| 1889 | + | |
1882 | 1890 | | |
1883 | 1891 | | |
1884 | 1892 | | |
| |||
2058 | 2066 | | |
2059 | 2067 | | |
2060 | 2068 | | |
| 2069 | + | |
| 2070 | + | |
| 2071 | + | |
| 2072 | + | |
| 2073 | + | |
| 2074 | + | |
| 2075 | + | |
| 2076 | + | |
| 2077 | + | |
| 2078 | + | |
| 2079 | + | |
| 2080 | + | |
| 2081 | + | |
| 2082 | + | |
| 2083 | + | |
| 2084 | + | |
| 2085 | + | |
| 2086 | + | |
| 2087 | + | |
| 2088 | + | |
| 2089 | + | |
| 2090 | + | |
| 2091 | + | |
2061 | 2092 | | |
2062 | 2093 | | |
2063 | 2094 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
736 | 736 | | |
737 | 737 | | |
738 | 738 | | |
| 739 | + | |
739 | 740 | | |
740 | | - | |
741 | | - | |
| 741 | + | |
| 742 | + | |
742 | 743 | | |
743 | 744 | | |
744 | 745 | | |
| |||
1232 | 1233 | | |
1233 | 1234 | | |
1234 | 1235 | | |
| 1236 | + | |
| 1237 | + | |
| 1238 | + | |
| 1239 | + | |
| 1240 | + | |
| 1241 | + | |
| 1242 | + | |
| 1243 | + | |
| 1244 | + | |
| 1245 | + | |
| 1246 | + | |
| 1247 | + | |
| 1248 | + | |
| 1249 | + | |
| 1250 | + | |
| 1251 | + | |
| 1252 | + | |
| 1253 | + | |
| 1254 | + | |
| 1255 | + | |
| 1256 | + | |
| 1257 | + | |
1235 | 1258 | | |
1236 | 1259 | | |
1237 | 1260 | | |
| |||
1346 | 1369 | | |
1347 | 1370 | | |
1348 | 1371 | | |
| 1372 | + | |
| 1373 | + | |
| 1374 | + | |
| 1375 | + | |
| 1376 | + | |
| 1377 | + | |
| 1378 | + | |
| 1379 | + | |
| 1380 | + | |
| 1381 | + | |
| 1382 | + | |
| 1383 | + | |
| 1384 | + | |
| 1385 | + | |
| 1386 | + | |
| 1387 | + | |
| 1388 | + | |
| 1389 | + | |
| 1390 | + | |
| 1391 | + | |
| 1392 | + | |
| 1393 | + | |
| 1394 | + | |
| 1395 | + | |
| 1396 | + | |
| 1397 | + | |
| 1398 | + | |
| 1399 | + | |
| 1400 | + | |
1349 | 1401 | | |
1350 | 1402 | | |
1351 | 1403 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3749 | 3749 | | |
3750 | 3750 | | |
3751 | 3751 | | |
3752 | | - | |
| 3752 | + | |
3753 | 3753 | | |
3754 | 3754 | | |
3755 | 3755 | | |
| |||
3759 | 3759 | | |
3760 | 3760 | | |
3761 | 3761 | | |
| 3762 | + | |
3762 | 3763 | | |
3763 | | - | |
3764 | | - | |
| 3764 | + | |
| 3765 | + | |
3765 | 3766 | | |
3766 | 3767 | | |
3767 | 3768 | | |
| |||
0 commit comments