Repository navigation
Commit 3216ce1
committed
fix: NVIDIA NIM model compatibility issues
Thanks to @akarshjadhav21 for this :D
- DeepSeek v4: Add chat_template_kwargs to enable thinking (fixes silent stall)
See: anomalyco#24264
- Nemotron 3 Ultra: Add chat_template_kwargs to enable thinking (fixes hang)
See: anomalyco#34026
- MiniMax M3: Use thinking.type instead of chat_template_kwargs for NIM compatibility
(NIM only accepts thinking.type 'enabled' or 'disabled', not 'adaptive')
- Model ID slash fix: Try prepending provider ID for NVIDIA NIM models with
slash-containing IDs (e.g., nvidia/nvidia/nemotron-3-ultra-550b-a55b)1 parent 829420b commit 3216ce1
3 files changed
Lines changed: 90 additions & 5 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1880 | 1880 | | |
1881 | 1881 | | |
1882 | 1882 | | |
| 1883 | + | |
| 1884 | + | |
| 1885 | + | |
| 1886 | + | |
| 1887 | + | |
| 1888 | + | |
| 1889 | + | |
| 1890 | + | |
1883 | 1891 | | |
1884 | 1892 | | |
1885 | 1893 | | |
| |||
2065 | 2073 | | |
2066 | 2074 | | |
2067 | 2075 | | |
| 2076 | + | |
| 2077 | + | |
| 2078 | + | |
| 2079 | + | |
| 2080 | + | |
| 2081 | + | |
| 2082 | + | |
| 2083 | + | |
| 2084 | + | |
| 2085 | + | |
| 2086 | + | |
| 2087 | + | |
| 2088 | + | |
| 2089 | + | |
| 2090 | + | |
| 2091 | + | |
| 2092 | + | |
| 2093 | + | |
| 2094 | + | |
| 2095 | + | |
| 2096 | + | |
| 2097 | + | |
| 2098 | + | |
| 2099 | + | |
2068 | 2100 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
735 | 735 | | |
736 | 736 | | |
737 | 737 | | |
| 738 | + | |
738 | 739 | | |
739 | | - | |
740 | | - | |
| 740 | + | |
| 741 | + | |
741 | 742 | | |
742 | 743 | | |
743 | 744 | | |
| |||
1231 | 1232 | | |
1232 | 1233 | | |
1233 | 1234 | | |
| 1235 | + | |
| 1236 | + | |
| 1237 | + | |
| 1238 | + | |
| 1239 | + | |
| 1240 | + | |
| 1241 | + | |
| 1242 | + | |
| 1243 | + | |
| 1244 | + | |
| 1245 | + | |
| 1246 | + | |
| 1247 | + | |
| 1248 | + | |
| 1249 | + | |
| 1250 | + | |
| 1251 | + | |
| 1252 | + | |
| 1253 | + | |
| 1254 | + | |
| 1255 | + | |
| 1256 | + | |
1234 | 1257 | | |
1235 | 1258 | | |
1236 | 1259 | | |
| |||
1345 | 1368 | | |
1346 | 1369 | | |
1347 | 1370 | | |
| 1371 | + | |
| 1372 | + | |
| 1373 | + | |
| 1374 | + | |
| 1375 | + | |
| 1376 | + | |
| 1377 | + | |
| 1378 | + | |
| 1379 | + | |
| 1380 | + | |
| 1381 | + | |
| 1382 | + | |
| 1383 | + | |
| 1384 | + | |
| 1385 | + | |
| 1386 | + | |
| 1387 | + | |
| 1388 | + | |
| 1389 | + | |
| 1390 | + | |
| 1391 | + | |
| 1392 | + | |
| 1393 | + | |
| 1394 | + | |
| 1395 | + | |
| 1396 | + | |
| 1397 | + | |
| 1398 | + | |
| 1399 | + | |
1348 | 1400 | | |
1349 | 1401 | | |
1350 | 1402 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3878 | 3878 | | |
3879 | 3879 | | |
3880 | 3880 | | |
3881 | | - | |
| 3881 | + | |
3882 | 3882 | | |
3883 | 3883 | | |
3884 | 3884 | | |
| |||
3888 | 3888 | | |
3889 | 3889 | | |
3890 | 3890 | | |
| 3891 | + | |
3891 | 3892 | | |
3892 | | - | |
3893 | | - | |
| 3893 | + | |
| 3894 | + | |
3894 | 3895 | | |
3895 | 3896 | | |
3896 | 3897 | | |
| |||
0 commit comments