Repository navigation
Commit 703eb5f
authored
Python: Send the NVIDIA nvext setting in extra_body (#14698)
### Motivation and Context
`NvidiaChatPromptExecutionSettings.nvext` is dumped as a top-level
argument of `chat.completions.create()`, so every request that sets it
fails:
```
ServiceResponseException: ... service failed to complete the chat
caused by: TypeError: AsyncCompletions.create() got an unexpected keyword argument 'nvext'
```
### Description
- `prepare_settings_dict()` now sends `nvext` in `extra_body`, merged
with the `guided_json` that `response_format` puts there. On a key
clash, `extra_body["nvext"]` wins.
- Removed the handler's copy of `extra_body["nvext"]`. `model_dump()`
already includes `extra_body`, and the copy would overwrite the merged
value.
- Added two regression tests. The existing tests mock `create()` with a
plain `AsyncMock`, which accepts any keyword, so they could not catch
this.
### Contribution Checklist
- [x] The code builds clean without any errors or warnings
- [x] The PR follows the [SK Contribution
Guidelines](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md)
and the [pre-submission formatting
script](https://github.com/microsoft/semantic-kernel/blob/main/CONTRIBUTING.md#development-scripts)
raises no violations
- [x] All unit tests pass, and I have added new tests where possible
- [x] I didn't break anyone 😄1 parent e68f977 commit 703eb5f
3 files changed
Lines changed: 51 additions & 10 deletions
File tree
- python
- semantic_kernel/connectors/ai/nvidia
- prompt_execution_settings
- services
- tests/unit/connectors/ai/nvidia/services
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
65 | 65 | | |
66 | 66 | | |
67 | 67 | | |
68 | | - | |
69 | | - | |
70 | | - | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
71 | 75 | | |
72 | 76 | | |
73 | 77 | | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
66 | 66 | | |
67 | 67 | | |
68 | 68 | | |
69 | | - | |
70 | | - | |
71 | | - | |
72 | | - | |
73 | | - | |
74 | | - | |
75 | | - | |
76 | 69 | | |
77 | 70 | | |
78 | 71 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
136 | 136 | | |
137 | 137 | | |
138 | 138 | | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
| 156 | + | |
| 157 | + | |
| 158 | + | |
| 159 | + | |
| 160 | + | |
| 161 | + | |
| 162 | + | |
| 163 | + | |
| 164 | + | |
| 165 | + | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
139 | 179 | | |
140 | 180 | | |
141 | 181 | | |
| |||
0 commit comments