Repository navigation
Commit 9210808
fix: enable TCP keepalive on the OpenAI client to prevent stale-connection hangs
Root cause of the intermittent multi-minute hangs during multi-place
imports: the OpenAI SDK's default transport does not enable TCP-level
SO_KEEPALIVE (unlike the Anthropic SDK, which already does). During a
burst of sequential calls, if a NAT gateway or load balancer silently
drops an idle pooled connection, the client has no way to detect the
dead connection at the OS level and blocks on it until the outer
request timeout fires. Known upstream issue: openai/openai-python#3269.
Confirmed via two live incidents in the same test session, on two
different place names, immediately preceded and followed by normal-
speed calls -- ruling out both the specific content and a rate-limit
cascade, and matching the documented failure mode exactly.
Mirrors the socket options the Anthropic SDK already applies by
default (anthropic._base_client._DefaultHttpxClient), so both
providers now have equivalent connection resilience.
Co-Authored-By: Claude Sonnet 5 <[email protected]>1 parent d14157e commit 9210808
4 files changed
Lines changed: 59 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | 3 | | |
4 | | - | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
5 | 7 | | |
| 8 | + | |
6 | 9 | | |
7 | 10 | | |
8 | 11 | | |
| |||
15 | 18 | | |
16 | 19 | | |
17 | 20 | | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
18 | 49 | | |
19 | 50 | | |
20 | 51 | | |
21 | | - | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
22 | 55 | | |
23 | 56 | | |
24 | 57 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
13 | 13 | | |
14 | 14 | | |
15 | 15 | | |
| 16 | + | |
16 | 17 | | |
17 | 18 | | |
18 | 19 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
| 2 | + | |
2 | 3 | | |
3 | 4 | | |
4 | 5 | | |
| |||
133 | 134 | | |
134 | 135 | | |
135 | 136 | | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
| 153 | + | |
| 154 | + | |
| 155 | + | |
| 156 | + | |
Some generated files are not rendered by default. Learn more about customizing how changed files appear on GitHub.
0 commit comments