Repository navigation
Commit d113ed4
Copybara import of the project:
--
b5c7090 by Mukunda Rao Katta <[email protected]>:
fix(retry): retry on httpx.TimeoutException with HttpRetryOptions
The retry predicate in `retry_args` only matched `errors.APIError` subclasses,
so lower-level httpx transport exceptions (`httpx.TimeoutException`,
`httpx.ConnectError`, and their subclasses such as `ReadTimeout` /
`ConnectTimeout`) were silently dropped and never retried, even when
`HttpRetryOptions` was explicitly configured.
Long-running LLM inference calls regularly hit transient transport errors
from load balancers, NAT gateways, and idle TCP timeouts. Vertex AI's
retry strategy guidance lists socket timeouts and TCP disconnects as
retryable, so honoring those here matches user expectations.
Fixes #2337.
FUTURE_COPYBARA_INTEGRATE_REVIEW=#2345 from MukundaKatta:fix/retry-httpx-timeout 9b2d886
PiperOrigin-RevId: 9066207871 parent f8a2e7e commit d113ed4
1 file changed
Lines changed: 17 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
187 | 187 | | |
188 | 188 | | |
189 | 189 | | |
| 190 | + | |
| 191 | + | |
| 192 | + | |
| 193 | + | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
190 | 207 | | |
191 | 208 | | |
192 | 209 | | |
| |||
0 commit comments