Skip to content

Commit a345778

Browse files
fix(llm): retry transient provider failures (#555)
* fix(llm): retry transient provider failures Signed-off-by: Narendran Raghavan <[email protected]> * fix(llm): complete provider retry semantics Signed-off-by: Narendran Raghavan <[email protected]> * fix(llm): jitter coordinator retry backoff Spread concurrent provider retries within each attempt budget while respecting bounded Retry-After minimums and shared scan deadlines. Cover retry counts, delay caps, header precedence, and sync/async deadline boundaries. Signed-off-by: Narendran Raghavan <[email protected]> * fix(llm): report actual provider retry stop outcomes Signed-off-by: Narendran Raghavan <[email protected]> --------- Signed-off-by: Narendran Raghavan <[email protected]> Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
1 parent d162d9b commit a345778

7 files changed

Lines changed: 1111 additions & 68 deletions

File tree

‎src/skillspector/inspection_ledger.py‎

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -116,7 +116,9 @@ class LedgerReason(StrEnum):
116116
LedgerReason.LLM_STRUCTURED_RESPONSE_INVALID: (
117117
"LLM returned a malformed structured response after bounded retries."
118118
),
119-
LedgerReason.LLM_CONNECTION_RETRIES_EXHAUSTED: ("LLM connection failed after bounded retries."),
119+
LedgerReason.LLM_CONNECTION_RETRIES_EXHAUSTED: (
120+
"Transient LLM provider failure persisted after bounded retries."
121+
),
120122
LedgerReason.ANALYZER_RUNTIME_ERROR: ("Analyzer failed after beginning applicable work."),
121123
LedgerReason.UNACCOUNTED_WORK: ("Planned inspection work has no unique terminal outcome."),
122124
LedgerReason.SEMANTIC_RUNTIME_INCOMPLETE: (

0 commit comments

Comments
 (0)