Skip to content

fix: retry live Gateway readiness proof#104374

Merged
steipete merged 2 commits into
mainfrom
codex/retry-live-updater-gateway-readiness
Jul 11, 2026
Merged

fix: retry live Gateway readiness proof#104374
steipete merged 2 commits into
mainfrom
codex/retry-live-updater-gateway-readiness

Conversation

@steipete

Copy link
Copy Markdown
Contributor

What Problem This Solves

Closes #104365.

The live updater could report a successful exact-head Gateway restart as failed when its single deep RPC probe landed during startup warmup. The live service was healthy and the identical probe passed eight seconds later.

Why This Change Was Made

Post-restart readiness now gets three bounded attempts with five seconds between failed probes. The retry is scoped to restart verification: no-op heartbeat probes remain immediate, exact-build assertions still run for every attempt, restart-window logs are still audited, and exhausted retries still fail closed.

User Impact

Live Gateway updates tolerate normal startup warmup without false failure reports or unnecessary reruns. Persistent RPC failures remain visible after the bounded retry window.

Evidence

  • Live reproduction on clawmac at 8e2ddd60ad8865a2c27624eec05951a234bcdf76: first 10-second RPC probe timed out while health was true; the same probe passed eight seconds later without another restart.
  • Testbox focused run: 27/27 tests passed (run).
  • Testbox touched-surface gate: typecheck, lint, import-cycle and repository guards passed (run).
  • Autoreview: clean, no accepted/actionable findings; correctness 0.97.

@clawsweeper clawsweeper Bot added rating: 🐚 platinum hermit Good normal PR readiness with ordinary maintainer review expected. status: 👀 ready for maintainer look ClawSweeper has no concrete contributor-facing blocker left for this PR. P2 Normal backlog priority with limited blast radius. labels Jul 11, 2026
@clawsweeper

clawsweeper Bot commented Jul 11, 2026

Copy link
Copy Markdown
Contributor

Codex review: needs real behavior proof before merge. Reviewed July 11, 2026, 6:08 AM ET / 10:08 UTC.

Summary
The PR adds three bounded attempts with five-second delays to post-restart Gateway readiness verification and updates focused updater tests.

PR surface: Tests +31, Other +32. Total +63 across 2 files.

Reproducibility: yes. from source and the linked live report: current main performs one immediate post-restart deep RPC probe, and that probe can time out during healthy startup warmup before the identical command succeeds shortly afterward.

Review metrics: none identified.

Root-cause cluster
Relationship: fixed_by_candidate
Canonical: #104365
Summary: This PR is the direct implementation candidate for the canonical live-updater startup-warmup false-negative issue.

Members:

Proposal only: this assessment does not dispatch repair, suppress jobs, mutate sibling items, close, or merge anything.

Merge readiness
Overall: 🐚 platinum hermit
Proof: 🌊 off-meta tidepool
Patch quality: 🐚 platinum hermit
Result: ready for maintainer review.

Overall follows the weaker of proof and patch quality, so missing proof can cap an otherwise strong patch.

Rank-up moves:

  • none.

Risk before merge

  • [P1] The PR body overstates its linked validation: both cited Testbox runs checked out a pre-PR commit and were cancelled, so maintainers should use the current-head checks or corrected exact-head evidence instead.

Maintainer options:

  1. Decide the mitigation before merge
    Land the bounded restart-only retry after correcting the validation references, while preserving the immediate no-op probe, exact-build checks, one restart-window audit, and fail-closed behavior after the retry budget is exhausted.
  2. Pause or close
    Do not merge this PR until maintainers decide whether the risk is worth taking.

Next step before merge

  • [P1] This protected, active implementation PR needs ordinary maintainer review and corrected evidence references, not a separate automated repair job.

Security
Cleared: The patch changes local retry control flow and tests without modifying dependencies, permissions, secrets, downloaded artifacts, package resolution, or other supply-chain surfaces.

Review details

Best possible solution:

Land the bounded restart-only retry after correcting the validation references, while preserving the immediate no-op probe, exact-build checks, one restart-window audit, and fail-closed behavior after the retry budget is exhausted.

Do we have a high-confidence way to reproduce the issue?

Yes from source and the linked live report: current main performs one immediate post-restart deep RPC probe, and that probe can time out during healthy startup warmup before the identical command succeeds shortly afterward.

Is this the best way to solve the issue?

Yes. Retrying at the existing post-restart verification boundary is narrower and more maintainable than changing Gateway command timeouts or no-op heartbeat behavior, and it preserves the existing exact-build, audit, and fail-closed contracts.

AGENTS.md: found and applied where relevant.

Codex review notes: model internal, reasoning high; reviewed against 6268eeef15b6.

Label changes

Label changes:

  • add P2: This fixes a limited-blast-radius false failure in live update maintenance automation without changing normal Gateway runtime or configuration.
  • add rating: 🐚 platinum hermit: Overall readiness is 🐚 platinum hermit; proof is 🌊 off-meta tidepool and patch quality is 🐚 platinum hermit.
  • add status: 👀 ready for maintainer look: ClawSweeper has no concrete contributor-facing blocker left for this PR. Not applicable: The repository labels this as a maintainer PR, so the external-contributor proof gate does not apply; the live reproduction and successful current-head checks remain supporting evidence.

Label justifications:

  • P2: This fixes a limited-blast-radius false failure in live update maintenance automation without changing normal Gateway runtime or configuration.
  • rating: 🐚 platinum hermit: Overall readiness is 🐚 platinum hermit; proof is 🌊 off-meta tidepool and patch quality is 🐚 platinum hermit.
  • status: 👀 ready for maintainer look: ClawSweeper has no concrete contributor-facing blocker left for this PR. Not applicable: The repository labels this as a maintainer PR, so the external-contributor proof gate does not apply; the live reproduction and successful current-head checks remain supporting evidence.
Evidence reviewed

PR surface:

Tests +31, Other +32. Total +63 across 2 files.

View PR surface stats
Area Files Added Removed Net
Source 0 0 0 0
Tests 1 32 1 +31
Docs 0 0 0 0
Config 0 0 0 0
Generated 0 0 0 0
Other 1 34 2 +32
Total 2 66 3 +63

What I checked:

Likely related people:

  • steipete: Authored the merged Gateway restart hardening, verification/audit integration, and subsequent updater isolation changes that define the path extended here. (role: feature owner and recent area contributor; confidence: high; commits: 2ed24246182f, 107b95e1ad89, 14a056ac83a3; files: .agents/skills/openclaw-live-updater/scripts/update-main.mjs, test/scripts/openclaw-live-updater.test.ts)
  • vincentkoc: Authored the initial live-updater implementation and test suite before the later Gateway restart and audit hardening. (role: introduced adjacent updater behavior; confidence: medium; commits: 1667654caa44; files: .agents/skills/openclaw-live-updater/scripts/update-main.mjs, test/scripts/openclaw-live-updater.test.ts)
What the crustacean ranks mean
  • 🦀 challenger crab: rare, exceptional readiness with strong proof, clean implementation, and convincing validation.
  • 🦞 diamond lobster: very strong readiness with only minor maintainer review expected.
  • 🐚 platinum hermit: good normal PR, likely mergeable with ordinary maintainer review.
  • 🦐 gold shrimp: useful signal, but proof or patch confidence is still limited.
  • 🦪 silver shellfish: thin signal; proof, validation, or implementation needs work.
  • 🧂 unranked krab: not merge-ready because proof is missing/unusable or there are serious correctness or safety concerns.
  • 🌊 off-meta tidepool: rating does not apply to this item.

Shiny media proof means a screenshot, video, or linked artifact directly shows the changed behavior. Runtime, network, CSP, and security claims still need visible diagnostics.

How this review workflow works
  • ClawSweeper keeps one durable marker-backed review comment per issue or PR.
  • Re-runs edit this comment so the latest verdict, findings, and automation markers stay together instead of adding duplicate bot comments.
  • A fresh review can be triggered by eligible @clawsweeper re-review comments, exact-item GitHub events, scheduled/background review runs, or manual workflow dispatch.
  • PR/issue authors and users with repository write access can comment @clawsweeper re-review or @clawsweeper re-run on an open PR or issue to request a fresh review only.
  • Maintainers can also comment @clawsweeper review to request a fresh review only.
  • Fresh-review commands do not start repair, autofix, rebase, CI repair, or automerge.
  • Maintainer-only repair and merge flows require explicit commands such as @clawsweeper autofix, @clawsweeper automerge, @clawsweeper fix ci, or @clawsweeper address review.
  • Maintainers can comment @clawsweeper explain to ask for more context, or @clawsweeper stop to stop active automation.

@steipete
steipete merged commit 5e8a534 into main Jul 11, 2026
94 of 97 checks passed
@steipete
steipete deleted the codex/retry-live-updater-gateway-readiness branch July 11, 2026 10:11
@steipete

Copy link
Copy Markdown
Contributor Author

Merged via squash.

vincentkoc added a commit that referenced this pull request Jul 11, 2026
* origin/main:
  fix(cron): abort superseded reconciliation hooks (#104368)
  ci(release): expose Telegram runtime preflight stage (#104387)
  fix(status): avoid false shell-wrapper audit warnings (#81778)
  fix: retry live Gateway readiness proof (#104374)
  fix(exec-approval): stop misattributing Allow Always unavailability to policy (#97740)
  fix: preserve Mac bundle during live builds (#104376)
  chore(docs): translate with GPT-5.6 xhigh
  test: wire Control UI suite into CI, fix its broken tests, drop dead harness surface (#104361)
  fix(ui): hide group submenu separator when New group is the only entry (#104370)
  fix(discord): reset progress drafts across queued turns (#102341)
  docs(cli): clarify that exec-policy show and approvals get exclude per-session /exec overrides (#94999)
  fix(discord): single-source thread-binding default placement and guard artifact parity (#104342)
  fix(agents): add tool-activity heartbeat to keep subagent alive during tool calls (#95536)
  fix(maint): reuse recent same-PR hosted gates (#104355)
github-actions Bot pushed a commit to Desicool/openclaw that referenced this pull request Jul 12, 2026
* fix: retry live Gateway readiness proof

* style: format live updater readiness helper
github-actions Bot pushed a commit to Desicool/openclaw that referenced this pull request Jul 12, 2026
* origin/main:
  fix(cron): abort superseded reconciliation hooks (openclaw#104368)
  ci(release): expose Telegram runtime preflight stage (openclaw#104387)
  fix(status): avoid false shell-wrapper audit warnings (openclaw#81778)
  fix: retry live Gateway readiness proof (openclaw#104374)
  fix(exec-approval): stop misattributing Allow Always unavailability to policy (openclaw#97740)
  fix: preserve Mac bundle during live builds (openclaw#104376)
  chore(docs): translate with GPT-5.6 xhigh
  test: wire Control UI suite into CI, fix its broken tests, drop dead harness surface (openclaw#104361)
  fix(ui): hide group submenu separator when New group is the only entry (openclaw#104370)
  fix(discord): reset progress drafts across queued turns (openclaw#102341)
  docs(cli): clarify that exec-policy show and approvals get exclude per-session /exec overrides (openclaw#94999)
  fix(discord): single-source thread-binding default placement and guard artifact parity (openclaw#104342)
  fix(agents): add tool-activity heartbeat to keep subagent alive during tool calls (openclaw#95536)
  fix(maint): reuse recent same-PR hosted gates (openclaw#104355)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

maintainer Maintainer-authored PR P2 Normal backlog priority with limited blast radius. rating: 🐚 platinum hermit Good normal PR readiness with ordinary maintainer review expected. size: S status: 👀 ready for maintainer look ClawSweeper has no concrete contributor-facing blocker left for this PR.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Live updater reports failure during healthy Gateway startup warmup

1 participant