Skip to content

fix(cli): repair interrupted update fleet restart - #95328

Closed
gokay-ai wants to merge 1 commit into
NousResearch:mainfrom
gokay-ai:cursor/fix-update-pending-fleet-restart-9c5d
Closed

gokay-ai wants to merge 1 commit into
NousResearch:mainfrom
gokay-ai:cursor/fix-update-pending-fleet-restart-9c5d

Conversation

@gokay-ai

Copy link
Copy Markdown

Fixes #95294 (parts 1+2)

Interrupted hermes update after a successful pull left the gateway on stale code. The next run said already up to date and skipped the restart.

This writes fleet_restart_pending after HEAD advances, clears it when the fleet restart finishes (or there were no services), and still restarts on the next hermes update if the marker or a skewed latest.json is there. Plain hermes only warns.

Part 3 is yours. Thanks for the constraints.

Copilot AI lite review requested due to automatic review settings August 26, 2026 06:44

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

@alt-glitch alt-glitch added type/bug Something isn't working P1 High — major feature broken, no workaround comp/cli CLI entry point, hermes_cli/, setup wizard area/install-update Installer, updater, packaging, wheels, doctor sweeper:risk-compatibility Sweeper risk: may break existing users, config, migrations, defaults, or upgrades labels Aug 26, 2026
An interrupted hermes update after git pull advanced HEAD never
restarted running gateways, and the next update said "Already up to
date" and skipped the fleet. Persist a HERMES_HOME fleet_restart_pending
marker after HEAD moves, clear it only when restart completes (or
nothing was running), and catch up on the next hermes update even when
git is current — also when latest.json records a stale runtime SHA.

Co-authored-by: GokayAI <[email protected]>
@teknium1

Copy link
Copy Markdown
Collaborator

Closing — this fix landed on main, merged in the final backend-cluster salvage PR #95980 (merge 00988f3), cherry-picked with your authorship preserved. This delivers parts 1+2 of #95294.

Thanks @gokay-ai for the fleet_restart_pending marker discipline — writing it right after a successful pull and treating catch-up restart as mandatory work even when git says "Already up to date" closes exactly the two-day stale-gateway window from the incident report. Rebase-checked against 27385e5 / 306a096 / adb29d8; the marker lifecycle suite is green in CI.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/install-update Installer, updater, packaging, wheels, doctor comp/cli CLI entry point, hermes_cli/, setup wizard P1 High — major feature broken, no workaround sweeper:risk-compatibility Sweeper risk: may break existing users, config, migrations, defaults, or upgrades type/bug Something isn't working

Projects

None yet

5 participants