-
-
Notifications
You must be signed in to change notification settings - Fork 80.7k
[Bug]: Release performance CI succeeds when report publishing fails #103125
Copy link
Copy link
Closed
Labels
P2Normal backlog priority with limited blast radius.Normal backlog priority with limited blast radius.bugSomething isn't workingSomething isn't workingclawsweeper:fix-shape-clearClawSweeper found a clear likely implementation shape for this issue.ClawSweeper found a clear likely implementation shape for this issue.clawsweeper:linked-pr-openClawSweeper found an open linked pull request for this issue.ClawSweeper found an open linked pull request for this issue.clawsweeper:needs-maintainer-reviewClawSweeper marked this issue as needing maintainer review before automation.ClawSweeper marked this issue as needing maintainer review before automation.clawsweeper:no-new-fix-prClawSweeper does not recommend queueing a new automated fix PR for this issue.ClawSweeper does not recommend queueing a new automated fix PR for this issue.clawsweeper:source-reproClawSweeper found a high-confidence source-level issue reproduction.ClawSweeper found a high-confidence source-level issue reproduction.impact:otherThis issue has meaningful maintainer-visible impact outside the owned taxonomy.This issue has meaningful maintainer-visible impact outside the owned taxonomy.issue-rating: 🦞 diamond lobsterVery strong issue quality with high-confidence source-level or clear reproduction.Very strong issue quality with high-confidence source-level or clear reproduction.maintainerMaintainer-authored PRMaintainer-authored PR
Description
Metadata
Metadata
Assignees
Labels
P2Normal backlog priority with limited blast radius.Normal backlog priority with limited blast radius.bugSomething isn't workingSomething isn't workingclawsweeper:fix-shape-clearClawSweeper found a clear likely implementation shape for this issue.ClawSweeper found a clear likely implementation shape for this issue.clawsweeper:linked-pr-openClawSweeper found an open linked pull request for this issue.ClawSweeper found an open linked pull request for this issue.clawsweeper:needs-maintainer-reviewClawSweeper marked this issue as needing maintainer review before automation.ClawSweeper marked this issue as needing maintainer review before automation.clawsweeper:no-new-fix-prClawSweeper does not recommend queueing a new automated fix PR for this issue.ClawSweeper does not recommend queueing a new automated fix PR for this issue.clawsweeper:source-reproClawSweeper found a high-confidence source-level issue reproduction.ClawSweeper found a high-confidence source-level issue reproduction.impact:otherThis issue has meaningful maintainer-visible impact outside the owned taxonomy.This issue has meaningful maintainer-visible impact outside the owned taxonomy.issue-rating: 🦞 diamond lobsterVery strong issue quality with high-confidence source-level or clear reproduction.Very strong issue quality with high-confidence source-level or clear reproduction.maintainerMaintainer-authored PRMaintainer-authored PR
Type
Fields
Priority
None yet
Bug type
Behavior bug (incorrect output/state without crash)
Beta release blocker
No
Summary
Release-profile performance CI can report success even when its required Clawgrit baseline report was never published.
Steps to reproduce
OpenClaw Performanceworkflow withfail_on_regression=true.Observed in run https://github.com/openclaw/openclaw/actions/runs/29051458125: the report push failed authentication five times, then the job exited successfully with an optional-publish warning.
Expected behavior
Scheduled and release/full performance gates must fail when a required baseline report cannot be published. A manually dispatched non-release run may remain advisory because it is not authoritative release evidence.
Actual behavior
Run 29051458125 completed successfully despite
Invalid username or token, five failed pushes, and no published report for the tested SHA.OpenClaw version
4da2ee3514fa50b7f0233053162f5f0f3f39896cOperating system
Ubuntu 24.04 GitHub Actions runner
Install method
Repository checkout in GitHub Actions
Model
Mock provider performance lane
Provider / routing chain
OpenClaw performance workflow -> Kova mock-provider evaluation -> Clawgrit reports repository
Additional provider/model setup details
profile=release,repeat=3, andfail_on_regression=true.Logs
Screenshots, recordings, and evidence
https://github.com/openclaw/openclaw/actions/runs/29051458125/job/86232944434
Impact and severity
Additional information
The publisher should run on a fresh artifact-consuming runner, keep the target checkout away from the report credential, validate report paths, serialize/retry concurrent writers, and expose the report URL only after a successful push.