-
-
Notifications
You must be signed in to change notification settings - Fork 80.7k
[Bug]: Deep-profile release gate treats instrumented RSS as baseline-eligible #102888
Copy link
Copy link
Closed
Closed
Copy link
Labels
P2Normal backlog priority with limited blast radius.Normal backlog priority with limited blast radius.clawsweeper:linked-pr-openClawSweeper found an open linked pull request for this issue.ClawSweeper found an open linked pull request for this issue.clawsweeper:no-new-fix-prClawSweeper does not recommend queueing a new automated fix PR for this issue.ClawSweeper does not recommend queueing a new automated fix PR for this issue.clawsweeper:source-reproClawSweeper found a high-confidence source-level issue reproduction.ClawSweeper found a high-confidence source-level issue reproduction.impact:otherThis issue has meaningful maintainer-visible impact outside the owned taxonomy.This issue has meaningful maintainer-visible impact outside the owned taxonomy.issue-rating: 🦞 diamond lobsterVery strong issue quality with high-confidence source-level or clear reproduction.Very strong issue quality with high-confidence source-level or clear reproduction.maintainerMaintainer-authored PRMaintainer-authored PR
Description
Metadata
Metadata
Assignees
Labels
P2Normal backlog priority with limited blast radius.Normal backlog priority with limited blast radius.clawsweeper:linked-pr-openClawSweeper found an open linked pull request for this issue.ClawSweeper found an open linked pull request for this issue.clawsweeper:no-new-fix-prClawSweeper does not recommend queueing a new automated fix PR for this issue.ClawSweeper does not recommend queueing a new automated fix PR for this issue.clawsweeper:source-reproClawSweeper found a high-confidence source-level issue reproduction.ClawSweeper found a high-confidence source-level issue reproduction.impact:otherThis issue has meaningful maintainer-visible impact outside the owned taxonomy.This issue has meaningful maintainer-visible impact outside the owned taxonomy.issue-rating: 🦞 diamond lobsterVery strong issue quality with high-confidence source-level or clear reproduction.Very strong issue quality with high-confidence source-level or clear reproduction.maintainerMaintainer-authored PRMaintainer-authored PR
Type
Fields
Priority
None yet
Bug type
Behavior bug (incorrect release-gate state without a product failure)
Beta release blocker
No. This is release infrastructure, not plugin compatibility.
Summary
The OpenClaw Performance workflow treats profiler-inflated CPU/RSS thresholds as baseline-eligible release failures even when Kova explicitly marks the measurements as profiling-affected and baseline-ineligible.
Steps to reproduce
OpenClaw Performancefor candidatedcee1da876e683277c0092e8efdaf019e4dcc303with thereleaseprofile,deep_profile=true, andfail_on_regression=true.profilingEnabled: trueprofilingAffectsResourceMeasurements: trueprofilingBaselineEligible: falseExpected behavior
The trusted report adapter should tolerate a non-zero Kova verdict only when every blocking failure maps one-to-one to a profiled record whose violations are exclusively profiling-affected CPU/RSS metrics. Functional, latency, auth, harness, timeout, error, and baseline-regression failures must remain blocking.
Actual behavior
The adapter accepts only filtered
PARTIALreports, so Kova'sDO_NOT_SHIPexit remains blocking even when the report explicitly says the only failed measurements are distorted by instrumentation and are not baseline-eligible.OpenClaw version
2026.7.1-beta.3candidate atdcee1da876e683277c0092e8efdaf019e4dcc303Operating system
GitHub Actions Ubuntu 24.04
Install method
OpenClaw Performance release workflow
Model
Mock OpenAI-compatible provider for the deep-profile lane; the sibling live GPT-5.5 lane passed.
Provider / routing chain
OpenClaw Performance -> Kova -> OpenClaw CLI agent path -> mock OpenAI-compatible provider
Additional provider/model setup details
The deep-profile lane uses Kova profiling instrumentation. The corresponding normal mock-provider lane and live-provider lane passed on the same candidate.
Logs
Screenshots, recordings, and evidence
The retry artifact's release report records
profilingAffectsResourceMeasurements=true,profilingBaselineEligible=false, and onlypeakRssMb/resourceByRole.*.peakRssMbviolations.Impact and severity
Affected: maintainers running instrumented release performance checks.
Severity: high operational impact during release closeout; no demonstrated product regression.
Frequency: reproduced in two consecutive deep-profile runs.
Consequence: a valid release candidate is blocked and the same expensive lane is rerun without changing product behavior.
Additional information
Pinned Kova source defines profiling as affecting resource measurements and makes profiled records baseline-ineligible. The OpenClaw adapter should enforce that contract narrowly and fail closed for every other gate card or violation kind.