Skip to content

fix(ci): verify live provider traffic in performance runs#103073

Merged
vincentkoc merged 2 commits into
mainfrom
fix/kova-workflow-evidence-truth
Jul 9, 2026
Merged

fix(ci): verify live provider traffic in performance runs#103073
vincentkoc merged 2 commits into
mainfrom
fix/kova-workflow-evidence-truth

Conversation

@vincentkoc

@vincentkoc vincentkoc commented Jul 9, 2026

Copy link
Copy Markdown
Member

Fixes #103063

What Problem This Solves

Fixes an issue where release performance runs could be configured as live while silently executing only the last requested scenario filter and using mock provider authentication. OpenClaw also did not emit the provider-request timeline event needed to independently prove real provider traffic.

Why This Change Was Made

The performance workflow now uses Kova's comma-delimited include contract, makes the live lane honor its explicit authentication mode, and validates the exact planned and reported scenario, repeat, authentication, and provider-evidence coverage. The embedded model-call boundary now emits one bounded, deduplicated provider.request timeline event for each completed or failed provider call.

User Impact

Release validation can no longer report a live provider performance pass without exact scenario coverage and observed live provider requests. Runtime model behavior is unchanged outside opt-in diagnostics timeline output.

Evidence

  • Blacksmith Testbox tbx_01kx43f6km9v03dbw30my07m5j: exact-head focused runtime and workflow tests passed, 43/43.
  • Exact-head pnpm check:changed passed: core and core-test tsgo, core and scripts lint, and repository guards.
  • Fresh structured autoreview returned no findings (patch is correct, confidence 0.86).
  • Hosted PR gates provide the final landing proof.

@vincentkoc vincentkoc self-assigned this Jul 9, 2026
@openclaw-barnacle openclaw-barnacle Bot added scripts Repository scripts agents Agent runtime and tooling size: L maintainer Maintainer-authored PR labels Jul 9, 2026
@clawsweeper

clawsweeper Bot commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

Codex review: stale review; fresh review needed.

Summary
The latest durable ClawSweeper review was for head 9ba6f062b0af0e9527d45c5883c573dcadb01a96, but the PR head is now c558d465b357e73542a37e3edab44003b56608ee. Its old verdict and PR readiness labels are no longer current.

Next step
Run or wait for a fresh ClawSweeper review on the current PR head.

Review history (5 earlier review cycles)
  • reviewed 2026-07-09T18:45:16.074Z sha 34922c2 :: needs maintainer review before merge. :: none
  • reviewed 2026-07-09T18:55:48.556Z sha 9ba6f06 :: needs maintainer review before merge. :: none
  • reviewed 2026-07-09T19:02:26.698Z sha 9ba6f06 :: needs maintainer review before merge. :: none
  • reviewed 2026-07-09T19:09:59.614Z sha 9ba6f06 :: needs maintainer review before merge. :: none
  • reviewed 2026-07-09T19:23:56.757Z sha 9ba6f06 :: needs maintainer review before merge. :: none

@clawsweeper clawsweeper Bot added rating: 🐚 platinum hermit Good normal PR readiness with ordinary maintainer review expected. status: 👀 ready for maintainer look ClawSweeper has no concrete contributor-facing blocker left for this PR. P2 Normal backlog priority with limited blast radius. merge-risk: 🚨 automation 🚨 May affect CI, automerge, proof capture, label sync, or maintainer automation. labels Jul 9, 2026
@vincentkoc
vincentkoc force-pushed the fix/kova-workflow-evidence-truth branch from 34922c2 to 9ba6f06 Compare July 9, 2026 18:50
@vincentkoc
vincentkoc marked this pull request as ready for review July 9, 2026 18:51
@vincentkoc vincentkoc closed this Jul 9, 2026
@vincentkoc vincentkoc reopened this Jul 9, 2026
@vincentkoc
vincentkoc requested a review from a team as a code owner July 9, 2026 19:27
@openclaw-barnacle openclaw-barnacle Bot added docs Improvements or additions to documentation gateway Gateway runtime extensions: meta Extension: meta size: XL and removed size: L labels Jul 9, 2026
@github-actions github-actions Bot added the dependencies-changed PR changes dependency-related files label Jul 9, 2026
@github-actions

github-actions Bot commented Jul 9, 2026

Copy link
Copy Markdown
Contributor

Dependency graph guard cleared

This PR no longer has blocked dependency graph changes. A future dependency graph change requires a fresh /allow-dependencies-change comment after the guard blocks that new head SHA.

  • Current SHA: c558d465b357e73542a37e3edab44003b56608ee

@vincentkoc
vincentkoc force-pushed the fix/kova-workflow-evidence-truth branch from 84e14d4 to c558d46 Compare July 9, 2026 19:30
@openclaw-barnacle openclaw-barnacle Bot added size: L and removed docs Improvements or additions to documentation gateway Gateway runtime extensions: meta Extension: meta size: XL labels Jul 9, 2026
@github-actions github-actions Bot removed the dependencies-changed PR changes dependency-related files label Jul 9, 2026
@clawsweeper clawsweeper Bot removed rating: 🐚 platinum hermit Good normal PR readiness with ordinary maintainer review expected. merge-risk: 🚨 automation 🚨 May affect CI, automerge, proof capture, label sync, or maintainer automation. status: 👀 ready for maintainer look ClawSweeper has no concrete contributor-facing blocker left for this PR. labels Jul 9, 2026
@vincentkoc
vincentkoc merged commit ee9d9ea into main Jul 9, 2026
117 of 122 checks passed
@vincentkoc
vincentkoc deleted the fix/kova-workflow-evidence-truth branch July 9, 2026 19:39
@vincentkoc

Copy link
Copy Markdown
Member Author

Merged via squash.

github-actions Bot pushed a commit to Desicool/openclaw that referenced this pull request Jul 10, 2026
…03073)

* fix(diagnostics): emit provider request timeline events

* fix(ci): verify Kova live provider evidence
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

agents Agent runtime and tooling maintainer Maintainer-authored PR P2 Normal backlog priority with limited blast radius. scripts Repository scripts size: L

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: diagnostics timeline omits provider request events

1 participant