Skip to content

test(qa): clean up smoke taxonomy profile#96320

Merged
RomneyDa merged 1 commit into
mainfrom
codex/qa-taxonomy-profile-cleanup
Jun 24, 2026
Merged

test(qa): clean up smoke taxonomy profile#96320
RomneyDa merged 1 commit into
mainfrom
codex/qa-taxonomy-profile-cleanup

Conversation

@RomneyDa

Copy link
Copy Markdown
Member

What Problem This Solves

PR #94291 should stay focused on adding QA smoke to CI. During that work, the smoke profile exposed a separate taxonomy problem: smoke-ci was selecting long-running QA scenarios through broad maturity categories, and a few coverage IDs were named after specific test shapes instead of reusable behavior.

Why This Change Was Made

  • Removes long-running category selections from smoke-ci so the profile no longer selects the runtime soak, long-context cache, first-hour 20-turn, or memory dreaming sweep scenarios.
  • Renames overly specific coverage IDs:
    • runtime.soak-100 -> runtime.long-run-stability
    • runtime.first-hour-20 -> runtime.multi-turn-continuity
    • docker.e2e -> docker.runtime-validation
  • Updates QA docs and CLI tests to use a category that remains in the narrowed smoke profile.

User Impact

Maintainer CI smoke stays focused on faster deterministic coverage. Release/all profile taxonomy still keeps the underlying categories and long-run scenarios available outside the PR smoke slice.

Evidence

  • git diff --check
  • node --import tsx --input-type=module <taxonomy/source validation>
  • node --import tsx --input-type=module <smoke profile selection check>: smokeCategoryCount=30, smokeScenarioCount=80, selectedSlowScenarios=[]
  • node scripts/run-vitest.mjs extensions/qa-lab/src/cli.runtime.test.ts extensions/qa-lab/src/cli.test.ts extensions/qa-lab/src/scenario-catalog.test.ts extensions/qa-lab/src/coverage-report.test.ts
  • pnpm check:docs
  • pnpm openclaw qa coverage --json

@openclaw-barnacle openclaw-barnacle Bot added docs Improvements or additions to documentation extensions: qa-lab size: XS maintainer Maintainer-authored PR labels Jun 24, 2026
@RomneyDa
RomneyDa merged commit 9666db6 into main Jun 24, 2026
115 of 117 checks passed
@RomneyDa
RomneyDa deleted the codex/qa-taxonomy-profile-cleanup branch June 24, 2026 07:43
github-actions Bot pushed a commit to Desicool/openclaw that referenced this pull request Jun 25, 2026
QiuYuang pushed a commit to QiuYuang/openclaw that referenced this pull request Jul 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

docs Improvements or additions to documentation extensions: qa-lab maintainer Maintainer-authored PR size: XS

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant