Skip to content

fix(ci): always upload recipe-evidence report so comment gate works#1292

Merged
njhensley merged 2 commits into
NVIDIA:mainfrom
njhensley:fix/recipe-evidence-ci
Jun 10, 2026
Merged

fix(ci): always upload recipe-evidence report so comment gate works#1292
njhensley merged 2 commits into
NVIDIA:mainfrom
njhensley:fix/recipe-evidence-ci

Conversation

@njhensley

Copy link
Copy Markdown
Member

Summary

Fix the recipe-evidence comment workflow, which has failed on every run since the gate was introduced with Artifact not found for name: recipe-evidence-report.

Motivation / Context

recipe-evidence.yaml writes its report to ${{ runner.temp }}/report.md, but its upload step was gated on hashFiles(format('{0}/report.md', runner.temp)) != ''. hashFiles() only matches files inside GITHUB_WORKSPACE, and runner.temp is outside it — so the expression always returned '', the guard was always false, and the upload was always skipped. The companion recipe-evidence-comment.yaml workflow then unconditionally tried to download an artifact that never existed and hard-failed.

Confirmed against run history: the last 12 successful "Recipe Evidence: Verify" runs all show Upload evidence report → skipped, and every triggered comment run failed at the download step. Broken since #1065 (2026-05-28).

Fixes: N/A
Related: #1065

Type of Change

  • Bug fix (non-breaking change that fixes an issue)
  • New feature (non-breaking change that adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Documentation update
  • Refactoring (no functional changes)
  • Build/CI/tooling

Component(s) Affected

  • Other: GitHub Actions workflows (.github/workflows/recipe-evidence*.yaml)

Implementation Notes

  • recipe-evidence.yaml — dropped the broken hashFiles guard. The upload step now runs on if: always() with if-no-files-found: ignore. upload-artifact reads the absolute runner.temp path without issue (only hashFiles couldn't see it), so the report now actually uploads, and a genuinely-absent report is a quiet no-op rather than an error.
  • recipe-evidence-comment.yaml — added continue-on-error: true to the download step. For the legitimate case where verify fails before writing a report (no artifact), the warning-only comment gate no longer turns red; it falls through to the existing [[ ! -s report.md ]] guard that skips posting.

Testing

yamllint -c .yamllint.yaml \
  .github/workflows/recipe-evidence.yaml \
  .github/workflows/recipe-evidence-comment.yaml   # exit 0

Full end-to-end validation requires a live recipes/** PR run on GitHub: "Recipe Evidence: Verify" should show Upload evidence report → success, and "Recipe Evidence: Comment" should post the sticky comment instead of failing at download. No Go code changed, so make test/lint gates are not exercised by this change.

Risk Assessment

  • Low — Isolated CI-only change, easy to revert. The affected gate is warning-only and never blocks merge.

Rollout notes: N/A — takes effect on the next recipes/** PR.

Checklist

  • Tests pass locally (make test with -race) — N/A, no Go changes
  • Linter passes (yamllint, exit 0)
  • I did not skip/disable tests to make CI green
  • I added/updated tests for new functionality — N/A (CI workflow fix)
  • I updated docs if user-facing behavior changed — N/A (no user-facing behavior change)
  • Changes follow existing patterns in the codebase
  • Commits are cryptographically signed (git commit -S)

@njhensley njhensley requested a review from a team as a code owner June 10, 2026 16:49
@njhensley njhensley added area/ci theme/ci-dx CI pipelines, developer experience, and build tooling labels Jun 10, 2026
@njhensley njhensley enabled auto-merge (squash) June 10, 2026 16:52
@coderabbitai

coderabbitai Bot commented Jun 10, 2026

Copy link
Copy Markdown

Review Change Stack

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Enterprise

Run ID: 1b8089f4-9ce7-403b-aedd-ea2683d32cfd

📥 Commits

Reviewing files that changed from the base of the PR and between 8f71165 and 018a715.

📒 Files selected for processing (2)
  • .github/workflows/recipe-evidence-comment.yaml
  • .github/workflows/recipe-evidence.yaml

📝 Walkthrough

Walkthrough

Two GitHub Actions workflows were updated to improve resilience around evidence report artifact availability. The recipe-evidence.yaml workflow replaced a faulty hashFiles(...) conditional guard in the artifact upload step with if: ${{ always() }} and if-no-files-found: ignore, allowing unconditional upload attempts that become no-ops when the report is missing. The recipe-evidence-comment.yaml workflow added continue-on-error: true to its artifact download step, preventing the entire workflow from failing when the report artifact is unavailable. Both changes include explanatory comments documenting the rationale for these guards.

Estimated code review effort

🎯 2 (Simple) | ⏱️ ~8 minutes

🚥 Pre-merge checks | ✅ 4
✅ Passed checks (4 passed)
Check name Status Explanation
Title check ✅ Passed The title precisely summarizes the main change: fixing the upload of the recipe-evidence report artifact to enable the comment workflow gate to function correctly.
Description check ✅ Passed The description is comprehensive and directly related to the changeset, explaining the root cause, implementation details, testing approach, and risk assessment.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests

Comment @coderabbitai help to get the list of available commands and usage tips.

@njhensley njhensley merged commit 484c61a into NVIDIA:main Jun 10, 2026
31 checks passed
@njhensley njhensley deleted the fix/recipe-evidence-ci branch June 23, 2026 16:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/ci size/S theme/ci-dx CI pipelines, developer experience, and build tooling

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants