Skip to content

fix(agent-sre): evaluate burn alerts over their declared windows - #4210

Merged
MohammadHaroonAbuomar merged 2 commits into
microsoft:mainfrom
1aifanatic:contrib/sre-alert-windows
Oct 2, 2026
Merged

MohammadHaroonAbuomar merged 2 commits into
microsoft:mainfrom
1aifanatic:contrib/sre-alert-windows

Conversation

@1aifanatic

@1aifanatic Naveen Chatlapalli (1aifanatic) commented Oct 2, 2026 •

Copy link
Copy Markdown
Contributor

Description

ErrorBudget declares 24-hour burn-rate alerts, but firing_alerts() calls burn_rate() with its one-hour default. An error two hours ago appears in the reported 24-hour burn rate while neither alert fires.

Evaluate each alert using its own window_seconds. Thresholds and burn-rate arithmetic remain unchanged.

Validation

The regression fails before the fix, covers a two-hour-old error, and confirms expiration beyond 24 hours. Objective tests: 21 passed. Full package run: 1,495 passed, 3 skipped, 1 known baseline failure (the separate Windows benchmark clock bug).

All regressions were reproduced on origin/main 406ddd4d before the production change. Whitespace checks pass. Ruff passes on the changed files. Changed-line spelling passes with the existing API identifier Deduplicator allowed in the temporary check input.

Scope: the existing Agent-SRE source tree, which remains exercised by repository CI. Combined validation of these six independent SRE fixes: 1,505 passed, 3 skipped on Windows/Python 3.12.

The Agent-SRE changelog now records that errors from one to 24 hours ago can correctly raise SLO status to WARNING or CRITICAL when the configured alert window includes them. Documentation link and frontmatter checks pass after this addition.

Type of Change

  • Bug fix (non-breaking correction of existing behavior)

Package(s) Affected

  • agent-sre

Checklist

  • Changed code follows the project style checks; the exact validation scope is recorded above.
  • Regression tests or existing package tests verify the change, as detailed above.
  • The independent full package run has no failures: one pre-existing Windows benchmark failure remains, as documented above. Focused tests pass; the combined run with fix(agent-sre): measure benchmark duration with a monotonic clock #4206 passes (1,505 passed, 3 skipped).
  • Documentation is updated where needed; the behavior and compatibility implications are described above.
  • The Microsoft CLA check has passed for this contribution.

Attribution & Prior Art

  • Related prior contributions are credited below; this PR introduces no unattributed code from external projects.
  • External design influences, where applicable, are identified below.

Prior art / related projects: Uses the existing Agent-SRE implementation and standard library operations. No code was copied or adapted from an external project.

AI Assistance

I reviewed the specific changes in this diff before this PR was opened.

Codex assisted with implementation, regression tests, and local validation under my direction.

  • I reviewed this diff before submission; its behavior, rationale, and tradeoffs are documented above.
  • Tests and verification appropriate to this change were run, with limitations disclosed above.
  • Submission followed my direction and my review of these specific changes.
  • No AI-generated reviews of other contributors' PRs were posted as part of this contribution.

IP, Patents, and Licensing

  • This change uses the existing project implementation and ordinary software techniques; no proprietary or patent-specific technique is introduced.
  • Understanding or using this change requires no NDA or separate licensing agreement.
  • This contribution remains under the repository's MIT License and introduces no third-party source code or additional license terms.

Related Issues

Newly reproduced defect; the reproduction and regression coverage are described above.

@azure-pipelines

Copy link
Copy Markdown
Azure Pipelines:
There may be pipelines that require an authorized user to comment /azp run to run.

@github-actions github-actions Bot added size/S Small PR (< 50 lines) tests agent-sre agent-sre package labels Oct 2, 2026
@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown

🟡 Contributor Check: MEDIUM

Check Result
Profile MEDIUM
Credential LOW
Overall MEDIUM

Automated check by AGT Contributor Check.

@github-actions github-actions Bot added the needs-review:MEDIUM Contributor check flagged MEDIUM risk label Oct 2, 2026
@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown

PR Review Summary

Check Status Details
🔍 Code Review ⚠️ Missing No current-run comment
🛡️ Security Scan ⚠️ Missing No current-run comment
🔄 Breaking Changes ⚠️ Missing No current-run comment
📝 Docs Sync ⚠️ Missing No current-run comment
🧪 Test Coverage ⚠️ Missing No current-run comment

Verdict: ⚠️ AI review incomplete; ready for human review

AI review comments are untrusted advisory output. The summary reports workflow-generated completion status only, not model-authored pass/fail claims.

@MohammadHaroonAbuomar

Copy link
Copy Markdown
Collaborator

Verified in code and locally: a two-hour-old error produced no firing alert on main because the burn rate was evaluated over the one-hour default; each alert now uses its declared window, so SLO status reaches WARNING or CRITICAL for one-to-24-hour-old errors, which is the intended change and worth a changelog line. Sign-off is present and CI is approved and running.

Before I approve, two process items that apply to all nine PRs in this batch: please use the repository template with its Checklist, Attribution, AI Assistance and IP sections, and tick the attestations in your own words. The AI note says Codex prepared and submitted the changes at your request; CONTRIBUTING asks that no PR be submitted by an agent without a human reviewing the specific changes, so one sentence confirming you reviewed this diff before it was opened settles it. Once that and the gated checks are green I will approve and merge.

@1aifanatic

Copy link
Copy Markdown
Contributor Author

I reviewed the specific changes in this diff before the PR was opened. I have updated the description to use the repository template sections, completed the attestations with the validation scope and limitations, and clarified the AI-assistance note. Commit 7da0e6b adds the requested Agent-SRE changelog entry explaining the WARNING/CRITICAL status correction for errors within the declared alert window. Documentation link and frontmatter checks pass.

@github-actions github-actions Bot added the documentation Improvements or additions to documentation label Oct 2, 2026

@MohammadHaroonAbuomar MohammadHaroonAbuomar left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving at 7da0e6b. Burn alerts evaluate errors over each alert's declared window instead of the default hour; new test fails on main and passes here; changelog entry added; ruff clean. Description uses the repository template with the attestations completed, and the author confirmed reviewing the diff before opening the PR. All 13 pull_request workflow runs on this head completed successfully. Commits are signed off.

@MohammadHaroonAbuomar
MohammadHaroonAbuomar merged commit 6d16e24 into microsoft:main Oct 2, 2026
135 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

agent-sre agent-sre package documentation Improvements or additions to documentation needs-review:MEDIUM Contributor check flagged MEDIUM risk size/S Small PR (< 50 lines) tests

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants