Skip to content

chore(skills): Expand test-guidelines and drop stale deps#3807

Merged
buenaflor merged 3 commits into
mainfrom
buenaflor/docs/test-guidelines-tautology
Jun 30, 2026
Merged

chore(skills): Expand test-guidelines and drop stale deps#3807
buenaflor merged 3 commits into
mainfrom
buenaflor/docs/test-guidelines-tautology

Conversation

@buenaflor

@buenaflor buenaflor commented Jun 30, 2026

Copy link
Copy Markdown
Contributor

Two small skill-maintenance changes.

test-guidelines gains two rules, each with a GOOD/AVOID example:

  • Assertions — assert the literal expected value, not the same constant the production code uses to set it. A shared constant makes the assertion tautological: it keeps passing even if the constant holds the wrong value. Using the constant as the lookup key is fine; pin the expected value as a literal.
  • What to Test — test the behavior your change owns, not guarantees already owned and covered by a shared helper, type, serializer, or framework. Includes the caveat that delegated behavior still deserves a caller-level test when it is load-bearing for your change's own contract (precedence, preserving user input, public API promises, regressions).

agents.toml drops two redundant entries — create-pr and skill-creator — which are aliases of the pr-writer and skill-writer skills already listed.

@github-actions

github-actions Bot commented Jun 30, 2026

Copy link
Copy Markdown
Contributor

Semver Impact of This PR

None (no version bump detected)

📋 Changelog Preview

This is how your changes will appear in the changelog.
Entries from this PR are highlighted with a left border (blockquote style).


Features

Dart

  • Add array attributes to telemetry by buenaflor in #3778
  • Mark span streaming API as non-experimental by buenaflor in #3756

Enhancements

  • (flutter) Support int64 values from sentry-native by buenaflor in #3760

Dependencies

Deps

  • chore(deps): update Native SDK to v0.15.2 by github-actions in #3785
  • chore(deps): update Android SDK to v8.45.0 by github-actions in #3790
  • chore(deps): update Native SDK to v0.15.1 by github-actions in #3757

Internal Changes

  • (flutter) Remove flaky frames measurement tests by buenaflor in #3783
  • (skills) Expand test-guidelines and drop stale deps by buenaflor in #3807
  • Add AI Use section to CONTRIBUTING.md by christophaigner in #3803

🤖 This preview updates automatically when you update the PR.

@buenaflor
buenaflor marked this pull request as ready for review June 30, 2026 09:55
@buenaflor
buenaflor requested a review from denrase as a code owner June 30, 2026 09:55
Copilot AI review requested due to automatic review settings June 30, 2026 09:55
Comment thread .agents/skills/test-guidelines/SKILL.md Outdated

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the test-guidelines agent skill documentation to prevent tautological assertions in tests by requiring literal expected values when verifying emitted telemetry/attributes.

Changes:

  • Adds an explicit rule in the Assertions section: expected values must be pinned as literals rather than reusing the same production constant being validated.
  • Adds a “GOOD vs AVOID” example demonstrating the tautological-assertion pitfall and the preferred pattern.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

Comment thread .agents/skills/test-guidelines/SKILL.md Outdated
@buenaflor buenaflor changed the title docs: Add tautological-assertion rule to test-guidelines chore(skills): Add test-assertion guideline and drop stale skill deps Jun 30, 2026
buenaflor and others added 2 commits June 30, 2026 12:12
Document that a test must pin the expected value as a literal rather than
the same constant the production code uses to produce it. Sharing one
constant across production and test makes the assertion tautological: it
passes even when the constant holds the wrong value.

Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>
These were consolidated upstream into pr-writer / skill-writer (already
declared), so getsentry/skills no longer exposes them as standalone
skills. Their presence made `dotagents install` fail during resolution.

Co-Authored-By: Claude Opus 4.8 (1M context) <[email protected]>
@buenaflor
buenaflor force-pushed the buenaflor/docs/test-guidelines-tautology branch 2 times, most recently from b6f4278 to 051a20e Compare June 30, 2026 12:12
@buenaflor buenaflor changed the title chore(skills): Add test-assertion guideline and drop stale skill deps chore(skills): Expand test-guidelines and drop stale deps Jun 30, 2026
Test the behavior a change introduces, not the internal guarantee of
a shared helper already covered by its own test. Distinguishes a
load-bearing contract from a helper's guarantee to avoid discouraging
integration tests.

Co-Authored-By: Claude Opus 4.8 <[email protected]>
Comment thread .agents/skills/test-guidelines/SKILL.md
@buenaflor
buenaflor merged commit 7d034fd into main Jun 30, 2026
18 checks passed
@buenaflor
buenaflor deleted the buenaflor/docs/test-guidelines-tautology branch June 30, 2026 12:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants