Repository navigation
Open
Labels
documentationImprovements or additions to documentationImprovements or additions to documentation
Description
Living document. Pinned, and linked from the README.
Now — the contract
The keystone is making the judge's reasoning auditable rather than merely visible, then exposing a stable contract so this can be embedded rather than only run.
- Evidence-backed dimensions: cited spans + unsupported #1 Evidence-backed dimensions: cited spans + unsupported
- Stable JSON output contract + documented library API #2 Stable JSON output contract + documented library API
- Regression suite for prompt and rule changes #5 Regression suite for prompt and rule changes
- Judge does not abstain on a self-contradictory spec, and over-abstains on good ones #19 Judge does not abstain on a self-contradictory spec, and over-abstains on good ones
- The compact digest is built from truncated text, so the judge never sees the requirements #29 The compact digest is built from truncated text, so the judge never sees the requirements
- Compact judges get one attempt; full-prompt judges get two #30 Compact judges get one attempt; full-prompt judges get two
- Support .github/instructions/*.instructions.md with applyTo frontmatter #33 Read Copilot path-specific instructions (
.github/instructions/*.instructions.md) as agent context (raised by @sabelaV) - A source can be truncated below the point of being worth sending #35 A source can be truncated below the point of being worth sending (raised on the 0.6.0 thread)
Next — the envelope, not the router
- Source-agnostic input: read AGENTS.md, CLAUDE.md and other context formats, not just
.specify/#16 Source-agnostic input: read AGENTS.md, CLAUDE.md and other context formats, not just .specify/ - Budget envelope output: constraint table, default tier, escalation triggers, confidence #3 Constraint table, default tier, escalation triggers
- Confidence: finer than three states, without manufacturing precision #26 Confidence: finer than three states, without manufacturing precision
- Ship SpecJudge as a spec-kit extension: one command, one hook #27 Ship SpecJudge as a spec-kit extension: one command, one hook
- Support any OpenAI-compatible endpoint as the judge #4 Support any OpenAI-compatible endpoint as the judge
- cli.py and api.analyze duplicate the pipeline, and drift in silence #38 cli.py and api.analyze duplicate the pipeline, and drift in silence
Quick wins — good first issues, no Python needed
- Warn when catalog pricing data is stale #6 Warn when catalog pricing data is stale
- Add a worked example to the README #7 Add a worked example to the README
- The "thin specs" warning is too quiet for how much it matters #11 The "thin specs" warning is too quiet (raised by @pete-lewis83)
- Judge Model Recommendations #23 Recommend local judge models, with measured numbers (raised by @rmarable)
Metadata
Metadata
Assignees
Labels
documentationImprovements or additions to documentationImprovements or additions to documentation
Activity