Cognometric Fingerprint
Specification.
The first open reference specification for measuring cognitive state in language models. Three axes (K, C, D). Seven fault kinds. Canonical JSON fingerprint format. Patent-anchored. Open-licensed. Vendor-neutral.
K, C, D — the basis of every cognometric fingerprint.
The spec defines three orthogonal axes along which any calibrated cognometric detector can be characterized. Together they form the canonical fingerprint: a 7-field descriptor that any safety detector — vendor or open-source — can emit alongside its weights.
Critical-feature index
The minimum feature-subset cardinality at which detection achieves phase-transition lift. K=1 is the canonical observation across nine instruments.
Calibration profile
Baseline AUC, AUC at critical_K, delta lift, substrate variance. The numbers that distinguish a real measurement from a benchmark report.
Domain transfer
Per-substrate AUC ablation. Within-family transfer, cross-vendor transfer, cross-alignment-regime null. Where the detector holds. Where it doesn't.
The cognitive failure modes the spec recognizes.
Every cognometric fingerprint declares which of the seven canonical faults its instrument targets. The list is non-exhaustive — extensions are permitted — but every certified detector must declare its fault scope.
| fault | scope | canonical instrument |
|---|---|---|
| hallucination | fluent unsupported claim | styxx instrument #1 |
| refusal | declining when capability available | styxx #2 |
| tool-call drift | wrong tool / wrong slot / hallucinated tool | styxx #3 |
| sycophancy | yielding without evidence | styxx #4 |
| conversation-loop | perseveration across turns | styxx #5 |
| deception-signature | instruction-induced dishonesty register | styxx #6 |
| plan-action gap | declared intention vs executed action | styxx #7 |
Plus overconfidence (#8) and goal-drift (#9) — registered extensions in v1.0+.
One file. Seven fields. Universal.
{
"instrument": "sycophancy",
"n_features": 9,
"baseline_auc": 0.500,
"critical_K": 1,
"critical_feature": "superlative_density",
"delta_auc_at_K": 0.4354,
"substrate_K_var": 0.0,
"negative_lift": ["counter_lexicon_density"]
}Every certified detector emits this object alongside its weights. A regulator, an auditor, or a researcher can read the fingerprint without running the detector and immediately know its calibration profile, its critical feature, and its domain transfer envelope.
v1.0 atlas published. Field invitation open.
We invite every other lab shipping calibrated safety detectors to publish their fingerprints in this format. Submit a PR to the cognometric fingerprint atlas. Your detector becomes part of the public record. Cost: one ablation run.
Ship a fingerprint with your detector.
One ablation run. Seven fields. CC-BY-4.0. The cost is small. The value is shared trust calibration across the field.
read the format spec