Add lane rates, estimated costs and gateway routing panels - #851

Scope

Add per-lane tool/API rates, separate estimated Claude/Codex costs, and gateway provider/model/outcome/HTTP-status panels to the existing cc-lanes dashboard. #848 already supplies the five collector dimensions on main; this PR has no collector YAML delta after its landing rebase. Host publication remains the CC's operation.

• Base commit: e450e378c6bf1b21dd0bb565812f84afe028bad5 (CC091807Z landing rebase).
• Lane: lane:foundation.
• Owned paths: observability/lanes_dashboard.py; generated plan config/grafana-lanes.json; the existing writer-identity test fixture; dated decision; own evidence registry entries.

Pipeline exactness

Dropped the old #851 traces.span.metrics.* statements from transform/privacy. They matched only direct OTLP metrics named traces.span.metrics.calls/duration entering the metrics pipeline. Gateway/Harbor connector output instead uses metrics/spans and transform/metric_export_privacy; it never passes through those statements. No reviewed shipped producer is bound to sending connector-named metrics through that direct OTLP metrics route.

Main's collector YAML is retained byte-for-byte, including #848's five-dimension flow-form line and comment. Its existing export guard retains provider/model/status/outcome. The synthetic test follows that actual connector pipeline and proves dimension export, not causality from the dropped exceptions.

SOTA sources

• open-telemetry/[email protected], spanmetricsconnector README: additional dimensions and default traces.span.metrics.calls/duration names. Main's processor/pipeline source establishes the exact routing and retained dimensions.
• open-telemetry/semantic-conventions-genai@06ec68e722c45a7218e23ea1bc1339fe4e21ecae, client-inference.md: gen_ai.provider.name; current conventions are Development.
• diegosouzapw/OmniRoute@c1e30b7676975feb298b49eff6ff58923c04b89e, routing/otel.ts:193: vendor omniroute.routing.status/outcome, provider/model fields and absent lane/session parentage. Routing status is distinct from OTel status.code.
• openai/codex@979011409de0a60b52f179721948e65531d26144, cost emission, Claude Code monitoring, and Prometheus rate/increase: reset-aware counter queries, micro-USD conversion, separate cost sources and interval-extrapolation limits.
• Existing Grafana13.2.3/Loki3.7.8 native renderer and provisioning formats are reused.

Evidence-class table

Local commands run

python3 observability/ns2604_dashboards.py
python3 observability/ns2604_dashboards.py --check
  rc=0
python3 -m unittest tests.test_ns2604_dashboards tests.test_j775_panel_contracts tests.test_observability_writer_identity -v
  rc=0; 43 collected, 39 passed, 4 optional pinned-Prometheus/promtool checks skipped
NS2604_OBSERVABILITY_DATA=<temporary>/data python3 evidence/artifacts/new-wsl-install-plan-20261002/config/observability_config.py otel --source-root <checkout>/evidence/artifacts/new-wsl-install-plan-20261002/config --config-root <temporary>/config
  rc=0; published YAML matches source and named main byte-for-byte
NS2604_OBSERVABILITY_DATA=<temporary>/data otelcol-contrib validate --config=<temporary>/config/otel.yaml
  rc=0; installed collector 0.162.0
python3 scripts/component_matrix.py --write
python3 scripts/new_host_grand_list.py --write
  rc=0; no derived-report changes
python3 scripts/validate.py
  rc=0
git diff --check
  rc=0

Decision record

docs/decisions/2026-10-08-cc-lanes-rate-cost-gateway.md records the corrected processor assumption.

Costs are estimates with source-specific coverage. Codex provider enrichment is conditional; increase() is not an exact total or guaranteed lower bound. No zero fill is used for missing costs or gateway routing data. Gateway events lack lane/session parentage and are not assigned to client lanes.

Host evidence

No files under evidence/hosts/ change, and no deployment acceptance is claimed. The existing native collector integration uses temporary configuration and loopback ports with synthetic input. The runtime lock, broker keys, live Grafana, services and gateway are untouched.

Checklist

• No GitHub Actions changes.
• No secrets, new credentials, paid hosting or billing surface.
• Peer worktrees preserved; Align code graph MCP server key with native client registrations #834 retains its separate landing cue.
• Main registry taken; only own changed files re-registered last.
• Source-only scope respects the paper freeze and quiet window.