Problem

The Garnet benchmark charts at https://microsoft.github.io/garnet/charts/ hide every Params variant except None. The FEATURED_BENCHMARKS constant was hardcoded with explicit (Params: None) suffixes:

const FEATURED_BENCHMARKS = Object.freeze([
    `Operations.BasicOperations.InlinePing(Params: None)`,
    // ...
]);

data.js already contains the per-Params entries (Operations.BasicOperations.InlinePing(Params: ACL), (Params: AOF), soon (Params: AAD) from #1859) but the default view never surfaces them. Users have to manually pick each variant from the dropdown to see it — and even then each variant gets its own separate chart, so cross-variant regressions are invisible.

This blocks the value of #1859: the whole point of adding Params: AAD was so a future AAD-path regression like the DateTime.UtcNow one (fixed in #1855) would be visible immediately on the public charts. With the current renderer, the AAD line would appear only if you knew to click into it.

Fix

Render one chart per base benchmark name, with one colored line per Params variant. Same number of charts as before; up to 4× more information per chart.

• FEATURED_BENCHMARKS — entries are now base names (e.g. Operations.BasicOperations.InlinePing), no (Params: …) suffix. The includes() match then attracts all variants automatically.
• parseBenchmarkName(fullName) — new helper that splits Foo(Params: X) into {base, params}. Returns {base: fullName, params: null} for legacy entries without a Params suffix.
• renderGraph(parent, baseName, variants) — refactored to accept a Map<params|null, datapoints[]>. Unions all commit IDs across variants for the x-axis; older variants (None) have longer histories and newer ones (AAD) start mid-axis, rendered as connected gaps via spanGaps: true. Emits one Chart.js dataset per variant with stable per-Params colors:
  • None → green (matches the existing BDN color)
  • ACL → blue
  • AOF → orange
  • AAD → red
  • Anything else cycles through a fallback palette deterministically per session
• renderBenchSet — groups bench entries by base name before rendering; FEATURED filter compares against the base name so all Params variants pass through.
• Legend — shown when a chart has more than one dataset (was hidden before since each chart had one line).
• Tooltips — now prefix each value with the Params label (e.g. AAD: 1048 ns (±5 ns)).

Result

After this change, the default Featured Benchmarks view will show, for example:

Operations.BasicOperations.InlinePing chart with four lines:

• 🟢 None (~954 ns flat)
• 🔵 ACL (~970 ns flat)
• 🟠 AOF (~986 ns flat)
• 🔴 AAD (~2594 ns until Cache DateTime.UtcNow in AAD authenticator hot path #1855 commit, then drops to ~1048 ns — the fix is obvious from the chart alone)

That's the symmetry the original reviewer was asking for in #1855: regressions on any auth/AOF path are visible at a glance, on the same plot as the baseline.

Implementation notes

• File touched: website/static/charts/index.html only. No data format change, no infrastructure change. data.js is untouched and continues to be appended by benchmark-action/github-action-benchmark as today.
• All filtering logic (OS, Framework, manual benchmark selection) preserved unchanged.
• The legacy TOOL_COLORS palette is retained but the per-Params palette overrides it for grouped charts (still used as a fallback elsewhere).
• Variants without a (Params: …) suffix (older benchmarks) get a single line labeled (no params), no regression.

Testing

Verified locally by serving the modified index.html via python -m http.server (so fetch() to https://microsoft.github.io/garnet/charts/data.js and /data_net80.js succeeds — file:// would have been blocked by CORS). The page loads, renders, and the Featured view shows all Params variants of each benchmark grouped into single charts.

Branch note

This branch is based on continuousbenchmark because index.html lives there (alongside data.js). The branch will need to be merged into continuousbenchmark (not main) for the change to take effect on the deployed charts site.