🤖 Update Mock Benchmark Results#6315
Conversation
Up to standards ✅🟢 Issues
|
Code ReviewThis is an automated benchmark documentation update (no production code changes). The review covers the data quality and patterns in the update. SummaryAll changes are documentation-only: updated benchmark numbers, dates, and Mermaid chart data across the mock benchmark markdown files and JSON data files. ObservationsData consistency: The Mermaid upper bounds are recalculated correctly relative to the new data (e.g., Callback drops from 222,976 ns to 169,061 ns as Moq's result improved). Performance trends in this run:
No issues found with the automated update itself. The data appears consistently applied across all files (Markdown + JSON). Suggestion (non-blocking, for future automation improvement)Since these benchmarks run daily on a shared CI runner, noticeable run-to-run variance (~20%) can make it hard to spot real regressions. Consider tracking a rolling average (e.g., 7-day mean) in alongside the latest results. This would make genuine performance regressions easier to distinguish from noise without adding overhead to individual benchmark runs. Overall, this automated PR is working correctly. ✓ |
Automated Mock Benchmark Update
This PR updates the mock benchmark documentation with the latest results from the Mock Benchmarks workflow.
Benchmarks Produced
Individual benchmark artifacts are available for download:
mock-benchmark-MockCreationmock-benchmark-Setupmock-benchmark-Invocationmock-benchmark-Verificationmock-benchmark-Callbackmock-benchmark-CombinedWorkflowmock-benchmark-summary(aggregated overview)Libraries Compared
Libraries are discovered dynamically from the benchmark output. See the generated
summary.jsonfor the full list.Changes
docs/static/benchmarks/mocks/latest.jsondocs/docs/benchmarks/mocks/docs/static/benchmarks/mocks/summary.jsonWorkflow Run
🤖 This PR was automatically created and will be merged automatically once CI checks pass.