Skip to content

🤖 Update Mock Benchmark Results#6321

Merged
thomhurst merged 1 commit into
mainfrom
automated-mock-benchmarks-update
Jun 28, 2026
Merged

🤖 Update Mock Benchmark Results#6321
thomhurst merged 1 commit into
mainfrom
automated-mock-benchmarks-update

Conversation

@thomhurst

Copy link
Copy Markdown
Owner

Automated Mock Benchmark Update

This PR updates the mock benchmark documentation with the latest results from the Mock Benchmarks workflow.

Benchmarks Produced

Individual benchmark artifacts are available for download:

  • mock-benchmark-MockCreation
  • mock-benchmark-Setup
  • mock-benchmark-Invocation
  • mock-benchmark-Verification
  • mock-benchmark-Callback
  • mock-benchmark-CombinedWorkflow
  • mock-benchmark-summary (aggregated overview)

Libraries Compared

Libraries are discovered dynamically from the benchmark output. See the generated summary.json for the full list.

Changes

  • Updated mock benchmark data in docs/static/benchmarks/mocks/latest.json
  • Regenerated mock benchmark documentation in docs/docs/benchmarks/mocks/
  • Updated mock benchmark summary in docs/static/benchmarks/mocks/summary.json

Workflow Run

  • Run ID: 28309786212
  • Triggered: schedule

🤖 This PR was automatically created and will be merged automatically once CI checks pass.

@thomhurst thomhurst added automated benchmarks documentation Improvements or additions to documentation ignore-for-release labels Jun 28, 2026
@thomhurst
thomhurst merged commit 1b0d3ff into main Jun 28, 2026
11 of 13 checks passed
@thomhurst
thomhurst deleted the automated-mock-benchmarks-update branch June 28, 2026 03:34
@codacy-production

Copy link
Copy Markdown

Up to standards ✅

🟢 Issues 0 issues

Results:
0 new issues

View in Codacy

NEW Get contextual insights on your PRs based on Codacy's metrics, along with PR and Jira context, without leaving GitHub. Enable AI reviewer
TIP This summary will be updated as you push new changes.

@claude claude Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Automated Mock Benchmark Update — Review

This is a clean, automated documentation-only update. No logic changes, no code paths affected. A few observations worth noting for the record:

Observation: Unit change in CombinedWorkflow chart

In CombinedWorkflow.md, the Mermaid chart's y-axis changed from "Time (μs)" to "Time (ns)" and the bar values shifted accordingly:

- bar [2.057, 2.982, 1.714, 406.602, 17.79, 18.321]   // μs
+ bar [1026.9, 1373.1, 882.5, 118764.5, 8453.9, 8383.5] // ns

The new values are self-consistent (table and chart both in ns), so the chart is now more correct than before — the previous run's chart had mixed units that happened to line up visually because the raw numbers were small floats in μs. This looks like a fix in the benchmark-to-docs generator.

Observation: Large performance swings in CombinedWorkflow

The CombinedWorkflow results show some large day-over-day swings (TUnit.Mocks ~50% faster, Moq ~70% faster). This is expected noise in a shared CI environment (Ubuntu runners are not dedicated hardware), but if these numbers are used for external comparisons or marketing, it may be worth considering running benchmarks on a dedicated/pinned machine or taking median over multiple runs.

Summary

The update is correct and the generated output is consistent. The code generation itself is working as intended. ✅

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

automated benchmarks documentation Improvements or additions to documentation ignore-for-release

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant