Skip to content

feat(benchmarking): add substrate spawn benchmark - #1969

Merged
Max Smythe (maxsmythe) merged 1 commit into
agent-substrate:mainfrom
sairajp-rewind:benchmarks/spawn-benchmark
Oct 2, 2026
Merged

Max Smythe (maxsmythe) merged 1 commit into
agent-substrate:mainfrom
sairajp-rewind:benchmarks/spawn-benchmark

Conversation

@sairajp-rewind

Copy link
Copy Markdown
Collaborator

Adds a spawn boomer user class that measures actor creation latency: it creates X actors once, C at a time, and times each until it answers its first ping.

Reported metrics

  • CreateActor, ResumeActor, GluttonPing: per-call latency
  • ActorTimeToReady: per actor, first CreateActor attempt to first successful ping
  • TimeToReady_10pct … TimeToReady_100pct, TimeToAllReady: from batch start until k% / all actors are ready
  • CrashCount: actors that crashed during resume

Knobs: --total-actors (100), --spawn-concurrency (1), --actor-deadline in seconds (120). The web UI shows the same fields through dynconfig; 0 keeps the boomer-worker flag.

  • Tests pass
  • Appropriate changes to documentation are included in the PR

@maxsmythe Max Smythe (maxsmythe) left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Couple nits, then LGTM

@bowei Bowei Du (bowei) added area/benchmarking kind/feature An enhancement / feature request or implementation labels Sep 30, 2026
@sairajp-rewind
Sairaj Pokale (sairajp-rewind) marked this pull request as ready for review September 30, 2026 18:24

@maxsmythe Max Smythe (maxsmythe) left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@maxsmythe
Max Smythe (maxsmythe) added this pull request to the merge queue Oct 2, 2026
Merged via the queue into agent-substrate:main with commit 585478a Oct 2, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/benchmarking kind/feature An enhancement / feature request or implementation

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants