Skip to content

benchmarking/locust: cap trial_summary actor density by live actors - #3140

Merged
Max Smythe (maxsmythe) merged 1 commit into
agent-substrate:mainfrom
chw120:trial-summary-live-actors
Oct 23, 2026
Merged

Max Smythe (maxsmythe) merged 1 commit into
agent-substrate:mainfrom
chw120:trial-summary-live-actors

Conversation

@chw120

Copy link
Copy Markdown
Collaborator

Summary

Locust's User Count in stats_history.csv tracks spawned VU goroutines even when CreateActor fails or wedged actors are deleted during the run (for example, in resident density benchmarks where the target user count exceeds single-node capacity).

  • In append_trial_summary (benchmarking/locust/cluster_facts.py), when CreateActor is recorded in stats.csv, cap peak_actors by CreateActor successes minus unretired DeleteActor requests (excluding completed TaskWallClock trajectories in sweperf that retire their actor before starting a fresh one; stats.csv is written before boomer's shutdown DeleteActor sweep).
  • Update test_live_actors_from_create_and_delete in benchmarking/locust/unit_tests/test_cluster_facts.py to cover warmup retry deletes, 100% CreateActor failures, partial actor survival, and sweperf trajectory retirements.

Testing

python3 -m unittest discover -s benchmarking/locust/unit_tests -p 'test_*.py'

Locust's User Count in stats_history.csv tracks spawned VU goroutines even when CreateActor fails or wedged actors are deleted during the run. Cap peak_actors in append_trial_summary by CreateActor successes minus unretired DeleteActor requests (excluding completed TaskWallClock trajectories in sweperf) when CreateActor is present in stats.csv, and update test_live_actors_from_create_and_delete.

@maxsmythe Max Smythe (maxsmythe) left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@maxsmythe
Max Smythe (maxsmythe) added this pull request to the merge queue Oct 23, 2026
Merged via the queue into agent-substrate:main with commit ad4e040 Oct 23, 2026
15 checks passed
@chw120
Chenyi Wang (chw120) deleted the trial-summary-live-actors branch October 23, 2026 02:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants