You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit fed2a4c
Browse filesBrowse the repository at this point in the historyBrowse files
fix(perf): judge nights, samples, and failures soundly; keep logs on interrupt
- Rolling baselines take one scheduled run per UTC night (the newest
usable one) and page through workflow runs until enough nights are
found. Explicit --to/--from references still accept any trigger.
- A run measures at least three rounds. A timing verdict needs three
successful samples tonight and on each counted baseline night.
- Failures get their own verdict. more-failures flags tonight failing
more than every baseline night, in count and share; a faster median
with worse failures is not an improvement.
- The interrupt handler and the normal finish share one finalizer:
save logs, stop session and daemon within a deadline, save again.
Co-Authored-By: Claude Opus 5.5 <[email protected]>
`--scenarios lifecycle,heavy-feed` runs a subset. `--app-id` changes the fixture bundle id.
21
+
`--rounds` is at least 3. `--scenarios lifecycle,heavy-feed` runs a subset. `--app-id` changes the fixture bundle id.
22
22
The suite uses its own temporary state directory and daemon. It stops them at the end.
23
+
At the end, or on SIGINT or SIGTERM, the suite saves the logs to `raw/state/`, stops the session and daemon within a deadline, and saves the logs again.
23
24
24
25
## Output
25
26
@@ -54,19 +55,22 @@ All times are milliseconds. Statistics use only the successful samples of a step
54
55
55
56
`.github/workflows/perf-nightly.yml` runs the iOS suite every night on `main`.
56
57
Each run uploads `perf-ios-summary` (summary, report, comparison; 90 days) and `perf-ios-raw` (logs; 30 days).
57
-
The job compares the run with up to seven earlier runs and writes the result to the job summary.
58
+
The job compares the run with up to seven earlier nights and writes the result to the job summary.
59
+
A night is the newest scheduled run of one UTC day that ran every scenario of the judged run.
60
+
Manual dispatches are never part of the rolling baseline.
58
61
59
62
To fetch and compare runs on your machine, use `gh` with access to the repository:
60
63
61
64
```sh
62
65
pnpm perf:compare # latest night against the 7 nights before it
63
66
pnpm perf:compare --to 2026-10-28 # that night against the 7 nights before it
64
-
pnpm perf:compare --to latest --from 2026-10-21 # latest against one night
0 commit comments