Skip to content

Commit 04140b8

Browse files
committed
evidence(ios-snapshot): #2198 slice A corpus, base 27a97ee vs head 7616ba2
1 parent a0e6418 commit 04140b8

6 files changed

Lines changed: 12780 additions & 0 deletions

File tree

‎2198-slice-a-7616ba222d/README.md‎

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,20 @@
1+
# #2198 slice A corpus: base vs head, local Simulator
2+
3+
Raw `ios-snapshot-benchmark` results behind the comparison posted on callstack/agent-device#2329.
4+
5+
- Target: `ad-bench-2198` (iPhone-class Simulator, `com.apple.CoreSimulator.SimRuntime.iOS-26-2`, UDID `93FC0A0B-CC1F-4F9D-B29A-CEC76A9301BC`), dedicated to this corpus; CI fixture app `com.callstack.agentdevicelab`.
6+
- Host: MacBook Pro (Mac16,8; Apple M4 Pro, 12 cores). Nothing else drove the Simulator during the runs.
7+
- Harness: `scripts/ios-snapshot-benchmark` at e319193ccf (the same copy for both legs; the base worktree ran the head harness against base production code).
8+
- Base production code: `27a97ee619` (`dist` built from it in a separate worktree).
9+
- Head production code: `7616ba222d` (`dist` built from it). `head-cold-first.json` stamps `revision.commit` as `9189275dcb` because that commit was checked out in the worktree when the leg started; it differs from `7616ba222d` only in source that was not rebuilt into the `dist` the leg ran, and its bench scripts are identical. `head-warm-relaunch.json` stamps `7616ba222d`.
10+
- Cells: `cold` and `first-interaction` at 10 samples, `warm` and `relaunch` at 20 samples, six screens (`quiet`, `list`, `nested-scroll`, `alert`, `system-surface`, `xctest-stress`), `--keep-device --skip-package-size`.
11+
- Known-invalid cells on both legs: `first-interaction` on `list` and `system-surface` fail every sample with `AMBIGUOUS_MATCH` because the harness pressed the screen's anchor text, which names two actionable elements there (a harness defect, fixed separately; the re-run of those two cells is published next to this directory).
12+
13+
| File | Leg |
14+
|---|---|
15+
| `base-cold-first.json` | base, cold + first-interaction |
16+
| `base-warm-relaunch.json` | base, warm + relaunch |
17+
| `head-cold-first.json` | head, cold + first-interaction |
18+
| `head-warm-relaunch.json` | head, warm + relaunch |
19+
20+
`SHA256SUMS` lists each file's digest.

‎2198-slice-a-7616ba222d/SHA256SUMS‎

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
1+
9033c97312cffdcaf2c69efd1a2c8f8e3656c555218db5dc6be3fd18d27d36ee base-cold-first.json
2+
211ef7e95be46d18d2b464897aee9aceffc7d097bedb9906de3266a486fc310c base-warm-relaunch.json
3+
dbf95c9639e96bbfe0442caaa0ab8aa952f6fb88b0c40bc9683bf00571a58040 head-cold-first.json
4+
dd0eefe9de033c53de1bebeab214babc2a64e56fe1bcdc775261ffff55c3107c head-warm-relaunch.json

0 commit comments

Comments
 (0)