Repository navigation
Commit eed0212
Measure a subset of four more benchmark sweeps on CodSpeed (#11132)
## Summary
Follow-up to #11131, using the
same pattern. Four more parameter sweeps keep every case for local runs
and measure a representative subset under `cfg(codspeed)`. CodSpeed
cases that are kept keep their names, so their history continues.
The cases to keep were chosen from one local walltime run of every case.
Dimensions whose timings scale linearly or barely move were reduced;
dimensions where timings jump (algorithm or threshold changes) were
kept.
## Changes
| Bench | CodSpeed benchmarks, before → after | What CodSpeed leaves out
|
|---|---:|---|
| `vortex-fastlanes/canonicalize_bench` | 32 → 14 | The 100-chunk cases,
which cost about 30× the 10-chunk ones; `(1000, 1000, 0.00)` already
covers the same total length. Also the 1% patch fraction, which lies
between 0% and 10%. |
| `vortex-array/dict_compare` | 27 → 16 | The 64-value dictionary in the
plain compares, which time alike for every dictionary size. The sliced
sweep keeps its ends, its middle, and both sides of codes as long as
values (`9_999`, `10_000`). |
| `vortex-fastlanes/compute_between` | 33 → 11 | Two of the three
lengths, which scale linearly. Every type is still measured. |
| `vortex-array/filter_bool` | 61 → 49 | The 250,000-row size. The
density sweeps, which change algorithm with density, are kept in full. |
The estimated saving is about 6 s of CodSpeed simulation time, mostly in
shard 7 (FastLanes & decimals), from `canonicalize_bench`'s 100-chunk
cases.
Left alone on purpose:
- `fsst_take`: its sweep sits on either side of the compressed-bytes
threshold, and timings jump around rather than scaling.
- `take_chunked`: its cases are hand-tuned.
- `take_filter`, `widen`: each case measures a distinct code path.
Verification: built every changed bench with and without `--cfg
codspeed` and ran each binary to count the benchmarks it runs. The local
builds run 32 / 27 / 33 / 61 and the CodSpeed builds 14 / 16 / 11 / 49,
with no compiler warnings. I didn't run clippy, rustfmt or tests.
---
_Generated by [Claude
Code](https://claude.ai/code/session_01UeniBAqXtmDDNUP9pHsfSo)_
Signed-off-by: Joe Isaacs <[email protected]>
Co-authored-by: Claude Opus 5.5 <[email protected]>1 parent 2d128af commit eed0212
9 files changed
Lines changed: 97 additions & 62 deletions
File tree
- encodings
- alp/benches
- fastlanes/benches
- fsst/benches
- vortex-array/benches
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
38 | 38 | | |
39 | 39 | | |
40 | 40 | | |
41 | | - | |
42 | | - | |
43 | 41 | | |
44 | 42 | | |
45 | 43 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
3 | 3 | | |
4 | 4 | | |
5 | 5 | | |
6 | | - | |
7 | 6 | | |
8 | 7 | | |
9 | 8 | | |
| |||
61 | 60 | | |
62 | 61 | | |
63 | 62 | | |
64 | | - | |
65 | | - | |
66 | | - | |
67 | | - | |
68 | 63 | | |
69 | 64 | | |
70 | 65 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
32 | | - | |
33 | | - | |
34 | | - | |
35 | | - | |
36 | | - | |
37 | | - | |
38 | | - | |
39 | | - | |
40 | | - | |
41 | | - | |
42 | | - | |
43 | | - | |
44 | | - | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
45 | 55 | | |
46 | 56 | | |
47 | 57 | | |
| |||
122 | 132 | | |
123 | 133 | | |
124 | 134 | | |
125 | | - | |
126 | | - | |
127 | | - | |
128 | | - | |
129 | | - | |
130 | | - | |
131 | | - | |
132 | | - | |
133 | | - | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
| 140 | + | |
| 141 | + | |
| 142 | + | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
| 147 | + | |
| 148 | + | |
| 149 | + | |
| 150 | + | |
| 151 | + | |
| 152 | + | |
134 | 153 | | |
135 | 154 | | |
136 | 155 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
88 | 88 | | |
89 | 89 | | |
90 | 90 | | |
91 | | - | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
92 | 96 | | |
93 | 97 | | |
94 | 98 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
51 | 51 | | |
52 | 52 | | |
53 | 53 | | |
54 | | - | |
55 | | - | |
56 | | - | |
57 | 54 | | |
58 | 55 | | |
59 | 56 | | |
| |||
149 | 146 | | |
150 | 147 | | |
151 | 148 | | |
152 | | - | |
153 | | - | |
154 | 149 | | |
155 | 150 | | |
156 | 151 | | |
| |||
199 | 194 | | |
200 | 195 | | |
201 | 196 | | |
202 | | - | |
203 | | - | |
204 | 197 | | |
205 | 198 | | |
206 | 199 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
42 | 42 | | |
43 | 43 | | |
44 | 44 | | |
45 | | - | |
46 | | - | |
47 | | - | |
48 | | - | |
49 | | - | |
50 | | - | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
51 | 59 | | |
52 | 60 | | |
53 | 61 | | |
| |||
108 | 116 | | |
109 | 117 | | |
110 | 118 | | |
111 | | - | |
112 | | - | |
113 | | - | |
114 | | - | |
115 | | - | |
116 | | - | |
117 | | - | |
118 | | - | |
119 | | - | |
120 | | - | |
121 | | - | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
| 137 | + | |
| 138 | + | |
| 139 | + | |
122 | 140 | | |
123 | 141 | | |
124 | 142 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
31 | 31 | | |
32 | 32 | | |
33 | 33 | | |
34 | | - | |
35 | | - | |
36 | | - | |
| 34 | + | |
37 | 35 | | |
38 | 36 | | |
39 | 37 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
41 | 41 | | |
42 | 42 | | |
43 | 43 | | |
44 | | - | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
45 | 49 | | |
46 | 50 | | |
47 | 51 | | |
| |||
421 | 425 | | |
422 | 426 | | |
423 | 427 | | |
424 | | - | |
| 428 | + | |
| 429 | + | |
| 430 | + | |
| 431 | + | |
| 432 | + | |
425 | 433 | | |
426 | | - | |
| 434 | + | |
| 435 | + | |
| 436 | + | |
| 437 | + | |
| 438 | + | |
427 | 439 | | |
428 | 440 | | |
429 | 441 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
46 | 46 | | |
47 | 47 | | |
48 | 48 | | |
49 | | - | |
50 | | - | |
51 | 49 | | |
52 | 50 | | |
53 | 51 | | |
| |||
0 commit comments