Branch perf/check-changed-skip-node-modules, commits 6e8168a03f and 24412204d4 (batches sized from the longest path) on 6577c6b618 (pingdotgg/t3code main). It replaces #30736 (a8f1b5b852); the raw rows for that revision are in https://gist.github.com/Pyseph/39d10df5712b73c447479995f4f029e0.
Machine: Windows 11 Home 10.0.26200, NTFS, AMD Ryzen 9 9950X (16 cores, 32 threads), git 2.47.0.windows.1, Node 26.12.1 via vp env exec --node 26.12.1. Timed runs ran under an exclusive lock that kept this project's other benchmarks and tests off the machine, at below-normal priority. Other unrelated work on the machine was not stopped.
| File | What |
|---|---|
timings.jsonl |
vp run check:changed HEAD in a worktree with a completed vp i, one new docs/zz-bench-note.md and nothing else changed, cache file deleted before each cold run. k: branch-cold (n=5), branch-cached-rerun (inputs unchanged after a pass), main-cold (n=1, the same worktree checked out at 6577c6b618), branch-after-main-cold (n=2). tooLongWarnings counts Filename too long lines in the output. |
e2e.cjs |
the driver: node e2e.cjs <worktree> <vp> <label> <runs> <cachedRerun 0/1> <out.jsonl> |
fuzz-seed1.jsonl, fuzz-seed2.jsonl |
random repositories, old pathspec command against the new function: 300 with seed 1, 100 with seed 2. Only the summary line is printed when no case differs. |
targeted.jsonl |
22 targeted cases: state A, a mutation to state B, both lists and whether the full cache key changed. STALE means the old key changed and the new one did not. |
collapsed-listing.jsonl |
5 variants of git's listing of an untracked directory whose contents are all ignored, combined with replaced and flagged paths. |
batch-check.mjs, batch-check.jsonl |
300 ignored directories with 140-character names, so the expansion takes two calls at 24412204d4; the old command and the new function list the same 300 paths. |
fuzz.mjs, targeted.mjs, quirk.mjs, lib.mjs |
the harness from #30736, unchanged. NEW_TS=<worktree>/scripts/check-changed.ts node fuzz.mjs <out dir> <cases> <seed>; targeted.mjs <out dir>; quirk.mjs <out dir>. |
-
check:changedwith one new docs file: main 2,500.3 s (n=1, exit 0); this branch 5.0 s median (n=7: 7.7, 4.5, 4.6, 4.6, 5.1 before the main run, 6.0 and 5.0 after it; min 4.5, max 7.7; all exit 0). Rerun with unchanged inputs: 4.2 s,Nothing changed since the last passing run. -
The main run lists the ignored inputs twice (before the checks and after the pass); git's
Filename too longwarnings go to its stderr, whichcheck:changeddoesn't print, sotooLongWarningsis 0 for every row and says nothing about the walk. -
#30736's earlier rows measured main at 696.6 to 833.7 s (median 740.1 s, n=5) in another worktree on 2026-11-03 with the same listing code.
-
Fuzz: 400 repositories, 0 missing, 0 extra, 0 errors (391 with a non-empty list).
-
Targeted: 22 cases, lists and key changes equal except
nested-in-node_modules-create(a nested repository created insidenode_modules: the old command printed its name, the new function doesn't list it). -
Collapsed listing: 5 variants, lists equal, no stale key.