Repository navigation
Commit b33017a
authored
ci(tui): run the TUI tests with cargo nextest (#31)
* ci(tui): run the TUI tests with cargo nextest
The vendored tests were written for cargo nextest (one process per test), and some say in a
comment that they are reliable only under it. TUI CI ran cargo test, where all tests of a
binary share one process.
- scripts/tui_baseline.toml: `[test] runner = "nextest"`; `--runner {cargo,nextest}` on the
command line takes the other one. The libtest path stays as it was.
- scripts/tui_baseline.py: `parse_nextest_output` reads the Summary line (nextest counts the
ignored tests and the tests removed by --skip together as "skipped") and the recap of the
failed tests (the live part has the captured output of a test, so it is not read);
`suite_command` builds the command line; the report names the runner; a missing
cargo-nextest stops the run at once, with a hint.
- stream(): after the timeout, SIGTERM to the process group, and SIGKILL 20 s later. nextest
puts each test in a process group of its own, so a SIGKILL to nextest left a hanging test
alive (measured on a demo crate); a nextest that gets a SIGTERM stops its tests.
- tui-ci.yml: install cargo-nextest 0.9.148 (taiki-e/install-action) in the test job; the job
is now called "cargo nextest (Linux x86_64)".
- 21 new unit tests. The fixtures are real output of nextest 0.9.148.
* docs(tui): say in AGENTS.md and the tui_envspy README that TUI CI runs nextest
* docs: record the nextest change and the r18 round
- Plan (status, section 10 index, revision log), execution log (new section
10.21), CHANGELOG, baselines and baseline history: the numbers of the first
nextest run on the whole tree (TUI CI run 39359879537: 8,490 passed, 0 failed,
22 skipped), the test time (about 130 s with nextest, about 65 s with
cargo test, same code), and the dry run of release.yml for PR #29.
- Correct the r17 notes: the 7 / 4 / 3 compiles of pi-tools-api in the cargo
test job were not caused by the protoc path (PR #30 shows it), and the runner
never ran doctests, so nextest loses nothing there.
- Remove a duplicated "verification" heading from the r17 text.1 parent d2182d9 commit b33017a
11 files changed
Lines changed: 573 additions & 62 deletions
File tree
- .github/workflows
- docs
- PLAN
- archive
- baselines
- archive
- scripts
- tests
- tui_envspy
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
87 | 87 | | |
88 | 88 | | |
89 | 89 | | |
90 | | - | |
| 90 | + | |
91 | 91 | | |
92 | 92 | | |
93 | 93 | | |
| |||
116 | 116 | | |
117 | 117 | | |
118 | 118 | | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
119 | 127 | | |
120 | 128 | | |
121 | 129 | | |
| |||
125 | 133 | | |
126 | 134 | | |
127 | 135 | | |
128 | | - | |
129 | | - | |
| 136 | + | |
| 137 | + | |
130 | 138 | | |
131 | 139 | | |
132 | 140 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
50 | 50 | | |
51 | 51 | | |
52 | 52 | | |
53 | | - | |
| 53 | + | |
54 | 54 | | |
55 | 55 | | |
56 | 56 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
16 | 16 | | |
17 | 17 | | |
18 | 18 | | |
| 19 | + | |
19 | 20 | | |
20 | 21 | | |
21 | 22 | | |
| |||
0 commit comments