Skip to content

Commit ebc3117

Browse files
ci(build): isolate each PR build on its own ephemeral runner VM
The shared self-hosted runner runs 4 agents against one dockerd-embedded buildkit; concurrent build jobs serialize on buildkit's single-writer bbolt cache lock + exporter mutex and stall to the 30-min timeout (proven via a live SIGUSR1 goroutine dump of a hung build). Run the Build job on a small ephemeral oracle-vm shape (4cpu/16gb x86-64) instead, so each build gets its own VM and its own buildkit -- the cross-job contention is severed by construction. make build is serial (one image at a time), so the small shape suffices; it relies on the warm mode=max cache (#2938) to stay under the 30-min wall. The `debug` label still routes to self-hosted for the breakpoint path. Phase 0.5 of #2937. Assisted-By: Claude <[email protected]> Signed-off-by: Myasnikov Daniil <[email protected]>
1 parent e1781ac commit ebc3117

1 file changed

Lines changed: 11 additions & 1 deletion

File tree

‎.github/workflows/pull-requests.yaml‎

Lines changed: 11 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -28,7 +28,17 @@ jobs:
2828
2929
build:
3030
name: Build
31-
runs-on: [self-hosted]
31+
# Run each Build on its own ephemeral VM instead of the shared self-hosted
32+
# runner. The shared host runs 4 runner agents against one dockerd-embedded
33+
# buildkit; concurrent build jobs serialize on buildkit's single-writer bbolt
34+
# cache lock + exporter mutex and stall to the 30-min timeout (proven via a
35+
# live SIGUSR1 goroutine dump). One VM per job => one buildkit per job => that
36+
# contention is severed by construction. `make build` is serial (one image at
37+
# a time), so a small shape suffices -- 4cpu/16gb, not the 24cpu the e2e job
38+
# uses -- and it leans on the warm mode=max cache (#2938) to stay under the
39+
# 30-min wall. The `debug` label still routes to self-hosted for the
40+
# breakpoint path. Phase 0.5 of #2937.
41+
runs-on: ${{ contains(github.event.pull_request.labels.*.name, 'debug') && 'self-hosted' || 'oracle-vm-4cpu-16gb-x86-64' }}
3242
timeout-minutes: 30
3343
permissions:
3444
contents: read

0 commit comments

Comments
 (0)