Skip to content

Commit c7bd3bc

Browse files
committed
test(e2e): widen etcd convergence budget to 5m in Talos bootstrap
The "Bootstrap Talos cluster" step times out the etcd-members health gate at 180s. A 3-node etcd converges via Talos's serialized learner promotion (one learner admitted at a time), so on a loaded ephemeral runner this deterministic path can approach ~3m wall clock and photo-finish against the 180s ceiling — failing a cluster that is in fact healthy. The wait is already event-driven; only the ceiling was too tight. Widen it to 300s. Assisted-By: Claude <[email protected]> Signed-off-by: Aleksei Sviridkin <[email protected]>
1 parent 29bf56f commit c7bd3bc

1 file changed

Lines changed: 9 additions & 2 deletions

File tree

‎hack/e2e-prepare-cluster.bats‎

Lines changed: 9 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -261,8 +261,15 @@ EOF
261261
# ephemeral runners can take several attempts of ~5s each.
262262
timeout 60 sh -ec 'until talosctl bootstrap -n 192.168.123.11 -e 192.168.123.11; do sleep 2; done'
263263

264-
# Wait until etcd is healthy
265-
if ! timeout 180 sh -ec 'until talosctl etcd members -n 192.168.123.11,192.168.123.12,192.168.123.13 -e 192.168.123.10 >/dev/null 2>&1; do sleep 1; done'; then
264+
# Wait until etcd is healthy.
265+
# Budget is 5m, not 3m: a 3-node etcd converges via Talos's serialized
266+
# learner promotion (etcd admits one learner at a time), so the third member
267+
# is only promoted after the second is fully caught up. On a loaded ephemeral
268+
# runner this deterministic path can legitimately approach ~3m wall clock —
269+
# a 180s ceiling photo-finishes against it and times out a cluster that is
270+
# actually healthy. The wait itself is already event-driven (poll until
271+
# members respond); only the ceiling needed widening.
272+
if ! timeout 300 sh -ec 'until talosctl etcd members -n 192.168.123.11,192.168.123.12,192.168.123.13 -e 192.168.123.10 >/dev/null 2>&1; do sleep 1; done'; then
266273
talosctl dmesg -n 192.168.123.11,192.168.123.12,192.168.123.13 -e 192.168.123.10 || true
267274
exit 1
268275
fi

0 commit comments

Comments
 (0)