Skip to content

valkey: set upper limit for parallelism in test-suite#431768

Merged
Ma27 merged 1 commit intoNixOS:masterfrom
Ma27:valkey-test-stability
Aug 10, 2025
Merged

valkey: set upper limit for parallelism in test-suite#431768
Ma27 merged 1 commit intoNixOS:masterfrom
Ma27:valkey-test-stability

Conversation

@Ma27
Copy link
Member

@Ma27 Ma27 commented Aug 7, 2025

On machines with many build cores, the tests either fail repeatedly or don't even manage to start because all ports are blocked. For instance, on a heavy machine with >350 threads, valkey was busy trying to find ports for its tests for several hours:

[...]
Port 23380 was already busy, trying another port...
Port 23381 was already busy, trying another port...
Port 23382 was already busy, trying another port...
Port 23383 was already busy, trying another port...
Port 23384 was already busy, trying another port...
Port 23385 was already busy, trying another port...
Port 23386 was already busy, trying another port...
Port 23387 was already busy, trying another port...
Port 23388 was already busy, trying another port...
Port 23389 was already busy, trying another port...
Port 23390 was already busy, trying another port...

It should be noted that the tests seem to repeatedly use the same, smallish range given it always tried to allocate ports in the range of 233xx.

Things done

  • Built on platform:
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • Tested, as applicable:
  • Ran nixpkgs-review on this PR. See nixpkgs-review usage.
  • Tested basic functionality of all binary files, usually in ./result/bin/.
  • Nixpkgs Release Notes
    • Package update: when the change is major or breaking.
  • NixOS Release Notes
    • Module addition: when adding a new NixOS module.
    • Module update: when the change is significant.
  • Fits CONTRIBUTING.md, pkgs/README.md, maintainers/README.md and other READMEs.

Add a 👍 reaction to pull requests you find important.

On machines with many build cores, the tests either fail repeatedly or
don't even manage to start because all ports are blocked. For instance,
on a heavy machine with >350 threads, valkey was busy trying to find
ports for its tests for several hours:

    [...]
    Port 23380 was already busy, trying another port...
    Port 23381 was already busy, trying another port...
    Port 23382 was already busy, trying another port...
    Port 23383 was already busy, trying another port...
    Port 23384 was already busy, trying another port...
    Port 23385 was already busy, trying another port...
    Port 23386 was already busy, trying another port...
    Port 23387 was already busy, trying another port...
    Port 23388 was already busy, trying another port...
    Port 23389 was already busy, trying another port...
    Port 23390 was already busy, trying another port...

It should be noted that the tests seem to repeatedly use the same,
smallish range given it always tried to allocate ports in the range of
233xx.
@nixpkgs-ci nixpkgs-ci bot added 10.rebuild-linux: 101-500 This PR causes between 101 and 500 packages to rebuild on Linux. 10.rebuild-darwin: 101-500 This PR causes between 101 and 500 packages to rebuild on Darwin. 9.needs: reviewer This PR currently has no reviewers requested and needs attention. labels Aug 7, 2025
@Ma27 Ma27 merged commit fa6afea into NixOS:master Aug 10, 2025
28 of 30 checks passed
@Ma27 Ma27 deleted the valkey-test-stability branch August 10, 2025 12:50
@nixpkgs-ci
Copy link
Contributor

nixpkgs-ci bot commented Aug 25, 2025

Backport failed for staging-25.05, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin staging-25.05
git worktree add -d .worktree/backport-431768-to-staging-25.05 origin/staging-25.05
cd .worktree/backport-431768-to-staging-25.05
git switch --create backport-431768-to-staging-25.05
git cherry-pick -x 8e4b0ab719788bfcbc76f635bb50fa307aa8b7f4

@h0nIg
Copy link
Contributor

h0nIg commented Aug 28, 2025

@Ma27 can you create s backport please?

@mdaniels5757 mdaniels5757 added 8.has: port to stable This PR already has a backport to the stable release. and removed backport staging-25.05 labels Aug 30, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

8.has: port to stable This PR already has a backport to the stable release. 9.needs: reviewer This PR currently has no reviewers requested and needs attention. 10.rebuild-darwin: 101-500 This PR causes between 101 and 500 packages to rebuild on Darwin. 10.rebuild-linux: 101-500 This PR causes between 101 and 500 packages to rebuild on Linux.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants