Skip to content

[WIP] add eval action#352808

Closed
Mic92 wants to merge 2 commits intoNixOS:masterfrom
Mic92:eval-check
Closed

[WIP] add eval action#352808
Mic92 wants to merge 2 commits intoNixOS:masterfrom
Mic92:eval-check

Conversation

@Mic92
Copy link
Member

@Mic92 Mic92 commented Nov 1, 2024

This is a POC to check wether it's feasible to replace ofborg with github actions runner.
Background is that we will loose the CI builder currently used for ofBorg.

@github-actions github-actions bot added the 6.topic: policy discussion Discuss policies to work in and around Nixpkgs label Nov 1, 2024
@Mic92 Mic92 force-pushed the eval-check branch 11 times, most recently from b13652a to e5f7abc Compare November 1, 2024 08:21
@Mic92 Mic92 force-pushed the eval-check branch 4 times, most recently from 83dbf45 to 4c16b97 Compare November 1, 2024 12:42
@Yethal
Copy link
Contributor

Yethal commented Nov 1, 2024

@Mic92 Is there a specific reason to use on push event and manually checking whether commit is part of PR instead of using on pull_request event directly?

@Mic92
Copy link
Member Author

Mic92 commented Nov 1, 2024

@Yethal yes, so that we have the runner limit of individual users instead of the NixOS org.

@Mic92 Mic92 force-pushed the eval-check branch 2 times, most recently from 0d12bd1 to ea49d72 Compare November 1, 2024 12:56
@ofborg ofborg bot added 10.rebuild-darwin: 0 This PR does not cause any packages to rebuild on Darwin. 10.rebuild-linux: 0 This PR does not cause any packages to rebuild on Linux. labels Nov 1, 2024
@nixos-discourse
Copy link

This pull request has been mentioned on NixOS Discourse. There might be relevant details there:

https://discourse.nixos.org/t/infrastructure-announcement-the-future-of-ofborg-your-help-needed/56025/1

@JohnRTitor
Copy link
Member

I'll suggest running merging this (keeping this alongside Ofborg) once it's stable enough. Then run it as a beta program for a few days, so we have sufficient confidence that it works seamlessly.

And in seems like contributer forks branchs need to be updated to take advantage of this.

@infinisil
Copy link
Member

New PR: #356023

For just evaluation (and those only taking 5 minutes on each arch) instead of also building, I don't think we need to do the running-on-forks dance.

- name: Set up Git
run: |
git config --global user.email "github-actions[bot]@users.noreply.github.com"
git config --global user.name "GitHub Actions"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One thing I've run into in the past is "global" can cause problems for other people.
Might it be worth switching to local (like this):

Suggested change
git config --global user.name "GitHub Actions"
git config --local user.name "GitHub Actions"

to not cause problems for other people?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It is "global" for the GH action run. So it doesn't really matter, I think

@infinisil
Copy link
Member

Superseded by #356023

@infinisil infinisil closed this Nov 18, 2024
Bot-wxt1221 pushed a commit to Bot-wxt1221/nixpkgs that referenced this pull request Nov 19, 2024
Motivated by ofborg struggling [1] and its evaluations taking too long,
inspired by Jörg's initial PR [2]
and Adam's previous attempt to parallelise Nixpkgs evaluation [3],
this PR contains initial work to relief ofborg from its evaluation duty
by using GitHub Actions to evaluate Nixpkgs.

For now this doesn't take care of all of what ofborg does, such as
requesting appropriate reviewers or labeling mass rebuilds, but this can
be follow-up work.

[1]: https://discourse.nixos.org/t/infrastructure-announcement-the-future-of-ofborg-your-help-needed/56025?u=infinisil
[2]: NixOS#352808
[3]: NixOS#269403

Co-Authored-By: Jörg Thalheim <[email protected]>
Co-Authored-By: Adam Joseph <[email protected]>
Bot-wxt1221 added a commit to Bot-wxt1221/nixpkgs that referenced this pull request Nov 19, 2024
* [WIP] Parallel GH actions workflow for Nixpkgs eval

Partly taken from NixOS#352808 and NixOS#269403

* ci/parallel.nix: nixfmt

* ci/eval: drop swap

Turns out we don't actually need it

* ci/eval: reformat with shfmt

the file was using mixed indentation (2 vs 4 spaces)

* ci/eval: depend on coreutils

nproc is only part of coreutils and not present on macOS

* ci/eval: allow to override cores

this is useful to control how much RAM is used during evaluation

* ci/eval: use xargs instead of parallel

saves us from having to install perl for this script.

* ci/eval: add quick test flag

* ci/eval: seperate different outputs in json

* WIP

* Update README.md

---------

Co-authored-by: Silvan Mosberger <[email protected]>
Co-authored-by: Jörg Thalheim <[email protected]>
Co-authored-by: Silvan Mosberger <[email protected]>
infinisil added a commit to tweag/nixpkgs that referenced this pull request Nov 20, 2024
Motivated by ofborg struggling [1] and its evaluations taking too long,
inspired by Jörg's initial PR [2]
and Adam's previous attempt to parallelise Nixpkgs evaluation [3],
this PR contains initial work to relief ofborg from its evaluation duty
by using GitHub Actions to evaluate Nixpkgs.

For now this doesn't take care of all of what ofborg does, such as
requesting appropriate reviewers or labeling mass rebuilds, but this can
be follow-up work.

[1]: https://discourse.nixos.org/t/infrastructure-announcement-the-future-of-ofborg-your-help-needed/56025?u=infinisil
[2]: NixOS#352808
[3]: NixOS#269403

Co-Authored-By: Jörg Thalheim <[email protected]>
Co-Authored-By: Adam Joseph <[email protected]>
infinisil added a commit to tweag/nixpkgs that referenced this pull request Nov 20, 2024
Motivated by ofborg struggling [1] and its evaluations taking too long,
inspired by Jörg's initial PR [2]
and Adam's previous attempt to parallelise Nixpkgs evaluation [3],
this PR contains initial work to relief ofborg from its evaluation duty
by using GitHub Actions to evaluate Nixpkgs.

For now this doesn't take care of all of what ofborg does, such as
requesting appropriate reviewers or labeling mass rebuilds, but this can
be follow-up work.

[1]: https://discourse.nixos.org/t/infrastructure-announcement-the-future-of-ofborg-your-help-needed/56025?u=infinisil
[2]: NixOS#352808
[3]: NixOS#269403

Co-Authored-By: Jörg Thalheim <[email protected]>
Co-Authored-By: Adam Joseph <[email protected]>
github-actions bot pushed a commit that referenced this pull request Nov 20, 2024
Motivated by ofborg struggling [1] and its evaluations taking too long,
inspired by Jörg's initial PR [2]
and Adam's previous attempt to parallelise Nixpkgs evaluation [3],
this PR contains initial work to relief ofborg from its evaluation duty
by using GitHub Actions to evaluate Nixpkgs.

For now this doesn't take care of all of what ofborg does, such as
requesting appropriate reviewers or labeling mass rebuilds, but this can
be follow-up work.

[1]: https://discourse.nixos.org/t/infrastructure-announcement-the-future-of-ofborg-your-help-needed/56025?u=infinisil
[2]: #352808
[3]: #269403

Co-Authored-By: Jörg Thalheim <[email protected]>
Co-Authored-By: Adam Joseph <[email protected]>
(cherry picked from commit fbbe972)
Mic92 added a commit to Mic92/nixpkgs that referenced this pull request Nov 21, 2024
Motivated by ofborg struggling [1] and its evaluations taking too long,
inspired by Jörg's initial PR [2]
and Adam's previous attempt to parallelise Nixpkgs evaluation [3],
this PR contains initial work to relief ofborg from its evaluation duty
by using GitHub Actions to evaluate Nixpkgs.

For now this doesn't take care of all of what ofborg does, such as
requesting appropriate reviewers or labeling mass rebuilds, but this can
be follow-up work.

[1]: https://discourse.nixos.org/t/infrastructure-announcement-the-future-of-ofborg-your-help-needed/56025?u=infinisil
[2]: NixOS#352808
[3]: NixOS#269403

Co-Authored-By: Jörg Thalheim <[email protected]>
Co-Authored-By: Adam Joseph <[email protected]>
github-actions bot pushed a commit to nix-community/nixpkgs.lib that referenced this pull request Nov 24, 2024
Motivated by ofborg struggling [1] and its evaluations taking too long,
inspired by Jörg's initial PR [2]
and Adam's previous attempt to parallelise Nixpkgs evaluation [3],
this PR contains initial work to relief ofborg from its evaluation duty
by using GitHub Actions to evaluate Nixpkgs.

For now this doesn't take care of all of what ofborg does, such as
requesting appropriate reviewers or labeling mass rebuilds, but this can
be follow-up work.

[1]: https://discourse.nixos.org/t/infrastructure-announcement-the-future-of-ofborg-your-help-needed/56025?u=infinisil
[2]: NixOS/nixpkgs#352808
[3]: NixOS/nixpkgs#269403

Co-Authored-By: Jörg Thalheim <[email protected]>
Co-Authored-By: Adam Joseph <[email protected]>
@Mic92 Mic92 deleted the eval-check branch January 18, 2025 16:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

6.topic: policy discussion Discuss policies to work in and around Nixpkgs 10.rebuild-darwin: 0 This PR does not cause any packages to rebuild on Darwin. 10.rebuild-linux: 0 This PR does not cause any packages to rebuild on Linux.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants